[2025-10-21T17:00:01.974687] [INFO ] [MAIN ] Using last completed trading day: 2025-10-21 [2025-10-21T17:00:02.196160] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-21T17:00:02.196319] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-21T17:00:02.271440] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-21T17:00:02.271868] [WARN ] [STATE ] State set to: RUNNING [2025-10-21T17:00:02.271961] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-21T17:00:02.272018] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-21T17:00:02.272162] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-21T17:00:02.272227] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-21T17:00:04.003231] [DEBUG] [SYMBOL ] Found 2418 valid NYSE symbols. [2025-10-21T17:00:04.003381] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-21T17:00:04.003584] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-21T17:00:04.004133] [INFO ] [LOCAL ] Symbols cache updated with 2366 symbols. [2025-10-21T17:00:04.004189] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-21T17:00:04.004219] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-21T17:00:04.004273] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-21T17:00:04.004311] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-21T17:00:04.004377] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-21T17:00:04.004800] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-21T17:00:04.004851] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-21T17:00:04.005006] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-21T17:00:04.005037] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2366 valid symbols. [2025-10-21T17:00:04.005074] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-21T17:00:04.005129] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-21T17:00:04.027546] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-21T17:00:04.050088] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-21T17:00:04.050146] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-21T17:00:04.050177] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-21T17:00:04.050204] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-21T17:00:04.050255] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-21T17:00:04.050594] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-21T17:00:04.050625] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-21T17:00:04.050686] [INFO ] [MAIN ] Starting incremental update for 2366 symbols. [2025-10-21T17:00:04.050729] [INFO ] [MAIN ] Running in parallel mode [2025-10-21T17:00:04.050890] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2366 symbols [2025-10-21T17:00:04.659184] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:04.731959] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:04.721018] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:04.732179] [DEBUG] [LOCAL ] AA: No existing data file found in primary storage. [2025-10-21T17:00:04.737355] [WARN ] [MAIN ] AA: No existing data found, performing full refresh instead. [2025-10-21T17:00:04.755459] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-21T17:00:04.762010] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:04.758132] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-21T17:00:04.762520] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-21T17:00:04.763110] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-21T17:00:04.762880] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-21T17:00:04.764309] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-21T17:00:04.764486] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-10-21T17:00:04.764769] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-21T17:00:04.764667] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-21T17:00:04.764863] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-21T17:00:05.079223] [DEBUG] [LOCAL ] AAMI: Loaded 24762 existing records from primary storage. [2025-10-21T17:00:05.179897] [INFO ] [MAIN ] AAMI: Loaded 24762 existing records. [2025-10-21T17:00:05.527785] [DEBUG] [LOCAL ] A: Loaded 50738 existing records from primary storage. [2025-10-21T17:00:05.555175] [INFO ] [MAIN ] A: Loaded 50738 existing records. [2025-10-21T17:00:05.696425] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:05.750892] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-21T17:00:05.852335] [WARN ] [MAIN ] AAMI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:00:05.865819] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-21T17:00:05.897380] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-21T17:00:05.901414] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:05.905728] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-21T17:00:05.905807] [DEBUG] [LOCAL ] AAMI: Deleted primary data file. [2025-10-21T17:00:05.905970] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-21T17:00:06.101460] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:00:06.111932] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-21T17:00:06.117123] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-21T17:00:06.148773] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-21T17:00:06.165933] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-21T17:00:06.381788] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-21T17:00:06.384402] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-21T17:00:06.522703] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:06.572551] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-10-21T17:00:06.720237] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:06.720501] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-21T17:00:06.788701] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-21T17:00:06.789535] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-21T17:00:07.188998] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-21T17:00:07.189927] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-21T17:00:07.645083] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-21T17:00:07.646238] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-21T17:00:07.657620] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-21T17:00:07.663528] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-10-21T17:00:07.987402] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-21T17:00:07.997992] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-21T17:00:08.023282] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-21T17:00:08.024458] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-21T17:00:08.066407] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T17:00:08.076410] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-21T17:00:08.319393] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-21T17:00:08.320541] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-21T17:00:08.668435] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-21T17:00:08.669714] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-21T17:00:08.732674] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T17:00:08.736680] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-10-21T17:00:09.030628] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-21T17:00:09.032222] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-21T17:00:09.372227] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-21T17:00:09.373202] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-21T17:00:09.693322] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-21T17:00:09.698405] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-10-21T17:00:09.768228] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-21T17:00:09.768984] [INFO ] [REMOTE ] AAM: Full fetch complete (914 records). [2025-10-21T17:00:09.769060] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-21T17:00:09.974063] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 184 unique days, need 200 days [2025-10-21T17:00:09.974571] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:00:09.974697] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:00:09.975192] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-21T17:00:09.975333] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-21T17:00:09.975432] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-21T17:00:09.975565] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-21T17:00:09.975758] [INFO ] [MAIN ] Update Progress: 1/2366 symbols completed. AAM took 5.9s. Estimated remaining: 3h 53m 33s. Rate: 10.1 symbols/min [2025-10-21T17:00:10.093790] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-21T17:00:10.100337] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-21T17:00:10.153941] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-21T17:00:10.155555] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-21T17:00:10.225750] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:10.282404] [DEBUG] [LOCAL ] AAP: Loaded 51783 existing records from primary storage. [2025-10-21T17:00:10.282751] [INFO ] [MAIN ] AAP: Loaded 51783 existing records. [2025-10-21T17:00:10.459192] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:00:10.459425] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-21T17:00:10.459494] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-21T17:00:10.459720] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-21T17:00:10.459776] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-21T17:00:10.847040] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:10.847377] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-21T17:00:10.987092] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-21T17:00:10.993525] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-10-21T17:00:12.056525] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T17:00:12.067850] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-21T17:00:12.172023] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-21T17:00:12.178037] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-10-21T17:00:12.232578] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-21T17:00:12.243600] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-21T17:00:12.275913] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T17:00:12.285867] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-21T17:00:13.261712] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-21T17:00:13.266834] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-10-21T17:00:13.782442] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T17:00:13.792338] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-21T17:00:13.825700] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T17:00:13.836993] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-21T17:00:14.235211] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-21T17:00:14.241242] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-10-21T17:00:14.976125] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-10-21T17:00:14.987878] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-21T17:00:15.429047] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-21T17:00:15.434381] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-10-21T17:00:15.606323] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T17:00:15.617009] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-21T17:00:15.686884] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T17:00:15.698048] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-21T17:00:16.816107] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T17:00:16.827097] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-21T17:00:17.124760] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T17:00:17.130818] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-10. [2025-10-21T17:00:17.597096] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T17:00:17.608873] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-21T17:00:17.939174] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-21T17:00:17.943163] [INFO ] [REMOTE ] AAMI: Full fetch complete (33073 records). [2025-10-21T17:00:17.943272] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-10-21T17:00:17.943866] [FATAL] [VALIDATOR ] AAMI: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:00:17.943983] [FATAL] [MAIN ] AAMI: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:00:17.944083] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:00:17.944192] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-21T17:00:17.944314] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-21T17:00:17.944374] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-21T17:00:17.944557] [DEBUG] [LOCAL ] AAMI: Deleted derivative data file. [2025-10-21T17:00:17.945182] [INFO ] [MAIN ] Update Progress: 2/2366 symbols completed. AAMI took 13.8s. Estimated remaining: 4h 33m 43s. Rate: 8.6 symbols/min [2025-10-21T17:00:18.115706] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:18.147892] [DEBUG] [LOCAL ] AAT: Loaded 30441 existing records from primary storage. [2025-10-21T17:00:18.148153] [INFO ] [MAIN ] AAT: Loaded 30441 existing records. [2025-10-21T17:00:18.336329] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:00:18.336585] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-21T17:00:18.336667] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-21T17:00:18.336881] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-21T17:00:18.336923] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-21T17:00:18.720817] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:18.721222] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-21T17:00:18.753573] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T17:00:18.764885] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-21T17:00:18.900501] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (3.20 seconds). [2025-10-21T17:00:18.911600] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-21T17:00:19.126805] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T17:00:19.138525] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-21T17:00:19.990416] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T17:00:19.995869] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-21T17:00:20.395130] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T17:00:20.406788] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-21T17:00:20.831157] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-21T17:00:20.843871] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-21T17:00:20.861629] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-21T17:00:20.868491] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-21T17:00:21.478713] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-21T17:00:21.490295] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-21T17:00:22.404379] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T17:00:22.411047] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-21T17:00:22.609428] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T17:00:22.621686] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-21T17:00:22.657279] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-21T17:00:22.670354] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-21T17:00:23.365246] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T17:00:23.377024] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-21T17:00:23.770594] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-21T17:00:23.782416] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-21T17:00:24.127836] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T17:00:24.144818] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-21T17:00:24.749249] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-21T17:00:24.766631] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-21T17:00:25.100470] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T17:00:25.111620] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-21T17:00:25.233234] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T17:00:25.240257] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-21T17:00:25.545436] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T17:00:25.553426] [INFO ] [REMOTE ] A: Full fetch complete (73227 records). [2025-10-21T17:00:25.553552] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-21T17:00:25.554243] [FATAL] [VALIDATOR ] A: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:00:25.554329] [FATAL] [MAIN ] A: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:00:25.554371] [WARN ] [MAIN ] A: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:00:25.554409] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-21T17:00:25.554465] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-10-21T17:00:25.554500] [INFO ] [LOCAL ] A: Starting deletion of derivative data. [2025-10-21T17:00:25.554621] [DEBUG] [LOCAL ] A: Deleted derivative data file. [2025-10-21T17:00:25.555096] [INFO ] [MAIN ] Update Progress: 3/2366 symbols completed. A took 21.5s. Estimated remaining: 4h 42m 18s. Rate: 8.4 symbols/min [2025-10-21T17:00:25.721541] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:25.721730] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-21T17:00:25.721777] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-21T17:00:25.721887] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-21T17:00:25.721928] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-21T17:00:25.721968] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-21T17:00:25.721999] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-21T17:00:26.075930] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:26.076252] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-10-21T17:00:26.531077] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:00:26.531392] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-10-21T17:00:26.531481] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:00:26.531553] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-21T17:00:26.531629] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:00:26.531742] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-21T17:00:26.531811] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-21T17:00:26.531848] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-21T17:00:26.531887] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-21T17:00:26.531938] [INFO ] [MAIN ] Update Progress: 4/2366 symbols completed. AAUC took 1.0s. Estimated remaining: 3h 41m 15s. Rate: 10.7 symbols/min [2025-10-21T17:00:26.636002] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T17:00:26.710040] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-21T17:00:26.744854] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:26.771305] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-21T17:00:26.781257] [INFO ] [REMOTE ] AA: Full fetch complete (77733 records). [2025-10-21T17:00:26.781461] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-21T17:00:27.065473] [DEBUG] [LOCAL ] AB: Loaded 25030 existing records from primary storage. [2025-10-21T17:00:27.115728] [INFO ] [MAIN ] AB: Loaded 25030 existing records. [2025-10-21T17:00:27.147802] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-21T17:00:27.270499] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-21T17:00:27.425400] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-21T17:00:27.431001] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-21T17:00:27.440346] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-21T17:00:27.457163] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-21T17:00:27.462167] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:00:27.462866] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-21T17:00:27.462997] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-21T17:00:27.463375] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-21T17:00:27.463436] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-21T17:00:27.494521] [DEBUG] [LOCAL ] AA: Trimmed 77733 records to 53622 (keeping 200 days of data) [2025-10-21T17:00:28.050079] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:28.051695] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-21T17:00:28.181617] [DEBUG] [LOCAL ] AA: Primary data saved (53622 records). [2025-10-21T17:00:28.182489] [INFO ] [MAIN ] AA: Full history saved. [2025-10-21T17:00:28.183518] [INFO ] [MAIN ] Update Progress: 5/2366 symbols completed. AA took 24.1s. Estimated remaining: 3h 9m 55s. Rate: 12.4 symbols/min [2025-10-21T17:00:28.183357] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T17:00:28.260823] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-21T17:00:28.362749] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:28.362954] [DEBUG] [LOCAL ] ABBV: No existing data file found in primary storage. [2025-10-21T17:00:28.362999] [WARN ] [MAIN ] ABBV: No existing data found, performing full refresh instead. [2025-10-21T17:00:28.363108] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-21T17:00:28.363150] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-21T17:00:28.363192] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-21T17:00:28.363225] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-21T17:00:28.742451] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:28.742877] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-21T17:00:29.052812] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T17:00:29.060588] [INFO ] [REMOTE ] AAP: Full fetch complete (75135 records). [2025-10-21T17:00:29.060751] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-21T17:00:29.458607] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-21T17:00:29.458842] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-21T17:00:29.459541] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-21T17:00:29.459620] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-21T17:00:29.461774] [DEBUG] [LOCAL ] AAP: Trimmed 75135 records to 51758 (keeping 200 days of data) [2025-10-21T17:00:29.725324] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T17:00:29.738672] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T17:00:29.747321] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-21T17:00:29.750052] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-21T17:00:29.829407] [DEBUG] [LOCAL ] AAP: Primary data saved (51758 records). [2025-10-21T17:00:29.829529] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-21T17:00:29.829898] [INFO ] [MAIN ] Update Progress: 6/2366 symbols completed. AAP took 19.9s. Estimated remaining: 2h 48m 60s. Rate: 14.0 symbols/min [2025-10-21T17:00:29.999350] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:29.999511] [DEBUG] [LOCAL ] ABCB: No existing data file found in primary storage. [2025-10-21T17:00:29.999548] [WARN ] [MAIN ] ABCB: No existing data found, performing full refresh instead. [2025-10-21T17:00:29.999684] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-21T17:00:29.999738] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-21T17:00:29.999780] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-10-21T17:00:29.999811] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-21T17:00:30.346913] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:30.347273] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-21T17:00:30.829612] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-21T17:00:30.840448] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-21T17:00:30.859482] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T17:00:30.866573] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-21T17:00:31.283409] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T17:00:31.292283] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-21T17:00:31.364205] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-21T17:00:31.370796] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-21T17:00:31.688314] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T17:00:31.693092] [INFO ] [REMOTE ] AAT: Full fetch complete (42854 records). [2025-10-21T17:00:31.693192] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-21T17:00:31.693791] [FATAL] [VALIDATOR ] AAT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:00:31.693874] [FATAL] [MAIN ] AAT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:00:31.693924] [WARN ] [MAIN ] AAT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:00:31.694032] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-21T17:00:31.694104] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-10-21T17:00:31.694140] [INFO ] [LOCAL ] AAT: Starting deletion of derivative data. [2025-10-21T17:00:31.694282] [DEBUG] [LOCAL ] AAT: Deleted derivative data file. [2025-10-21T17:00:31.694371] [INFO ] [MAIN ] Update Progress: 7/2366 symbols completed. AAT took 13.7s. Estimated remaining: 2h 35m 16s. Rate: 15.2 symbols/min [2025-10-21T17:00:31.874682] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:31.929187] [DEBUG] [LOCAL ] ABEV: Loaded 53291 existing records from primary storage. [2025-10-21T17:00:31.929524] [INFO ] [MAIN ] ABEV: Loaded 53291 existing records. [2025-10-21T17:00:32.117033] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:00:32.117244] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-21T17:00:32.117292] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-21T17:00:32.117600] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-21T17:00:32.117714] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-21T17:00:32.482406] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:32.482899] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-21T17:00:32.629353] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T17:00:32.639605] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-21T17:00:32.672603] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T17:00:32.678734] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-21T17:00:32.900050] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T17:00:32.910111] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-21T17:00:34.104952] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-21T17:00:34.112229] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-21T17:00:34.253150] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T17:00:34.263517] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-21T17:00:34.394392] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-21T17:00:34.405412] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-21T17:00:34.449119] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T17:00:34.457713] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-21T17:00:35.504639] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-21T17:00:35.512716] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-21T17:00:35.756758] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-21T17:00:35.762931] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-21T17:00:36.074236] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T17:00:36.084781] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-21T17:00:36.811178] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-21T17:00:36.818392] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-21T17:00:36.831960] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-21T17:00:36.836620] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-21T17:00:37.106505] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-21T17:00:37.117555] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-21T17:00:37.949037] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T17:00:37.954667] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-21T17:00:38.308709] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-21T17:00:38.319629] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-21T17:00:38.646120] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-21T17:00:38.651266] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-21T17:00:38.677034] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T17:00:38.682553] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-21T17:00:38.895810] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-21T17:00:38.906979] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-21T17:00:39.984035] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T17:00:39.989895] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-21T17:00:40.109629] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T17:00:40.116608] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-21T17:00:40.260489] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T17:00:40.271553] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-21T17:00:40.839472] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T17:00:40.850419] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-21T17:00:41.048664] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-21T17:00:41.055362] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-21T17:00:41.206477] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T17:00:41.210299] [INFO ] [REMOTE ] AB: Full fetch complete (44147 records). [2025-10-21T17:00:41.210384] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-21T17:00:41.587547] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-21T17:00:41.587670] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-21T17:00:41.588214] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-21T17:00:41.588260] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-21T17:00:41.589363] [DEBUG] [LOCAL ] AB: Trimmed 44147 records to 24859 (keeping 200 days of data) [2025-10-21T17:00:41.743469] [DEBUG] [LOCAL ] AB: Primary data saved (24859 records). [2025-10-21T17:00:41.743605] [INFO ] [MAIN ] AB: Full history saved. [2025-10-21T17:00:41.743710] [INFO ] [MAIN ] Update Progress: 8/2366 symbols completed. AB took 15.2s. Estimated remaining: 3h 5m 10s. Rate: 12.7 symbols/min [2025-10-21T17:00:41.918097] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:41.948025] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T17:00:41.959399] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-21T17:00:41.972306] [DEBUG] [LOCAL ] ABG: Loaded 18128 existing records from primary storage. [2025-10-21T17:00:41.972517] [INFO ] [MAIN ] ABG: Loaded 18128 existing records. [2025-10-21T17:00:42.149187] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:00:42.149460] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-21T17:00:42.149535] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-21T17:00:42.149744] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-21T17:00:42.149804] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-21T17:00:42.523949] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:42.524410] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-21T17:00:42.553490] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T17:00:42.560563] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-21T17:00:42.898874] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-21T17:00:42.910917] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-21T17:00:43.608576] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-21T17:00:43.615294] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-21T17:00:43.672962] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T17:00:43.684542] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-21T17:00:43.705576] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-21T17:00:43.713686] [INFO ] [REMOTE ] ABCB: Full fetch complete (44891 records). [2025-10-21T17:00:43.713823] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-21T17:00:44.091558] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-21T17:00:44.091668] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-21T17:00:44.092130] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-21T17:00:44.092172] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-21T17:00:44.093098] [DEBUG] [LOCAL ] ABCB: Trimmed 44891 records to 30362 (keeping 200 days of data) [2025-10-21T17:00:44.272142] [DEBUG] [LOCAL ] ABCB: Primary data saved (30362 records). [2025-10-21T17:00:44.272270] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-21T17:00:44.272343] [INFO ] [MAIN ] Update Progress: 9/2366 symbols completed. ABCB took 14.4s. Estimated remaining: 2h 55m 34s. Rate: 13.4 symbols/min [2025-10-21T17:00:44.447839] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:44.479950] [DEBUG] [LOCAL ] ABM: Loaded 32177 existing records from primary storage. [2025-10-21T17:00:44.480215] [INFO ] [MAIN ] ABM: Loaded 32177 existing records. [2025-10-21T17:00:44.665078] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:00:44.665511] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-21T17:00:44.665691] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-21T17:00:44.674560] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-21T17:00:44.674800] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-21T17:00:44.675595] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-21T17:00:44.715541] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-21T17:00:45.071797] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:45.066576] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-21T17:00:45.072112] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-21T17:00:45.084172] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-21T17:00:45.847621] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-21T17:00:45.859792] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-21T17:00:45.873434] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-21T17:00:45.878517] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-21T17:00:46.801703] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T17:00:46.807829] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-21T17:00:46.893181] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-21T17:00:46.902113] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-21T17:00:46.971861] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-21T17:00:46.983390] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-21T17:00:47.547863] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T17:00:47.559125] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-21T17:00:47.726855] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-21T17:00:47.736692] [INFO ] [REMOTE ] ABBV: Full fetch complete (77846 records). [2025-10-21T17:00:47.736846] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-21T17:00:47.944402] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T17:00:47.980704] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-21T17:00:48.165930] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-21T17:00:48.189719] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-21T17:00:48.189833] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-21T17:00:48.190586] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-21T17:00:48.190930] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-21T17:00:48.191016] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-21T17:00:48.193080] [DEBUG] [LOCAL ] ABBV: Trimmed 77846 records to 53682 (keeping 200 days of data) [2025-10-21T17:00:48.519602] [DEBUG] [LOCAL ] ABBV: Primary data saved (53682 records). [2025-10-21T17:00:48.519768] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-21T17:00:48.519845] [INFO ] [MAIN ] Update Progress: 10/2366 symbols completed. ABBV took 20.3s. Estimated remaining: 2h 54m 37s. Rate: 13.5 symbols/min [2025-10-21T17:00:48.686474] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:48.738295] [DEBUG] [LOCAL ] ABR: Loaded 51949 existing records from primary storage. [2025-10-21T17:00:48.738610] [INFO ] [MAIN ] ABR: Loaded 51949 existing records. [2025-10-21T17:00:48.916937] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:00:48.917961] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-21T17:00:48.918067] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-21T17:00:48.918322] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-21T17:00:48.918410] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-21T17:00:49.162865] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T17:00:49.211906] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-21T17:00:49.343454] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:49.343878] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-21T17:00:49.411334] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T17:00:49.423511] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-21T17:00:49.445225] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T17:00:49.452828] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-21T17:00:50.060478] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-21T17:00:50.065275] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-21T17:00:50.972141] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T17:00:50.980341] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-21T17:00:51.042424] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-21T17:00:51.051272] [INFO ] [REMOTE ] ABEV: Full fetch complete (77342 records). [2025-10-21T17:00:51.051392] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-21T17:00:51.366341] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-21T17:00:51.376637] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-21T17:00:51.469408] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-21T17:00:51.484070] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-21T17:00:51.485614] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-21T17:00:51.495071] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-21T17:00:51.496919] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-21T17:00:51.507182] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-21T17:00:51.508472] [DEBUG] [LOCAL ] ABEV: Trimmed 77342 records to 53287 (keeping 200 days of data) [2025-10-21T17:00:51.809111] [DEBUG] [LOCAL ] ABEV: Primary data saved (53287 records). [2025-10-21T17:00:51.809438] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-21T17:00:51.809699] [INFO ] [MAIN ] Update Progress: 11/2366 symbols completed. ABEV took 20.1s. Estimated remaining: 2h 50m 25s. Rate: 13.8 symbols/min [2025-10-21T17:00:51.939625] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T17:00:51.966748] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-21T17:00:52.021803] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:52.072395] [DEBUG] [LOCAL ] ABT: Loaded 53622 existing records from primary storage. [2025-10-21T17:00:52.072744] [INFO ] [MAIN ] ABT: Loaded 53622 existing records. [2025-10-21T17:00:52.271188] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:00:52.271447] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-21T17:00:52.271506] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-21T17:00:52.271751] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-21T17:00:52.271819] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-21T17:00:52.664023] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:52.674179] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-21T17:00:52.675269] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T17:00:52.680757] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-21T17:00:53.510519] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T17:00:53.524786] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-21T17:00:53.525545] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-21T17:00:53.529310] [INFO ] [REMOTE ] ABG: Full fetch complete (26609 records). [2025-10-21T17:00:53.529398] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-21T17:00:53.529951] [FATAL] [VALIDATOR ] ABG: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:00:53.530096] [FATAL] [MAIN ] ABG: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:00:53.530139] [WARN ] [MAIN ] ABG: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:00:53.530207] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-21T17:00:53.530269] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-10-21T17:00:53.530304] [INFO ] [LOCAL ] ABG: Starting deletion of derivative data. [2025-10-21T17:00:53.530504] [DEBUG] [LOCAL ] ABG: Deleted derivative data file. [2025-10-21T17:00:53.530595] [INFO ] [MAIN ] Update Progress: 12/2366 symbols completed. ABG took 11.8s. Estimated remaining: 2h 41m 46s. Rate: 14.6 symbols/min [2025-10-21T17:00:53.703917] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:53.704088] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-10-21T17:00:53.704124] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-10-21T17:00:53.704231] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-21T17:00:53.704271] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-21T17:00:53.704311] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-21T17:00:53.704342] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-21T17:00:54.073311] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:54.073626] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-21T17:00:54.292023] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (2.78 seconds). [2025-10-21T17:00:54.302074] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-21T17:00:55.048108] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T17:00:55.099620] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-21T17:00:55.105835] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-21T17:00:55.123173] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-21T17:00:55.344039] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T17:00:55.349951] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-21T17:00:56.289853] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T17:00:56.302470] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-21T17:00:56.472434] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T17:00:56.480299] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-21T17:00:56.538127] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T17:00:56.543431] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-21T17:00:56.932510] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T17:00:56.942682] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-21T17:00:57.619225] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T17:00:57.625878] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-21T17:00:57.706023] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-21T17:00:57.718437] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-21T17:00:58.112078] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T17:00:58.123356] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-21T17:00:58.813845] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T17:00:58.824825] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-21T17:00:58.996490] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-21T17:00:59.002606] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-21T17:00:59.100128] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T17:00:59.105288] [INFO ] [REMOTE ] ABM: Full fetch complete (44982 records). [2025-10-21T17:00:59.105389] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-21T17:00:59.484038] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-21T17:00:59.484161] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-21T17:00:59.484611] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-21T17:00:59.484706] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-21T17:00:59.485621] [DEBUG] [LOCAL ] ABM: Trimmed 44982 records to 32115 (keeping 200 days of data) [2025-10-21T17:00:59.679156] [DEBUG] [LOCAL ] ABM: Primary data saved (32115 records). [2025-10-21T17:00:59.679283] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-21T17:00:59.679363] [INFO ] [MAIN ] Update Progress: 13/2366 symbols completed. ABM took 15.4s. Estimated remaining: 2h 47m 49s. Rate: 14.0 symbols/min [2025-10-21T17:00:59.855544] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:59.888449] [DEBUG] [LOCAL ] ACCO: Loaded 36838 existing records from primary storage. [2025-10-21T17:00:59.894054] [INFO ] [MAIN ] ACCO: Loaded 36838 existing records. [2025-10-21T17:00:59.981143] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-21T17:01:00.034944] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-21T17:01:00.096253] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:01:00.096631] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-21T17:01:00.096806] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-21T17:01:00.097238] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-21T17:01:00.097377] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-21T17:01:00.309245] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-21T17:01:00.428759] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-21T17:01:00.518739] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:01:00.519054] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-21T17:01:00.799799] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-21T17:01:00.811185] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-21T17:01:01.276381] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-21T17:01:01.282144] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-21T17:01:01.949436] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T17:01:01.958246] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-21T17:01:02.102351] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T17:01:02.113251] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-21T17:01:02.494176] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-21T17:01:02.499471] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-21T17:01:02.681470] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T17:01:02.693060] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-21T17:01:02.961800] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-21T17:01:02.969110] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-21T17:01:03.637638] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T17:01:03.644271] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-21T17:01:03.740128] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-21T17:01:03.751380] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-21T17:01:04.227712] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-21T17:01:04.236444] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-21T17:01:04.315923] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T17:01:04.505890] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-21T17:01:04.951111] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-21T17:01:05.621028] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T17:01:05.750998] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-21T17:01:05.847589] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T17:01:05.988310] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T17:01:05.991868] [INFO ] [REMOTE ] ACA: Full fetch complete (34151 records). [2025-10-21T17:01:05.991987] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-21T17:01:05.992575] [FATAL] [VALIDATOR ] ACA: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:01:05.992682] [FATAL] [MAIN ] ACA: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:01:05.992735] [WARN ] [MAIN ] ACA: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:01:05.992802] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-21T17:01:05.992869] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-21T17:01:05.992905] [INFO ] [LOCAL ] ACA: Starting deletion of derivative data. [2025-10-21T17:01:05.992942] [DEBUG] [LOCAL ] ACA: No derivative data file found to delete. [2025-10-21T17:01:05.992995] [INFO ] [MAIN ] Update Progress: 14/2366 symbols completed. ACA took 12.5s. Estimated remaining: 2h 53m 26s. Rate: 13.6 symbols/min [2025-10-21T17:01:06.166337] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:01:06.212790] [DEBUG] [LOCAL ] ACEL: Loaded 26577 existing records from primary storage. [2025-10-21T17:01:06.213081] [INFO ] [MAIN ] ACEL: Loaded 26577 existing records. [2025-10-21T17:01:06.395871] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:01:06.396297] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-21T17:01:06.396346] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-21T17:01:06.396802] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-21T17:01:06.396861] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-21T17:01:06.557575] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-21T17:01:06.770769] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:01:07.351066] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-21T17:01:07.592933] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T17:01:07.743135] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T17:01:08.151137] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-21T17:01:08.951007] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-21T17:01:09.358835] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-21T17:01:09.450715] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-21T17:01:09.751103] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-21T17:01:09.995315] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T17:01:10.551084] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-21T17:01:11.351080] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-21T17:01:11.735950] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-21T17:01:11.744741] [INFO ] [REMOTE ] ABR: Full fetch complete (75397 records). [2025-10-21T17:01:11.744905] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-21T17:01:11.958810] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T17:01:12.156326] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-21T17:01:12.207424] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-21T17:01:12.207510] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-21T17:01:12.208303] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-21T17:01:12.208401] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-21T17:01:12.209938] [DEBUG] [LOCAL ] ABR: Trimmed 75397 records to 51919 (keeping 200 days of data) [2025-10-21T17:01:12.545723] [DEBUG] [LOCAL ] ABR: Primary data saved (51919 records). [2025-10-21T17:01:12.545869] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-21T17:01:12.545952] [INFO ] [MAIN ] Update Progress: 15/2366 symbols completed. ABR took 24.0s. Estimated remaining: 2h 58m 55s. Rate: 13.1 symbols/min [2025-10-21T17:01:12.720911] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:01:12.769963] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-21T17:01:12.770332] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-10-21T17:01:12.952968] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-21T17:01:12.956703] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:01:12.958115] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-21T17:01:12.958508] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-21T17:01:12.958863] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-21T17:01:12.958930] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-21T17:01:13.353452] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T17:01:13.370993] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:01:13.751075] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-21T17:01:13.827614] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T17:01:14.517055] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T17:01:14.551039] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-21T17:01:15.351052] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-21T17:01:15.536570] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T17:01:15.990625] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T17:01:16.151079] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-21T17:01:16.769008] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T17:01:16.867952] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-21T17:01:16.877721] [INFO ] [REMOTE ] ABT: Full fetch complete (77770 records). [2025-10-21T17:01:16.877907] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-21T17:01:16.956181] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-21T17:01:17.409431] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-21T17:01:17.409585] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-21T17:01:17.410909] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-21T17:01:17.411000] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-21T17:01:17.413116] [DEBUG] [LOCAL ] ABT: Trimmed 77770 records to 53623 (keeping 200 days of data) [2025-10-21T17:01:17.751114] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-21T17:01:17.843135] [DEBUG] [LOCAL ] ABT: Primary data saved (53623 records). [2025-10-21T17:01:17.843284] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-21T17:01:17.843367] [INFO ] [MAIN ] Update Progress: 16/2366 symbols completed. ABT took 26.0s. Estimated remaining: 3h 0m 38s. Rate: 13.0 symbols/min [2025-10-21T17:01:18.033283] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:01:18.033519] [DEBUG] [LOCAL ] ACI: No existing data file found in primary storage. [2025-10-21T17:01:18.033567] [WARN ] [MAIN ] ACI: No existing data found, performing full refresh instead. [2025-10-21T17:01:18.033721] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-21T17:01:18.033776] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-21T17:01:18.033821] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-10-21T17:01:18.033854] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-21T17:01:18.411173] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:01:18.432220] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T17:01:18.551037] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-21T17:01:19.083155] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-21T17:01:19.351049] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-21T17:01:20.151054] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-21T17:01:20.430924] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T17:01:20.487968] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T17:01:20.951107] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-21T17:01:21.751115] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-21T17:01:22.551145] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-21T17:01:22.638230] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T17:01:22.756139] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-21T17:01:23.132844] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T17:01:23.139241] [INFO ] [REMOTE ] ACCO: Full fetch complete (53994 records). [2025-10-21T17:01:23.139392] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-21T17:01:23.356936] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-21T17:01:23.603189] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-21T17:01:23.603338] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-21T17:01:23.604314] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-21T17:01:23.604425] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-21T17:01:23.605802] [DEBUG] [LOCAL ] ACCO: Trimmed 53994 records to 36747 (keeping 200 days of data) [2025-10-21T17:01:23.714824] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T17:01:23.849531] [DEBUG] [LOCAL ] ACCO: Primary data saved (36747 records). [2025-10-21T17:01:23.849728] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-21T17:01:23.849879] [INFO ] [MAIN ] Update Progress: 17/2366 symbols completed. ACCO took 24.2s. Estimated remaining: 3h 3m 46s. Rate: 12.8 symbols/min [2025-10-21T17:01:24.041893] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:01:24.083465] [DEBUG] [LOCAL ] ACM: Loaded 42890 existing records from primary storage. [2025-10-21T17:01:24.083812] [INFO ] [MAIN ] ACM: Loaded 42890 existing records. [2025-10-21T17:01:24.159631] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-21T17:01:24.271173] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:01:24.271380] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-21T17:01:24.271427] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-21T17:01:24.271621] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-21T17:01:24.271701] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-21T17:01:24.637765] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:01:24.951094] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-21T17:01:25.397391] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T17:01:25.751052] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-21T17:01:25.939914] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-21T17:01:26.529748] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T17:01:26.550989] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-21T17:01:26.843114] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-21T17:01:27.351055] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-21T17:01:28.151008] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-21T17:01:28.541007] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T17:01:28.545069] [INFO ] [REMOTE ] ACEL: Full fetch complete (38697 records). [2025-10-21T17:01:28.545182] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-21T17:01:28.934068] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-21T17:01:28.934173] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-21T17:01:28.934779] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-21T17:01:28.934900] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-21T17:01:28.936085] [DEBUG] [LOCAL ] ACEL: Trimmed 38697 records to 26474 (keeping 200 days of data) [2025-10-21T17:01:28.992480] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-21T17:01:29.141843] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-21T17:01:29.140173] [DEBUG] [LOCAL ] ACEL: Primary data saved (26474 records). [2025-10-21T17:01:29.153800] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-21T17:01:29.154323] [INFO ] [MAIN ] Update Progress: 18/2366 symbols completed. ACEL took 23.2s. Estimated remaining: 3h 5m 1s. Rate: 12.7 symbols/min [2025-10-21T17:01:29.329599] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:01:29.392374] [DEBUG] [LOCAL ] ACN: Loaded 53440 existing records from primary storage. [2025-10-21T17:01:29.392842] [INFO ] [MAIN ] ACN: Loaded 53440 existing records. [2025-10-21T17:01:29.589067] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:01:29.589372] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-21T17:01:29.589442] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-21T17:01:29.589685] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-21T17:01:29.589754] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-21T17:01:29.753169] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-21T17:01:29.978957] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:01:30.017788] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T17:01:30.551000] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-21T17:01:30.608938] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T17:01:31.351052] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-21T17:01:32.156229] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-21T17:01:32.184953] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-21T17:01:32.732421] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-21T17:01:32.951023] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-21T17:01:33.142343] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T17:01:33.751001] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-21T17:01:33.847014] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:01:34.551081] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-21T17:01:35.351004] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-21T17:01:35.626109] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T17:01:35.708630] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-10-21T17:01:35.934568] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T17:01:36.151032] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-21T17:01:36.949792] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-21T17:01:36.958629] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-21T17:01:37.751163] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-21T17:01:38.260607] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-21T17:01:38.551078] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-21T17:01:38.722085] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T17:01:39.351083] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-21T17:01:40.151138] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-21T17:01:40.398015] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-10-21T17:01:40.596137] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-21T17:01:40.951080] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-21T17:01:40.988214] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T17:01:41.650622] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T17:01:41.751092] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-21T17:01:42.551072] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-21T17:01:43.351093] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-21T17:01:43.383678] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T17:01:43.749899] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-10-21T17:01:44.151186] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-21T17:01:44.439957] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T17:01:44.951242] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-21T17:01:45.354369] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T17:01:45.751027] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-21T17:01:46.550999] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-21T17:01:46.662321] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T17:01:46.782670] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-21T17:01:47.351088] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-21T17:01:47.621166] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T17:01:48.151024] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-21T17:01:48.418071] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-21T17:01:48.951863] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-21T17:01:48.957504] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T17:01:49.751095] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-21T17:01:50.240814] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-21T17:01:50.249306] [INFO ] [REMOTE ] ACI: Full fetch complete (77233 records). [2025-10-21T17:01:50.249473] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-21T17:01:50.552147] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-21T17:01:50.654766] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-21T17:01:50.654858] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-21T17:01:50.655575] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-21T17:01:50.655621] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-21T17:01:50.657421] [DEBUG] [LOCAL ] ACI: Trimmed 77233 records to 53286 (keeping 200 days of data) [2025-10-21T17:01:50.986337] [DEBUG] [LOCAL ] ACI: Primary data saved (53286 records). [2025-10-21T17:01:50.986464] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-21T17:01:50.986553] [INFO ] [MAIN ] Update Progress: 19/2366 symbols completed. ACI took 33.1s. Estimated remaining: 3h 40m 9s. Rate: 10.7 symbols/min [2025-10-21T17:01:51.163026] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:01:51.203907] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-21T17:01:51.226661] [DEBUG] [LOCAL ] ACP: Loaded 31109 existing records from primary storage. [2025-10-21T17:01:51.226935] [INFO ] [MAIN ] ACP: Loaded 31109 existing records. [2025-10-21T17:01:51.365582] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-21T17:01:51.407395] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:01:51.407745] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-21T17:01:51.407843] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-21T17:01:51.408133] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-21T17:01:51.408264] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-21T17:01:51.714883] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-21T17:01:51.801533] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:01:52.151132] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-21T17:01:52.951060] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-21T17:01:53.075241] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-21T17:01:53.503057] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-21T17:01:53.751115] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-21T17:01:53.868164] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T17:01:54.551087] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-21T17:01:54.664401] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T17:01:54.671726] [INFO ] [REMOTE ] ACM: Full fetch complete (63285 records). [2025-10-21T17:01:54.671888] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-21T17:01:55.096934] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-21T17:01:55.097026] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-21T17:01:55.097688] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-21T17:01:55.097752] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-21T17:01:55.099237] [DEBUG] [LOCAL ] ACM: Trimmed 63285 records to 42827 (keeping 200 days of data) [2025-10-21T17:01:55.351912] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-21T17:01:55.388227] [DEBUG] [LOCAL ] ACM: Primary data saved (42827 records). [2025-10-21T17:01:55.388677] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-21T17:01:55.390874] [INFO ] [MAIN ] Update Progress: 20/2366 symbols completed. ACM took 31.5s. Estimated remaining: 3h 37m 40s. Rate: 10.8 symbols/min [2025-10-21T17:01:55.581093] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:01:55.581472] [DEBUG] [LOCAL ] ACR: No existing data file found in primary storage. [2025-10-21T17:01:55.581589] [WARN ] [MAIN ] ACR: No existing data found, performing full refresh instead. [2025-10-21T17:01:55.581793] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-21T17:01:55.582028] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-21T17:01:55.582205] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-10-21T17:01:55.582353] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-21T17:01:55.714010] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-21T17:01:55.990637] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:01:56.112466] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-21T17:01:56.120470] [INFO ] [REMOTE ] ACHR: Full fetch complete (77608 records). [2025-10-21T17:01:56.120611] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-21T17:01:56.121429] [FATAL] [VALIDATOR ] ACHR: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:01:56.121515] [FATAL] [MAIN ] ACHR: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:01:56.121557] [WARN ] [MAIN ] ACHR: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:01:56.121624] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-21T17:01:56.121745] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-10-21T17:01:56.121825] [INFO ] [LOCAL ] ACHR: Starting deletion of derivative data. [2025-10-21T17:01:56.121948] [DEBUG] [LOCAL ] ACHR: Deleted derivative data file. [2025-10-21T17:01:56.122020] [INFO ] [MAIN ] Update Progress: 21/2366 symbols completed. ACHR took 43.6s. Estimated remaining: 3h 28m 35s. Rate: 11.2 symbols/min [2025-10-21T17:01:56.156150] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-21T17:01:56.299600] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:01:56.299798] [DEBUG] [LOCAL ] ACRE: No existing data file found in primary storage. [2025-10-21T17:01:56.299841] [WARN ] [MAIN ] ACRE: No existing data found, performing full refresh instead. [2025-10-21T17:01:56.299954] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-21T17:01:56.299995] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-21T17:01:56.300036] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-10-21T17:01:56.300067] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-21T17:01:56.656494] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:01:56.954075] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-21T17:01:56.954898] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-21T17:01:57.546261] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-21T17:01:57.751050] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-21T17:01:58.303321] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T17:01:58.409701] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-21T17:01:58.418671] [INFO ] [REMOTE ] ACN: Full fetch complete (77405 records). [2025-10-21T17:01:58.418821] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-21T17:01:58.556099] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-21T17:01:58.863040] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-21T17:01:58.863127] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-21T17:01:58.863852] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-21T17:01:58.863918] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-21T17:01:58.865422] [DEBUG] [LOCAL ] ACN: Trimmed 77405 records to 53440 (keeping 200 days of data) [2025-10-21T17:01:59.242330] [DEBUG] [LOCAL ] ACN: Primary data saved (53440 records). [2025-10-21T17:01:59.242480] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-21T17:01:59.244267] [INFO ] [MAIN ] Update Progress: 22/2366 symbols completed. ACN took 30.1s. Estimated remaining: 3h 24m 33s. Rate: 11.5 symbols/min [2025-10-21T17:01:59.351068] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-21T17:01:59.425701] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:01:59.425858] [DEBUG] [LOCAL ] ACV: No existing data file found in primary storage. [2025-10-21T17:01:59.425897] [WARN ] [MAIN ] ACV: No existing data found, performing full refresh instead. [2025-10-21T17:01:59.426006] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-21T17:01:59.426049] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-21T17:01:59.426091] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-10-21T17:01:59.426125] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-21T17:01:59.803824] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:02:00.149240] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T17:02:00.157358] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-21T17:02:00.385947] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T17:02:00.951044] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-21T17:02:01.704419] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T17:02:01.751006] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-21T17:02:02.160981] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T17:02:02.551095] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-21T17:02:03.351053] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-21T17:02:03.505074] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-21T17:02:03.505274] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T17:02:04.151069] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-21T17:02:04.805526] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-21T17:02:04.852817] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-21T17:02:04.951063] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-21T17:02:05.751040] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-21T17:02:06.425089] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-21T17:02:06.551041] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-21T17:02:06.563445] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T17:02:07.351054] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-21T17:02:07.944770] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T17:02:08.011760] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-21T17:02:08.151039] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-21T17:02:08.951054] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-21T17:02:09.529680] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T17:02:09.751049] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-21T17:02:09.774410] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T17:02:10.551029] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-21T17:02:11.113469] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-21T17:02:11.322957] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T17:02:11.350997] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-21T17:02:11.951504] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-21T17:02:12.151018] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-21T17:02:12.792953] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T17:02:12.951056] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-21T17:02:13.594442] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-21T17:02:13.751084] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-21T17:02:14.378244] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-21T17:02:14.551063] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-21T17:02:15.161283] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-21T17:02:15.351028] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-21T17:02:15.938760] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-21T17:02:16.151042] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-21T17:02:16.951026] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-21T17:02:17.594787] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T17:02:17.635159] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-21T17:02:17.751037] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-21T17:02:18.375152] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-21T17:02:18.551046] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-21T17:02:19.006550] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-21T17:02:19.351037] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-21T17:02:19.967056] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-21T17:02:20.151042] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-21T17:02:20.951029] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-21T17:02:21.459857] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T17:02:21.474231] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-21T17:02:21.751034] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-21T17:02:22.551109] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-21T17:02:22.676373] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T17:02:22.678632] [INFO ] [REMOTE ] ACV: Full fetch complete (10460 records). [2025-10-21T17:02:22.678741] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-21T17:02:23.098818] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-21T17:02:23.098928] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-21T17:02:23.099156] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-21T17:02:23.099200] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-21T17:02:23.099688] [DEBUG] [LOCAL ] ACV: Trimmed 10460 records to 7423 (keeping 200 days of data) [2025-10-21T17:02:23.149224] [DEBUG] [LOCAL ] ACV: Primary data saved (7423 records). [2025-10-21T17:02:23.149392] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-21T17:02:23.149496] [INFO ] [MAIN ] Update Progress: 23/2366 symbols completed. ACV took 23.9s. Estimated remaining: 3h 56m 10s. Rate: 9.9 symbols/min [2025-10-21T17:02:23.321122] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:02:23.351944] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-21T17:02:23.376898] [DEBUG] [LOCAL ] ACVA: Loaded 49252 existing records from primary storage. [2025-10-21T17:02:23.377212] [INFO ] [MAIN ] ACVA: Loaded 49252 existing records. [2025-10-21T17:02:23.569104] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:02:23.569428] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-21T17:02:23.569613] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-21T17:02:23.569927] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-21T17:02:23.569985] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-21T17:02:23.705612] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-21T17:02:23.758003] [INFO ] [REMOTE ] ACP: Full fetch complete (46437 records). [2025-10-21T17:02:23.784215] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-21T17:02:24.182065] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:02:24.160272] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-21T17:02:24.387551] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-21T17:02:24.387665] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-21T17:02:24.388174] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-21T17:02:24.388220] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-21T17:02:24.389345] [DEBUG] [LOCAL ] ACP: Trimmed 46437 records to 31078 (keeping 200 days of data) [2025-10-21T17:02:24.567354] [DEBUG] [LOCAL ] ACP: Primary data saved (31078 records). [2025-10-21T17:02:24.567539] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-21T17:02:24.567629] [INFO ] [MAIN ] Update Progress: 24/2366 symbols completed. ACP took 33.6s. Estimated remaining: 3h 48m 32s. Rate: 10.2 symbols/min [2025-10-21T17:02:24.737871] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:02:24.738157] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-21T17:02:24.738223] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-21T17:02:24.738458] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-21T17:02:24.738515] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-21T17:02:24.738573] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-21T17:02:24.738619] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-21T17:02:24.956083] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-21T17:02:25.016752] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T17:02:25.133039] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:02:25.136206] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T17:02:25.137252] [INFO ] [REMOTE ] ACR: Full fetch complete (8529 records). [2025-10-21T17:02:25.137320] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-21T17:02:25.137666] [FATAL] [VALIDATOR ] ACR: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:02:25.137747] [FATAL] [MAIN ] ACR: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:02:25.137790] [WARN ] [MAIN ] ACR: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:02:25.137855] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-21T17:02:25.137915] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-10-21T17:02:25.137950] [INFO ] [LOCAL ] ACR: Starting deletion of derivative data. [2025-10-21T17:02:25.137988] [DEBUG] [LOCAL ] ACR: No derivative data file found to delete. [2025-10-21T17:02:25.138040] [INFO ] [MAIN ] Update Progress: 25/2366 symbols completed. ACR took 29.7s. Estimated remaining: 3h 40m 11s. Rate: 10.6 symbols/min [2025-10-21T17:02:25.306244] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:02:25.357421] [DEBUG] [LOCAL ] ADC: Loaded 46431 existing records from primary storage. [2025-10-21T17:02:25.357795] [INFO ] [MAIN ] ADC: Loaded 46431 existing records. [2025-10-21T17:02:25.535171] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:02:25.535410] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-21T17:02:25.535458] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-21T17:02:25.535630] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-21T17:02:25.535715] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-21T17:02:25.756178] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-10-21T17:02:25.895191] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:02:26.026404] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:02:26.026833] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-10-21T17:02:26.026933] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:02:26.027015] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-21T17:02:26.027088] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:02:26.027171] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-21T17:02:26.027250] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-21T17:02:26.027312] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-21T17:02:26.027396] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-21T17:02:26.027482] [INFO ] [MAIN ] Update Progress: 26/2366 symbols completed. AD took 1.5s. Estimated remaining: 3h 32m 58s. Rate: 11.0 symbols/min [2025-10-21T17:02:26.222123] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:02:26.222266] [DEBUG] [LOCAL ] ADCT: No existing data file found in primary storage. [2025-10-21T17:02:26.222302] [WARN ] [MAIN ] ADCT: No existing data found, performing full refresh instead. [2025-10-21T17:02:26.222410] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-21T17:02:26.222451] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-21T17:02:26.222491] [DEBUG] [LOCAL ] ADCT: No primary data file found to delete. [2025-10-21T17:02:26.222523] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-21T17:02:26.556242] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-21T17:02:26.621584] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:02:26.694987] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T17:02:27.351221] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-21T17:02:28.151192] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-21T17:02:28.223158] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T17:02:28.803983] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T17:02:28.951110] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-21T17:02:29.582587] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T17:02:29.751061] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-21T17:02:30.560220] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-21T17:02:30.586814] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T17:02:31.303419] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-21T17:02:31.351034] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-21T17:02:31.935692] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T17:02:32.151020] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-21T17:02:32.741627] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-21T17:02:32.951019] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-21T17:02:33.759546] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-21T17:02:33.765899] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T17:02:34.560620] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-21T17:02:34.598281] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T17:02:35.266284] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T17:02:35.351023] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-21T17:02:36.151046] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-21T17:02:36.279323] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T17:02:36.703345] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T17:02:36.708605] [INFO ] [REMOTE ] ACRE: Full fetch complete (49397 records). [2025-10-21T17:02:36.708786] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-21T17:02:36.709394] [FATAL] [VALIDATOR ] ACRE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:02:36.709486] [FATAL] [MAIN ] ACRE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:02:36.709531] [WARN ] [MAIN ] ACRE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:02:36.709594] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-21T17:02:36.709714] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-10-21T17:02:36.709780] [INFO ] [LOCAL ] ACRE: Starting deletion of derivative data. [2025-10-21T17:02:36.709836] [DEBUG] [LOCAL ] ACRE: No derivative data file found to delete. [2025-10-21T17:02:36.709913] [INFO ] [MAIN ] Update Progress: 27/2366 symbols completed. ACRE took 40.6s. Estimated remaining: 3h 40m 25s. Rate: 10.6 symbols/min [2025-10-21T17:02:36.879855] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:02:36.880013] [DEBUG] [LOCAL ] ADM: No existing data file found in primary storage. [2025-10-21T17:02:36.880049] [WARN ] [MAIN ] ADM: No existing data found, performing full refresh instead. [2025-10-21T17:02:36.880159] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-21T17:02:36.880227] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-21T17:02:36.880290] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-10-21T17:02:36.880335] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-21T17:02:36.956219] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-21T17:02:37.244635] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:02:37.363669] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-21T17:02:37.751040] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-21T17:02:38.305754] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T17:02:38.551053] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-21T17:02:39.351079] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-21T17:02:39.536075] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T17:02:39.996497] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T17:02:40.151102] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-21T17:02:40.951102] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-21T17:02:41.658096] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-21T17:02:41.751052] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-21T17:02:42.551078] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-21T17:02:42.684961] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T17:02:42.883844] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-21T17:02:43.351072] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-21T17:02:43.998869] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T17:02:44.091978] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (4.74 seconds). [2025-10-21T17:02:44.151035] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-21T17:02:44.670773] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-21T17:02:44.951087] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-21T17:02:45.751097] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-21T17:02:46.098753] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T17:02:46.551130] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-21T17:02:46.650096] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T17:02:47.358057] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-21T17:02:47.363296] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T17:02:48.026428] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-21T17:02:48.151053] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-21T17:02:48.951050] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-21T17:02:49.154837] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-21T17:02:49.751086] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-21T17:02:50.551054] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-21T17:02:50.773961] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-21T17:02:51.190701] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T17:02:51.351002] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-21T17:02:51.647440] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (3.50 seconds). [2025-10-21T17:02:52.151045] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-21T17:02:52.652581] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-21T17:02:52.660542] [INFO ] [REMOTE ] ACVA: Full fetch complete (71017 records). [2025-10-21T17:02:52.660713] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-21T17:02:52.959342] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-21T17:02:53.071034] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-21T17:02:53.071161] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-21T17:02:53.071888] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-21T17:02:53.071951] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-21T17:02:53.073306] [DEBUG] [LOCAL ] ACVA: Trimmed 71017 records to 49262 (keeping 200 days of data) [2025-10-21T17:02:53.372281] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-21T17:02:53.386318] [DEBUG] [LOCAL ] ACVA: Primary data saved (49262 records). [2025-10-21T17:02:53.386428] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-21T17:02:53.386501] [INFO ] [MAIN ] Update Progress: 28/2366 symbols completed. ACVA took 30.2s. Estimated remaining: 3h 55m 40s. Rate: 9.9 symbols/min [2025-10-21T17:02:53.568915] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:02:53.608681] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T17:02:53.631549] [DEBUG] [LOCAL ] ADNT: Loaded 46530 existing records from primary storage. [2025-10-21T17:02:53.631895] [INFO ] [MAIN ] ADNT: Loaded 46530 existing records. [2025-10-21T17:02:53.756124] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-21T17:02:53.811503] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:02:53.811702] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-21T17:02:53.811757] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-21T17:02:53.811997] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-21T17:02:53.812035] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-21T17:02:54.161059] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:02:54.551080] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-21T17:02:54.987375] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T17:02:55.351050] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-21T17:02:55.385314] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T17:02:56.151022] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-21T17:02:56.288167] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T17:02:56.957553] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-21T17:02:56.961024] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T17:02:57.751110] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-21T17:02:58.170444] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-21T17:02:58.306141] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T17:02:58.551043] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-21T17:02:59.277204] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T17:02:59.284526] [INFO ] [REMOTE ] ADCT: Full fetch complete (51441 records). [2025-10-21T17:02:59.284757] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-21T17:02:59.356165] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-21T17:02:59.684510] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-21T17:02:59.684596] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-21T17:02:59.685127] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-21T17:02:59.685192] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-21T17:02:59.686288] [DEBUG] [LOCAL ] ADCT: Trimmed 51441 records to 35445 (keeping 200 days of data) [2025-10-21T17:02:59.896914] [DEBUG] [LOCAL ] ADCT: Primary data saved (35445 records). [2025-10-21T17:02:59.897146] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-21T17:02:59.897237] [INFO ] [MAIN ] Update Progress: 29/2366 symbols completed. ADCT took 33.9s. Estimated remaining: 3h 56m 11s. Rate: 9.9 symbols/min [2025-10-21T17:03:00.087959] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:03:00.143440] [DEBUG] [LOCAL ] ADT: Loaded 53438 existing records from primary storage. [2025-10-21T17:03:00.143786] [INFO ] [MAIN ] ADT: Loaded 53438 existing records. [2025-10-21T17:03:00.175858] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-21T17:03:00.300660] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T17:03:00.342444] [INFO ] [REMOTE ] ADC: Full fetch complete (66676 records). [2025-10-21T17:03:00.361991] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-21T17:03:00.361911] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:03:00.362259] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-21T17:03:00.362316] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-21T17:03:00.394984] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-21T17:03:00.427567] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-21T17:03:01.150251] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-21T17:03:01.165174] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-21T17:03:01.171320] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-21T17:03:01.170441] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:03:01.171490] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-21T17:03:01.171853] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-21T17:03:01.173846] [DEBUG] [LOCAL ] ADC: Trimmed 66676 records to 46430 (keeping 200 days of data) [2025-10-21T17:03:01.466426] [DEBUG] [LOCAL ] ADC: Primary data saved (46430 records). [2025-10-21T17:03:01.466562] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-21T17:03:01.467756] [INFO ] [MAIN ] Update Progress: 30/2366 symbols completed. ADC took 36.3s. Estimated remaining: 3h 50m 15s. Rate: 10.1 symbols/min [2025-10-21T17:03:01.651409] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:03:01.685927] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-21T17:03:01.718434] [DEBUG] [LOCAL ] ADX: Loaded 27841 existing records from primary storage. [2025-10-21T17:03:01.718718] [INFO ] [MAIN ] ADX: Loaded 27841 existing records. [2025-10-21T17:03:01.762515] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-21T17:03:01.915981] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:03:01.916252] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-21T17:03:01.916306] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-21T17:03:01.917545] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-21T17:03:01.917606] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-21T17:03:02.286440] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-21T17:03:02.353886] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:03:02.551040] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-21T17:03:03.319614] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-21T17:03:03.350981] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-21T17:03:03.628951] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-21T17:03:03.729419] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-21T17:03:04.151086] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-21T17:03:04.951010] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-21T17:03:05.008242] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T17:03:05.419209] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T17:03:05.509688] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-21T17:03:05.518194] [INFO ] [REMOTE ] ADM: Full fetch complete (77456 records). [2025-10-21T17:03:05.518369] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-21T17:03:05.756226] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-21T17:03:05.965824] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-21T17:03:05.966000] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-21T17:03:05.967035] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-21T17:03:05.967129] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-21T17:03:05.969071] [DEBUG] [LOCAL ] ADM: Trimmed 77456 records to 53400 (keeping 200 days of data) [2025-10-21T17:03:06.293418] [DEBUG] [LOCAL ] ADM: Primary data saved (53400 records). [2025-10-21T17:03:06.293555] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-21T17:03:06.293629] [INFO ] [MAIN ] Update Progress: 31/2366 symbols completed. ADM took 29.6s. Estimated remaining: 3h 48m 47s. Rate: 10.2 symbols/min [2025-10-21T17:03:06.467171] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:03:06.512636] [DEBUG] [LOCAL ] AEE: Loaded 50155 existing records from primary storage. [2025-10-21T17:03:06.512979] [INFO ] [MAIN ] AEE: Loaded 50155 existing records. [2025-10-21T17:03:06.558059] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-21T17:03:06.704327] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:03:06.704550] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-21T17:03:06.704602] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-21T17:03:06.705711] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-21T17:03:06.705770] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-21T17:03:07.078425] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:03:07.350996] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-21T17:03:07.705416] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T17:03:08.077494] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T17:03:08.151041] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-21T17:03:08.951036] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-21T17:03:08.990666] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T17:03:09.435711] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-21T17:03:09.751040] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-21T17:03:10.551055] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-21T17:03:10.810759] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T17:03:11.059475] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T17:03:11.351025] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-21T17:03:12.151005] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-21T17:03:12.309594] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T17:03:12.489431] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T17:03:12.951045] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-21T17:03:13.718535] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T17:03:13.750995] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-21T17:03:14.551073] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-21T17:03:14.725225] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T17:03:15.014729] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T17:03:15.351027] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-21T17:03:16.151006] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-21T17:03:16.380728] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T17:03:16.774862] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T17:03:16.951027] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-21T17:03:17.753265] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-21T17:03:17.759147] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T17:03:18.282362] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T17:03:18.551026] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-21T17:03:19.351022] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-21T17:03:19.704231] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-21T17:03:19.915823] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T17:03:20.151039] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-21T17:03:20.951009] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-21T17:03:21.258839] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-21T17:03:21.587388] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-21T17:03:21.751106] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-21T17:03:22.483154] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T17:03:22.551111] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-21T17:03:23.143030] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T17:03:23.351049] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-21T17:03:23.960059] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-21T17:03:24.151049] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-21T17:03:24.951034] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-21T17:03:25.241928] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T17:03:25.751007] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-21T17:03:25.942817] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T17:03:26.521437] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T17:03:26.527765] [INFO ] [REMOTE ] ADNT: Full fetch complete (67653 records). [2025-10-21T17:03:26.527892] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-21T17:03:26.528566] [FATAL] [VALIDATOR ] ADNT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:03:26.528688] [FATAL] [MAIN ] ADNT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:03:26.528744] [WARN ] [MAIN ] ADNT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:03:26.528786] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-21T17:03:26.528844] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-10-21T17:03:26.528881] [INFO ] [LOCAL ] ADNT: Starting deletion of derivative data. [2025-10-21T17:03:26.529042] [DEBUG] [LOCAL ] ADNT: Deleted derivative data file. [2025-10-21T17:03:26.529130] [INFO ] [MAIN ] Update Progress: 32/2366 symbols completed. ADNT took 33.1s. Estimated remaining: 4h 6m 8s. Rate: 9.5 symbols/min [2025-10-21T17:03:26.556142] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-21T17:03:26.723423] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:03:26.734621] [DEBUG] [LOCAL ] AEFC: Loaded 8025 existing records from primary storage. [2025-10-21T17:03:26.734857] [INFO ] [MAIN ] AEFC: Loaded 8025 existing records. [2025-10-21T17:03:26.928946] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:03:26.929208] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-21T17:03:26.929282] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-21T17:03:26.929479] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-21T17:03:26.929545] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-21T17:03:27.326612] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:03:27.358780] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-21T17:03:27.367440] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-21T17:03:27.443929] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-21T17:03:28.110857] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-21T17:03:28.151023] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-21T17:03:28.951078] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-21T17:03:29.751046] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-21T17:03:29.943751] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T17:03:30.363504] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-21T17:03:30.391770] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-21T17:03:30.551031] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-21T17:03:31.351031] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-21T17:03:32.151001] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-21T17:03:32.223371] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-21T17:03:32.951001] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-21T17:03:33.153055] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T17:03:33.161549] [INFO ] [REMOTE ] ADT: Full fetch complete (77360 records). [2025-10-21T17:03:33.161730] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-21T17:03:33.570040] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-21T17:03:33.570190] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-21T17:03:33.570989] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-21T17:03:33.571077] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-21T17:03:33.572563] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-21T17:03:33.577778] [INFO ] [REMOTE ] ADX: Full fetch complete (41925 records). [2025-10-21T17:03:33.577875] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-21T17:03:33.578058] [DEBUG] [LOCAL ] ADT: Trimmed 77360 records to 53436 (keeping 200 days of data) [2025-10-21T17:03:33.764034] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-21T17:03:34.200597] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-21T17:03:34.203751] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-21T17:03:34.204333] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-21T17:03:34.234940] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-21T17:03:34.259525] [DEBUG] [LOCAL ] ADX: Trimmed 41925 records to 27734 (keeping 200 days of data) [2025-10-21T17:03:34.376920] [DEBUG] [LOCAL ] ADT: Primary data saved (53436 records). [2025-10-21T17:03:34.384553] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-21T17:03:34.384757] [INFO ] [MAIN ] Update Progress: 33/2366 symbols completed. ADT took 34.5s. Estimated remaining: 4h 7m 50s. Rate: 9.4 symbols/min [2025-10-21T17:03:34.573823] [DEBUG] [LOCAL ] ADX: Primary data saved (27734 records). [2025-10-21T17:03:34.634217] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:03:34.630541] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-21T17:03:34.660150] [INFO ] [MAIN ] Update Progress: 34/2366 symbols completed. ADX took 33.2s. Estimated remaining: 4h 0m 45s. Rate: 9.7 symbols/min [2025-10-21T17:03:34.660716] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-21T17:03:34.662137] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T17:03:34.681150] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-21T17:03:34.773532] [INFO ] [REMOTE ] AEE: Full fetch complete (73025 records). [2025-10-21T17:03:34.787224] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-21T17:03:34.946979] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:03:35.069795] [DEBUG] [LOCAL ] AEG: Loaded 49602 existing records from primary storage. [2025-10-21T17:03:35.078495] [INFO ] [MAIN ] AEG: Loaded 49602 existing records. [2025-10-21T17:03:35.531607] [DEBUG] [LOCAL ] AEM: Loaded 53477 existing records from primary storage. [2025-10-21T17:03:35.564630] [INFO ] [MAIN ] AEM: Loaded 53477 existing records. [2025-10-21T17:03:35.560146] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:03:35.565356] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-21T17:03:35.569059] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-21T17:03:35.569323] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-21T17:03:35.574900] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-21T17:03:35.574816] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-21T17:03:35.605704] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-21T17:03:35.617944] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-21T17:03:35.628612] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-21T17:03:35.653069] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-21T17:03:35.669451] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-21T17:03:35.784857] [DEBUG] [LOCAL ] AEE: Trimmed 73025 records to 50107 (keeping 200 days of data) [2025-10-21T17:03:35.883799] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:03:35.970674] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-21T17:03:36.002837] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-21T17:03:36.047619] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-21T17:03:36.049699] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-21T17:03:36.539022] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:03:36.548597] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-21T17:03:36.690317] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-21T17:03:36.827005] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:03:36.862052] [DEBUG] [LOCAL ] AEE: Primary data saved (50107 records). [2025-10-21T17:03:36.862155] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-21T17:03:36.862235] [INFO ] [MAIN ] Update Progress: 35/2366 symbols completed. AEE took 30.6s. Estimated remaining: 3h 56m 13s. Rate: 9.9 symbols/min [2025-10-21T17:03:36.960538] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-21T17:03:37.037156] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:03:37.087361] [DEBUG] [LOCAL ] AEO: Loaded 53565 existing records from primary storage. [2025-10-21T17:03:37.087692] [INFO ] [MAIN ] AEO: Loaded 53565 existing records. [2025-10-21T17:03:37.266461] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:03:37.266718] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-21T17:03:37.266774] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-21T17:03:37.266993] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-21T17:03:37.267049] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-21T17:03:37.633077] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:03:37.710211] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T17:03:37.751036] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-21T17:03:38.136830] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T17:03:38.551083] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-21T17:03:39.351047] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-21T17:03:39.611087] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-21T17:03:40.151059] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-21T17:03:40.244893] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T17:03:40.248536] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-21T17:03:40.951044] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-21T17:03:41.743825] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T17:03:41.750966] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-21T17:03:42.166900] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-21T17:03:42.347423] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-21T17:03:42.551095] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-21T17:03:43.228075] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-21T17:03:43.230168] [INFO ] [REMOTE ] AEFC: Full fetch complete (11629 records). [2025-10-21T17:03:43.230253] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-21T17:03:43.356197] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-21T17:03:43.598464] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-21T17:03:43.598544] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-21T17:03:43.598768] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-21T17:03:43.598829] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-21T17:03:43.599348] [DEBUG] [LOCAL ] AEFC: Trimmed 11629 records to 7734 (keeping 200 days of data) [2025-10-21T17:03:43.644886] [DEBUG] [LOCAL ] AEFC: Primary data saved (7734 records). [2025-10-21T17:03:43.645009] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-21T17:03:43.645085] [INFO ] [MAIN ] Update Progress: 36/2366 symbols completed. AEFC took 17.1s. Estimated remaining: 3h 56m 53s. Rate: 9.8 symbols/min [2025-10-21T17:03:43.815420] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:03:43.815577] [DEBUG] [LOCAL ] AER: No existing data file found in primary storage. [2025-10-21T17:03:43.815614] [WARN ] [MAIN ] AER: No existing data found, performing full refresh instead. [2025-10-21T17:03:43.815752] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-21T17:03:43.815848] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-21T17:03:43.815917] [DEBUG] [LOCAL ] AER: No primary data file found to delete. [2025-10-21T17:03:43.815952] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-21T17:03:44.166790] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-21T17:03:44.171286] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:03:44.951085] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-21T17:03:45.574117] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-21T17:03:45.751051] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-21T17:03:45.948881] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T17:03:46.551053] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-21T17:03:46.695701] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T17:03:47.351090] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-21T17:03:47.465027] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-21T17:03:48.151050] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-21T17:03:48.539821] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T17:03:48.921043] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T17:03:48.950980] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-21T17:03:49.751011] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-21T17:03:50.163675] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T17:03:50.551046] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-21T17:03:50.622802] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T17:03:51.350989] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-21T17:03:51.695404] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T17:03:52.032631] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-21T17:03:52.150984] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-21T17:03:52.950018] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-21T17:03:52.960094] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-21T17:03:53.750994] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-21T17:03:54.069741] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T17:03:54.513257] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T17:03:54.550987] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-21T17:03:55.351020] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-21T17:03:55.555932] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T17:03:56.043200] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T17:03:56.151038] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-21T17:03:56.951040] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-21T17:03:57.430183] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-21T17:03:57.751029] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-21T17:03:57.963513] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-21T17:03:58.551067] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-21T17:03:58.636133] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T17:03:59.351018] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-21T17:03:59.489098] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T17:04:00.151033] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-21T17:04:00.235855] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T17:04:00.951077] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-21T17:04:01.470250] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-21T17:04:01.751029] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-21T17:04:02.134437] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-21T17:04:02.551058] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-21T17:04:02.967814] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-21T17:04:03.213861] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-21T17:04:03.351063] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-21T17:04:04.151063] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-21T17:04:04.321355] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-21T17:04:04.951107] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-21T17:04:05.384097] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-21T17:04:05.751036] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-21T17:04:05.983823] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T17:04:05.992341] [INFO ] [REMOTE ] AEG: Full fetch complete (70660 records). [2025-10-21T17:04:05.992548] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-21T17:04:06.388944] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-21T17:04:06.389027] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-21T17:04:06.389746] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-21T17:04:06.389815] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-21T17:04:06.391154] [DEBUG] [LOCAL ] AEG: Trimmed 70660 records to 49601 (keeping 200 days of data) [2025-10-21T17:04:06.555251] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-21T17:04:06.677638] [DEBUG] [LOCAL ] AEG: Primary data saved (49601 records). [2025-10-21T17:04:06.677898] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-21T17:04:06.678188] [INFO ] [MAIN ] Update Progress: 37/2366 symbols completed. AEG took 32.3s. Estimated remaining: 4h 14m 32s. Rate: 9.1 symbols/min [2025-10-21T17:04:06.715786] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T17:04:07.351086] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-21T17:04:08.707816] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.96 seconds). [2025-10-21T17:04:08.719775] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-21T17:04:08.760266] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-21T17:04:08.951074] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-21T17:04:09.863855] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-21T17:04:09.875096] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-21T17:04:10.627959] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T17:04:10.638779] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-21T17:04:10.715146] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-21T17:04:10.723555] [INFO ] [REMOTE ] AEO: Full fetch complete (77647 records). [2025-10-21T17:04:10.723703] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-21T17:04:11.114990] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-21T17:04:11.115076] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-21T17:04:11.115830] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-21T17:04:11.115893] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-21T17:04:11.117276] [DEBUG] [LOCAL ] AEO: Trimmed 77647 records to 53564 (keeping 200 days of data) [2025-10-21T17:04:11.441010] [DEBUG] [LOCAL ] AEO: Primary data saved (53564 records). [2025-10-21T17:04:11.441198] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-21T17:04:11.441476] [INFO ] [MAIN ] Update Progress: 38/2366 symbols completed. AEO took 34.6s. Estimated remaining: 4h 12m 36s. Rate: 9.2 symbols/min [2025-10-21T17:04:11.583176] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T17:04:11.591473] [INFO ] [REMOTE ] AEM: Full fetch complete (77458 records). [2025-10-21T17:04:11.591602] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-21T17:04:11.982155] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-21T17:04:11.982239] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-21T17:04:11.982964] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-21T17:04:11.983028] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-21T17:04:11.984420] [DEBUG] [LOCAL ] AEM: Trimmed 77458 records to 53477 (keeping 200 days of data) [2025-10-21T17:04:12.337350] [DEBUG] [LOCAL ] AEM: Primary data saved (53477 records). [2025-10-21T17:04:12.337592] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-21T17:04:12.337741] [INFO ] [MAIN ] Update Progress: 39/2366 symbols completed. AEM took 37.7s. Estimated remaining: 4h 6m 54s. Rate: 9.4 symbols/min [2025-10-21T17:04:12.365359] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T17:04:12.375811] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-21T17:04:13.654441] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T17:04:13.661225] [INFO ] [REMOTE ] AER: Full fetch complete (69585 records). [2025-10-21T17:04:13.661350] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-21T17:04:13.662078] [FATAL] [VALIDATOR ] AER: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:04:13.662162] [FATAL] [MAIN ] AER: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:04:13.662205] [WARN ] [MAIN ] AER: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:04:13.662243] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-21T17:04:13.662298] [DEBUG] [LOCAL ] AER: No primary data file found to delete. [2025-10-21T17:04:13.662334] [INFO ] [LOCAL ] AER: Starting deletion of derivative data. [2025-10-21T17:04:13.662372] [DEBUG] [LOCAL ] AER: No derivative data file found to delete. [2025-10-21T17:04:13.662424] [INFO ] [MAIN ] Update Progress: 40/2366 symbols completed. AER took 30.0s. Estimated remaining: 4h 1m 55s. Rate: 9.6 symbols/min [2025-10-21T17:04:14.250593] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:04:14.322778] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-21T17:04:14.327521] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:04:14.351996] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-21T17:04:14.390116] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:04:14.383994] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-21T17:04:14.421878] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-21T17:04:14.431176] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-21T17:04:14.438922] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-21T17:04:14.462015] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:04:14.672438] [DEBUG] [LOCAL ] AFB: Loaded 11115 existing records from primary storage. [2025-10-21T17:04:14.673153] [INFO ] [MAIN ] AFB: Loaded 11115 existing records. [2025-10-21T17:04:14.827912] [DEBUG] [LOCAL ] AESI: Loaded 49828 existing records from primary storage. [2025-10-21T17:04:14.894203] [INFO ] [MAIN ] AESI: Loaded 49828 existing records. [2025-10-21T17:04:14.975046] [DEBUG] [LOCAL ] AES: Loaded 53668 existing records from primary storage. [2025-10-21T17:04:15.125524] [INFO ] [MAIN ] AES: Loaded 53668 existing records. [2025-10-21T17:04:15.486530] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:04:15.561694] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-21T17:04:15.561547] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:04:15.601517] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-01. [2025-10-21T17:04:15.584374] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-21T17:04:15.670809] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-21T17:04:15.735936] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-21T17:04:15.779043] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:04:15.783681] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:04:15.832724] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-21T17:04:15.860789] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-21T17:04:15.868108] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-21T17:04:15.886245] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-21T17:04:15.886319] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-21T17:04:15.905361] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-21T17:04:15.899591] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:04:15.920975] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-21T17:04:15.937223] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-01 [2025-10-21T17:04:15.969739] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-21T17:04:16.005464] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:04:16.091109] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-21T17:04:16.147375] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:04:16.166385] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-21T17:04:16.233742] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-21T17:04:16.289186] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-21T17:04:16.319891] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-21T17:04:16.392943] [INFO ] [MAIN ] Update Progress: 41/2366 symbols completed. AEXA took 2.7s. Estimated remaining: 3h 58m 30s. Rate: 9.7 symbols/min [2025-10-21T17:04:16.675793] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:04:16.855704] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-21T17:04:17.049300] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:04:17.189038] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:04:17.193482] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-21T17:04:17.193138] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:04:17.195134] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-21T17:04:17.228013] [DEBUG] [LOCAL ] AFG: Loaded 31954 existing records from primary storage. [2025-10-21T17:04:17.228283] [INFO ] [MAIN ] AFG: Loaded 31954 existing records. [2025-10-21T17:04:17.416760] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:04:17.416974] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-21T17:04:17.417023] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-21T17:04:17.417238] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-21T17:04:17.417297] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-21T17:04:17.790302] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:04:17.790780] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-21T17:04:17.801894] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T17:04:17.804985] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-21T17:04:18.650195] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-21T17:04:18.649887] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T17:04:18.662941] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-21T17:04:18.663815] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-21T17:04:18.839033] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T17:04:18.851155] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-21T17:04:18.870626] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-21T17:04:19.351039] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-21T17:04:19.523795] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T17:04:20.151045] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-21T17:04:20.231464] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T17:04:20.529420] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T17:04:20.674235] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-21T17:04:20.868881] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T17:04:20.951051] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-21T17:04:21.751038] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-21T17:04:22.550987] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-21T17:04:22.551282] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-21T17:04:22.621255] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T17:04:23.351038] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-21T17:04:24.120011] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-21T17:04:24.151006] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-21T17:04:24.487218] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T17:04:24.633535] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T17:04:24.951036] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-21T17:04:25.424716] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-21T17:04:25.751033] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-21T17:04:26.548427] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T17:04:26.551210] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-21T17:04:27.351042] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-21T17:04:28.150997] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-21T17:04:28.226249] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T17:04:28.288683] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T17:04:28.290826] [INFO ] [REMOTE ] AFB: Full fetch complete (16423 records). [2025-10-21T17:04:28.290896] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-21T17:04:28.646372] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-21T17:04:28.646446] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-21T17:04:28.646719] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-21T17:04:28.646780] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-21T17:04:28.647272] [DEBUG] [LOCAL ] AFB: Trimmed 16423 records to 11097 (keeping 200 days of data) [2025-10-21T17:04:28.711966] [DEBUG] [LOCAL ] AFB: Primary data saved (11097 records). [2025-10-21T17:04:28.712096] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-21T17:04:28.712174] [INFO ] [MAIN ] Update Progress: 42/2366 symbols completed. AFB took 15.0s. Estimated remaining: 4h 4m 5s. Rate: 9.5 symbols/min [2025-10-21T17:04:28.883993] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:04:28.888815] [DEBUG] [LOCAL ] AFGB: Loaded 2245 existing records from primary storage. [2025-10-21T17:04:28.889004] [INFO ] [MAIN ] AFGB: Loaded 2245 existing records. [2025-10-21T17:04:28.956085] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-21T17:04:29.078909] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:04:29.079108] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-21T17:04:29.079155] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-21T17:04:29.079275] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-21T17:04:29.079313] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-21T17:04:29.435380] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:04:29.751020] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-21T17:04:30.071692] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-21T17:04:30.301818] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-21T17:04:30.551000] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-21T17:04:30.696813] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T17:04:31.000152] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-21T17:04:31.351031] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-21T17:04:31.933719] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-21T17:04:32.151020] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-21T17:04:32.951001] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-21T17:04:33.001620] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-21T17:04:33.751024] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-21T17:04:34.238012] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-21T17:04:34.551003] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-21T17:04:34.645541] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T17:04:35.351020] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-21T17:04:35.800178] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-21T17:04:36.151049] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-21T17:04:36.316475] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T17:04:36.951026] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-21T17:04:37.625089] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-21T17:04:37.751012] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-21T17:04:38.510124] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T17:04:38.550981] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-21T17:04:39.350998] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-21T17:04:39.812438] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-21T17:04:39.903177] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-21T17:04:40.151012] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-21T17:04:40.331194] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T17:04:40.951082] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-21T17:04:41.359474] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-21T17:04:41.751060] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-21T17:04:42.224467] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-21T17:04:42.551064] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-21T17:04:42.589540] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T17:04:43.351033] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-21T17:04:44.151010] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-21T17:04:44.374976] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T17:04:44.832250] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T17:04:44.951011] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-21T17:04:45.762273] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-21T17:04:45.767676] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-21T17:04:46.107358] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-21T17:04:46.369380] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T17:04:46.551032] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-21T17:04:47.351053] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-21T17:04:48.151030] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-21T17:04:48.340063] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T17:04:48.348163] [INFO ] [REMOTE ] AESI: Full fetch complete (71496 records). [2025-10-21T17:04:48.348314] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-21T17:04:48.744946] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-21T17:04:48.745223] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-21T17:04:48.745942] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-21T17:04:48.746009] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-21T17:04:48.747806] [DEBUG] [LOCAL ] AESI: Trimmed 71496 records to 49822 (keeping 200 days of data) [2025-10-21T17:04:48.951284] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-21T17:04:49.041853] [DEBUG] [LOCAL ] AESI: Primary data saved (49822 records). [2025-10-21T17:04:49.042031] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-21T17:04:49.042131] [INFO ] [MAIN ] Update Progress: 43/2366 symbols completed. AESI took 35.4s. Estimated remaining: 4h 16m 36s. Rate: 9.1 symbols/min [2025-10-21T17:04:49.216171] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:04:49.249470] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T17:04:49.248082] [DEBUG] [LOCAL ] AFGC: Loaded 2561 existing records from primary storage. [2025-10-21T17:04:49.260780] [INFO ] [MAIN ] AFGC: Loaded 2561 existing records. [2025-10-21T17:04:49.446997] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:04:49.443432] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-21T17:04:49.448447] [INFO ] [REMOTE ] AFGB: Full fetch complete (3454 records). [2025-10-21T17:04:49.448558] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-21T17:04:49.447360] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-21T17:04:49.460269] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-21T17:04:49.497862] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-21T17:04:49.514332] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-21T17:04:49.762698] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-21T17:04:49.801076] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T17:04:50.189243] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-21T17:04:50.208908] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-21T17:04:50.208845] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:04:50.209103] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-21T17:04:50.209181] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-21T17:04:50.209805] [DEBUG] [LOCAL ] AFGB: Trimmed 3454 records to 2236 (keeping 200 days of data) [2025-10-21T17:04:50.223418] [DEBUG] [LOCAL ] AFGB: Primary data saved (2236 records). [2025-10-21T17:04:50.223486] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-21T17:04:50.223551] [INFO ] [MAIN ] Update Progress: 44/2366 symbols completed. AFGB took 21.5s. Estimated remaining: 4h 11m 42s. Rate: 9.2 symbols/min [2025-10-21T17:04:50.396691] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:04:50.401038] [DEBUG] [LOCAL ] AFGD: Loaded 1775 existing records from primary storage. [2025-10-21T17:04:50.401240] [INFO ] [MAIN ] AFGD: Loaded 1775 existing records. [2025-10-21T17:04:50.557158] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-21T17:04:50.590139] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:04:50.590376] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-21T17:04:50.590456] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-21T17:04:50.590610] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-21T17:04:50.590699] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-21T17:04:50.961389] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:04:51.192854] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-21T17:04:51.351033] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-21T17:04:52.064345] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-21T17:04:52.093411] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-21T17:04:52.102005] [INFO ] [REMOTE ] AES: Full fetch complete (77843 records). [2025-10-21T17:04:52.102178] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-21T17:04:52.156271] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-21T17:04:52.496219] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-21T17:04:52.496297] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-21T17:04:52.497048] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-21T17:04:52.497139] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-21T17:04:52.498542] [DEBUG] [LOCAL ] AES: Trimmed 77843 records to 53665 (keeping 200 days of data) [2025-10-21T17:04:52.810023] [DEBUG] [LOCAL ] AES: Primary data saved (53665 records). [2025-10-21T17:04:52.810154] [INFO ] [MAIN ] AES: Full history saved. [2025-10-21T17:04:52.811122] [INFO ] [MAIN ] Update Progress: 45/2366 symbols completed. AES took 39.1s. Estimated remaining: 4h 8m 14s. Rate: 9.4 symbols/min [2025-10-21T17:04:52.956151] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-21T17:04:52.981297] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:04:52.986218] [DEBUG] [LOCAL ] AFGE: Loaded 2313 existing records from primary storage. [2025-10-21T17:04:52.986380] [INFO ] [MAIN ] AFGE: Loaded 2313 existing records. [2025-10-21T17:04:53.163267] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:04:53.163463] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-21T17:04:53.163509] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-21T17:04:53.163638] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-21T17:04:53.163721] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-21T17:04:53.521240] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:04:53.525475] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-21T17:04:53.545283] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-21T17:04:53.751069] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-21T17:04:54.381989] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-21T17:04:54.551019] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-21T17:04:54.993817] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-21T17:04:55.351033] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-21T17:04:56.151022] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-21T17:04:56.592248] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-21T17:04:56.770685] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-21T17:04:56.951054] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-21T17:04:57.396567] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-21T17:04:57.751103] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-21T17:04:58.551023] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-21T17:04:58.917077] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-21T17:04:59.062601] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T17:04:59.067557] [INFO ] [REMOTE ] AFG: Full fetch complete (46781 records). [2025-10-21T17:04:59.067666] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-21T17:04:59.358950] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-21T17:04:59.452149] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-21T17:04:59.452223] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-21T17:04:59.452720] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-21T17:04:59.452783] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-21T17:04:59.453673] [DEBUG] [LOCAL ] AFG: Trimmed 46781 records to 31884 (keeping 200 days of data) [2025-10-21T17:04:59.647329] [DEBUG] [LOCAL ] AFG: Primary data saved (31884 records). [2025-10-21T17:04:59.647451] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-21T17:04:59.647525] [INFO ] [MAIN ] Update Progress: 46/2366 symbols completed. AFG took 43.2s. Estimated remaining: 4h 8m 28s. Rate: 9.3 symbols/min [2025-10-21T17:04:59.821008] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:04:59.872489] [DEBUG] [LOCAL ] AFL: Loaded 53182 existing records from primary storage. [2025-10-21T17:04:59.872816] [INFO ] [MAIN ] AFL: Loaded 53182 existing records. [2025-10-21T17:04:59.948314] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-21T17:05:00.072521] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:05:00.072972] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-21T17:05:00.073032] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-21T17:05:00.073323] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-21T17:05:00.073384] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-21T17:05:00.156222] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-21T17:05:00.432093] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:05:00.703566] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-21T17:05:00.951066] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-21T17:05:01.397725] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-21T17:05:01.751029] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-21T17:05:02.445692] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-21T17:05:02.551086] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-21T17:05:03.058988] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-21T17:05:03.351037] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-21T17:05:03.983178] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-21T17:05:04.151030] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-21T17:05:04.828164] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-21T17:05:04.951046] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-21T17:05:05.299768] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-21T17:05:05.751048] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-21T17:05:06.551055] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-21T17:05:07.094341] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-21T17:05:07.351058] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-21T17:05:07.555744] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T17:05:07.943901] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-21T17:05:08.151095] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-21T17:05:08.951088] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-21T17:05:09.567684] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-21T17:05:09.751071] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-21T17:05:10.094281] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-21T17:05:10.200029] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-21T17:05:10.551086] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-21T17:05:11.270842] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T17:05:11.351015] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-21T17:05:12.151060] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-21T17:05:12.792700] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-21T17:05:12.951088] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-21T17:05:13.301183] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T17:05:13.461621] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-21T17:05:13.751088] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-21T17:05:14.091347] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-21T17:05:14.551034] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-21T17:05:15.060531] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-21T17:05:15.061380] [INFO ] [REMOTE ] AFGC: Full fetch complete (3582 records). [2025-10-21T17:05:15.061447] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-21T17:05:15.061823] [FATAL] [VALIDATOR ] AFGC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:05:15.061903] [FATAL] [MAIN ] AFGC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:05:15.061945] [WARN ] [MAIN ] AFGC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:05:15.061983] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-21T17:05:15.062035] [DEBUG] [LOCAL ] AFGC: No primary data file found to delete. [2025-10-21T17:05:15.062068] [INFO ] [LOCAL ] AFGC: Starting deletion of derivative data. [2025-10-21T17:05:15.062223] [DEBUG] [LOCAL ] AFGC: Deleted derivative data file. [2025-10-21T17:05:15.062308] [INFO ] [MAIN ] Update Progress: 47/2366 symbols completed. AFGC took 26.0s. Estimated remaining: 4h 15m 45s. Rate: 9.1 symbols/min [2025-10-21T17:05:15.229689] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:05:15.277882] [DEBUG] [LOCAL ] AG: Loaded 53644 existing records from primary storage. [2025-10-21T17:05:15.278196] [INFO ] [MAIN ] AG: Loaded 53644 existing records. [2025-10-21T17:05:15.356094] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-21T17:05:15.460748] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:05:15.460972] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-21T17:05:15.461018] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-21T17:05:15.461229] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-21T17:05:15.461293] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-21T17:05:15.808749] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:05:16.151021] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-21T17:05:16.708472] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-21T17:05:16.951001] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-21T17:05:17.016251] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T17:05:17.751026] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-21T17:05:18.551060] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-21T17:05:18.999721] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-21T17:05:19.113587] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-21T17:05:19.114453] [INFO ] [REMOTE ] AFGE: Full fetch complete (3342 records). [2025-10-21T17:05:19.114521] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-21T17:05:19.361533] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-21T17:05:19.480142] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-21T17:05:19.480313] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-21T17:05:19.480473] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-21T17:05:19.480612] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-21T17:05:19.481217] [DEBUG] [LOCAL ] AFGE: Trimmed 3342 records to 2292 (keeping 200 days of data) [2025-10-21T17:05:19.495141] [DEBUG] [LOCAL ] AFGE: Primary data saved (2292 records). [2025-10-21T17:05:19.495201] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-21T17:05:19.495265] [INFO ] [MAIN ] Update Progress: 48/2366 symbols completed. AFGE took 26.7s. Estimated remaining: 4h 13m 53s. Rate: 9.1 symbols/min [2025-10-21T17:05:19.664315] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:05:19.704972] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-21T17:05:19.761205] [DEBUG] [LOCAL ] AGCO: Loaded 42303 existing records from primary storage. [2025-10-21T17:05:19.761527] [INFO ] [MAIN ] AGCO: Loaded 42303 existing records. [2025-10-21T17:05:19.947531] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:05:19.947796] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-21T17:05:19.947858] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-21T17:05:19.948060] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-21T17:05:19.948118] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-21T17:05:20.156212] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-21T17:05:20.323170] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:05:20.664735] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-21T17:05:20.951008] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-21T17:05:21.008371] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T17:05:21.751017] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-21T17:05:22.534167] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T17:05:22.550970] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-21T17:05:23.351014] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-21T17:05:23.612518] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T17:05:24.051271] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T17:05:24.151042] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-21T17:05:24.661118] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T17:05:24.951053] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-21T17:05:25.751096] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-21T17:05:26.551058] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-21T17:05:26.776595] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T17:05:27.351035] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-21T17:05:28.010945] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T17:05:28.150992] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-21T17:05:28.889111] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (4.74 seconds). [2025-10-21T17:05:28.950982] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-21T17:05:28.971145] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (3.22 seconds). [2025-10-21T17:05:29.277176] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T17:05:29.751030] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-21T17:05:29.910094] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T17:05:30.322180] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-21T17:05:30.322960] [INFO ] [REMOTE ] AFGD: Full fetch complete (2746 records). [2025-10-21T17:05:30.323028] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-21T17:05:30.552479] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-21T17:05:30.694611] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-21T17:05:30.694746] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-21T17:05:30.694923] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-21T17:05:30.695022] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-21T17:05:30.695429] [DEBUG] [LOCAL ] AFGD: Trimmed 2746 records to 1769 (keeping 200 days of data) [2025-10-21T17:05:30.707291] [DEBUG] [LOCAL ] AFGD: Primary data saved (1769 records). [2025-10-21T17:05:30.707449] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-21T17:05:30.707701] [INFO ] [MAIN ] Update Progress: 49/2366 symbols completed. AFGD took 40.5s. Estimated remaining: 4h 17m 26s. Rate: 9.0 symbols/min [2025-10-21T17:05:30.885185] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:05:30.919680] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-21T17:05:30.946062] [DEBUG] [LOCAL ] AGD: Loaded 19307 existing records from primary storage. [2025-10-21T17:05:30.946300] [INFO ] [MAIN ] AGD: Loaded 19307 existing records. [2025-10-21T17:05:31.131025] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:05:31.131256] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-21T17:05:31.131321] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-21T17:05:31.131590] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-21T17:05:31.131696] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-21T17:05:31.361142] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-21T17:05:31.522372] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:05:32.151024] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-21T17:05:32.357799] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T17:05:32.366225] [INFO ] [REMOTE ] AFL: Full fetch complete (77065 records). [2025-10-21T17:05:32.366370] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-21T17:05:32.760925] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-21T17:05:32.761010] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-21T17:05:32.761788] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-21T17:05:32.761853] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-21T17:05:32.763336] [DEBUG] [LOCAL ] AFL: Trimmed 77065 records to 53177 (keeping 200 days of data) [2025-10-21T17:05:32.954156] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-21T17:05:33.024058] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T17:05:33.124933] [DEBUG] [LOCAL ] AFL: Primary data saved (53177 records). [2025-10-21T17:05:33.125065] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-21T17:05:33.126733] [INFO ] [MAIN ] Update Progress: 50/2366 symbols completed. AFL took 33.5s. Estimated remaining: 4h 14m 3s. Rate: 9.1 symbols/min [2025-10-21T17:05:33.297780] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:05:33.352523] [DEBUG] [LOCAL ] AGI: Loaded 53423 existing records from primary storage. [2025-10-21T17:05:33.352848] [INFO ] [MAIN ] AGI: Loaded 53423 existing records. [2025-10-21T17:05:33.533927] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:05:33.534142] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-21T17:05:33.534193] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-21T17:05:33.534384] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-21T17:05:33.534422] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-21T17:05:33.766404] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-21T17:05:33.912789] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:05:34.191587] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-21T17:05:34.261884] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T17:05:34.551034] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-21T17:05:35.351041] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-21T17:05:35.365120] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-21T17:05:35.468368] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T17:05:36.151041] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-21T17:05:36.951054] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-21T17:05:37.024699] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-21T17:05:37.287793] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T17:05:37.751026] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-21T17:05:38.366017] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T17:05:38.551025] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-21T17:05:39.351009] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-21T17:05:39.510624] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T17:05:40.151033] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-21T17:05:40.193388] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T17:05:40.951116] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-21T17:05:41.627712] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-21T17:05:41.724736] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-21T17:05:41.751027] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-21T17:05:41.895978] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T17:05:42.551010] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-21T17:05:42.940893] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T17:05:43.351105] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-21T17:05:44.151067] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-21T17:05:44.445748] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-21T17:05:44.841970] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-21T17:05:44.900760] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T17:05:44.950989] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-21T17:05:45.751077] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-21T17:05:46.443824] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T17:05:46.551050] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-21T17:05:47.351084] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-21T17:05:47.496245] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T17:05:47.551060] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-21T17:05:48.151047] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-21T17:05:48.951104] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-21T17:05:49.648742] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-21T17:05:49.751068] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-21T17:05:50.448151] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-21T17:05:50.551042] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-21T17:05:50.587311] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-21T17:05:50.594846] [INFO ] [REMOTE ] AGCO: Full fetch complete (61594 records). [2025-10-21T17:05:50.594986] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-21T17:05:51.027134] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-21T17:05:51.027215] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-21T17:05:51.027833] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-21T17:05:51.027896] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-21T17:05:51.029173] [DEBUG] [LOCAL ] AGCO: Trimmed 61594 records to 42188 (keeping 200 days of data) [2025-10-21T17:05:51.314331] [DEBUG] [LOCAL ] AGCO: Primary data saved (42188 records). [2025-10-21T17:05:51.314473] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-21T17:05:51.317026] [INFO ] [MAIN ] Update Progress: 51/2366 symbols completed. AGCO took 31.8s. Estimated remaining: 4h 22m 43s. Rate: 8.8 symbols/min [2025-10-21T17:05:51.356101] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-21T17:05:51.522052] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:05:51.522169] [DEBUG] [LOCAL ] AGL: No existing data file found in primary storage. [2025-10-21T17:05:51.522207] [WARN ] [MAIN ] AGL: No existing data found, performing full refresh instead. [2025-10-21T17:05:51.522312] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-21T17:05:51.522354] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-21T17:05:51.522395] [DEBUG] [LOCAL ] AGL: No primary data file found to delete. [2025-10-21T17:05:51.522429] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-21T17:05:51.919308] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:05:51.976605] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-21T17:05:51.985410] [INFO ] [REMOTE ] AG: Full fetch complete (77394 records). [2025-10-21T17:05:51.985558] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-21T17:05:51.986376] [FATAL] [VALIDATOR ] AG: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:05:51.986485] [FATAL] [MAIN ] AG: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:05:51.986567] [WARN ] [MAIN ] AG: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:05:51.986678] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-21T17:05:51.986770] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-10-21T17:05:51.986825] [INFO ] [LOCAL ] AG: Starting deletion of derivative data. [2025-10-21T17:05:51.986959] [DEBUG] [LOCAL ] AG: Deleted derivative data file. [2025-10-21T17:05:51.987047] [INFO ] [MAIN ] Update Progress: 52/2366 symbols completed. AG took 36.9s. Estimated remaining: 4h 18m 3s. Rate: 9.0 symbols/min [2025-10-21T17:05:52.162753] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-21T17:05:52.162634] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:05:52.176513] [DEBUG] [LOCAL ] AGM: Loaded 10702 existing records from primary storage. [2025-10-21T17:05:52.176849] [INFO ] [MAIN ] AGM: Loaded 10702 existing records. [2025-10-21T17:05:52.385826] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:05:52.389296] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-21T17:05:52.389428] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-21T17:05:52.389789] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-21T17:05:52.390151] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-21T17:05:52.391114] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-21T17:05:52.543479] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T17:05:52.772112] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:05:52.950986] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-21T17:05:53.591831] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-21T17:05:53.750999] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-21T17:05:53.920703] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T17:05:54.436860] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T17:05:54.550996] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-21T17:05:55.351027] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-21T17:05:56.151016] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-21T17:05:56.440029] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-21T17:05:56.638731] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-21T17:05:56.642751] [INFO ] [REMOTE ] AGD: Full fetch complete (26621 records). [2025-10-21T17:05:56.642829] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-21T17:05:56.934047] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-21T17:05:56.956076] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-21T17:05:57.021349] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-21T17:05:57.021425] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-21T17:05:57.021811] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-21T17:05:57.021874] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-21T17:05:57.022594] [DEBUG] [LOCAL ] AGD: Trimmed 26621 records to 19315 (keeping 200 days of data) [2025-10-21T17:05:57.133036] [DEBUG] [LOCAL ] AGD: Primary data saved (19315 records). [2025-10-21T17:05:57.133167] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-21T17:05:57.133243] [INFO ] [MAIN ] Update Progress: 53/2366 symbols completed. AGD took 26.4s. Estimated remaining: 4h 16m 49s. Rate: 9.0 symbols/min [2025-10-21T17:05:57.300016] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:05:57.324933] [DEBUG] [LOCAL ] AGO: Loaded 27832 existing records from primary storage. [2025-10-21T17:05:57.325186] [INFO ] [MAIN ] AGO: Loaded 27832 existing records. [2025-10-21T17:05:57.500575] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:05:57.500832] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-21T17:05:57.500901] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-21T17:05:57.501113] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-21T17:05:57.501152] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-21T17:05:57.756208] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-21T17:05:57.853994] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:05:58.402915] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-21T17:05:58.551049] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-21T17:05:58.732207] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T17:05:59.351099] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-21T17:06:00.100691] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-21T17:06:00.151016] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-21T17:06:00.796004] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T17:06:00.951009] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-21T17:06:01.337356] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T17:06:01.751057] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-21T17:06:02.551055] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-21T17:06:03.184009] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-21T17:06:03.351051] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-21T17:06:03.445195] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-21T17:06:03.984412] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (3.03 seconds). [2025-10-21T17:06:04.151032] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-21T17:06:04.752337] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-21T17:06:04.951083] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-21T17:06:05.750997] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-21T17:06:05.791328] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T17:06:06.126287] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T17:06:06.551013] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-21T17:06:07.350980] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-21T17:06:07.830527] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-21T17:06:08.151014] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-21T17:06:08.669395] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-21T17:06:08.713188] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T17:06:08.951039] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-21T17:06:09.751052] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-21T17:06:10.551014] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-21T17:06:10.765813] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-21T17:06:11.356242] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-21T17:06:11.383147] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (3.23 seconds). [2025-10-21T17:06:11.503990] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-21T17:06:12.012191] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (3.06 seconds). [2025-10-21T17:06:12.150988] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-21T17:06:12.387456] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-21T17:06:12.951063] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-21T17:06:13.724287] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T17:06:13.750993] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-21T17:06:14.102920] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T17:06:14.551029] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-21T17:06:15.351072] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-21T17:06:15.748815] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T17:06:16.150996] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-21T17:06:16.238253] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T17:06:16.247086] [INFO ] [REMOTE ] AGI: Full fetch complete (77313 records). [2025-10-21T17:06:16.247222] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-21T17:06:16.633829] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-21T17:06:16.633938] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-21T17:06:16.634802] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-21T17:06:16.634940] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-21T17:06:16.636491] [DEBUG] [LOCAL ] AGI: Trimmed 77313 records to 53423 (keeping 200 days of data) [2025-10-21T17:06:16.880314] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T17:06:16.967427] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-21T17:06:16.991963] [DEBUG] [LOCAL ] AGI: Primary data saved (53423 records). [2025-10-21T17:06:16.992092] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-21T17:06:16.993780] [INFO ] [MAIN ] Update Progress: 54/2366 symbols completed. AGI took 43.9s. Estimated remaining: 4h 26m 7s. Rate: 8.7 symbols/min [2025-10-21T17:06:17.171504] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:06:17.171684] [DEBUG] [LOCAL ] AGRO: No existing data file found in primary storage. [2025-10-21T17:06:17.171736] [WARN ] [MAIN ] AGRO: No existing data found, performing full refresh instead. [2025-10-21T17:06:17.171874] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-21T17:06:17.171940] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-21T17:06:17.171991] [DEBUG] [LOCAL ] AGRO: No primary data file found to delete. [2025-10-21T17:06:17.172024] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-21T17:06:17.551928] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:06:17.751078] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-21T17:06:18.105985] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T17:06:18.109299] [INFO ] [REMOTE ] AGM: Full fetch complete (13315 records). [2025-10-21T17:06:18.109436] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-21T17:06:18.394860] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-21T17:06:18.556251] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-21T17:06:18.672029] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-21T17:06:18.672140] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-21T17:06:18.672601] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-21T17:06:18.672703] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-21T17:06:18.673564] [DEBUG] [LOCAL ] AGM: Trimmed 13315 records to 10663 (keeping 200 days of data) [2025-10-21T17:06:18.777750] [DEBUG] [LOCAL ] AGM: Primary data saved (10663 records). [2025-10-21T17:06:18.777923] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-21T17:06:18.778036] [INFO ] [MAIN ] Update Progress: 55/2366 symbols completed. AGM took 26.8s. Estimated remaining: 4h 22m 25s. Rate: 8.8 symbols/min [2025-10-21T17:06:18.966682] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:06:19.003059] [DEBUG] [LOCAL ] AGX: Loaded 32688 existing records from primary storage. [2025-10-21T17:06:19.003362] [INFO ] [MAIN ] AGX: Loaded 32688 existing records. [2025-10-21T17:06:19.198582] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:06:19.199178] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-21T17:06:19.199294] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-21T17:06:19.199627] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-21T17:06:19.199723] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-21T17:06:19.351795] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-21T17:06:19.598085] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-21T17:06:19.603594] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:06:19.627506] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T17:06:20.151035] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-21T17:06:20.951075] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-21T17:06:21.438329] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-21T17:06:21.493913] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-21T17:06:21.502051] [INFO ] [REMOTE ] AGL: Full fetch complete (75932 records). [2025-10-21T17:06:21.502177] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-21T17:06:21.759076] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-21T17:06:21.916416] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-21T17:06:21.916494] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-21T17:06:21.917277] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-21T17:06:21.917342] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-21T17:06:21.918800] [DEBUG] [LOCAL ] AGL: Trimmed 75932 records to 52587 (keeping 200 days of data) [2025-10-21T17:06:22.155777] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-21T17:06:22.237795] [DEBUG] [LOCAL ] AGL: Primary data saved (52587 records). [2025-10-21T17:06:22.237921] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-21T17:06:22.237989] [INFO ] [MAIN ] Update Progress: 56/2366 symbols completed. AGL took 30.9s. Estimated remaining: 4h 20m 0s. Rate: 8.9 symbols/min [2025-10-21T17:06:22.411685] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:06:22.447680] [DEBUG] [LOCAL ] AHH: Loaded 40379 existing records from primary storage. [2025-10-21T17:06:22.447950] [INFO ] [MAIN ] AHH: Loaded 40379 existing records. [2025-10-21T17:06:22.553672] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-21T17:06:22.633685] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:06:22.633869] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-21T17:06:22.633917] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-21T17:06:22.634140] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-21T17:06:22.634177] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-21T17:06:22.999473] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:06:23.017955] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T17:06:23.351025] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-21T17:06:23.764300] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-21T17:06:24.151029] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-21T17:06:24.569523] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-21T17:06:24.951023] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-21T17:06:25.269898] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T17:06:25.751051] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-21T17:06:26.497175] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T17:06:26.551001] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-21T17:06:27.006461] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T17:06:27.011139] [INFO ] [REMOTE ] AGO: Full fetch complete (39755 records). [2025-10-21T17:06:27.011234] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-21T17:06:27.358164] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-21T17:06:27.390426] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-21T17:06:27.390515] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-21T17:06:27.391019] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-21T17:06:27.391087] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-21T17:06:27.392141] [DEBUG] [LOCAL ] AGO: Trimmed 39755 records to 27763 (keeping 200 days of data) [2025-10-21T17:06:27.560839] [DEBUG] [LOCAL ] AGO: Primary data saved (27763 records). [2025-10-21T17:06:27.560967] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-21T17:06:27.561044] [INFO ] [MAIN ] Update Progress: 57/2366 symbols completed. AGO took 30.4s. Estimated remaining: 4h 18m 56s. Rate: 8.9 symbols/min [2025-10-21T17:06:27.727217] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:06:27.727372] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-21T17:06:27.727408] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-21T17:06:27.727516] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-21T17:06:27.727556] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-21T17:06:27.727596] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-21T17:06:27.727628] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-21T17:06:28.090261] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:06:28.151002] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-21T17:06:28.231954] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T17:06:28.956955] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-10-21T17:06:28.979482] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T17:06:29.193261] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:06:29.193561] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-10-21T17:06:29.193672] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:06:29.193730] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-21T17:06:29.193773] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:06:29.193836] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-21T17:06:29.193899] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-21T17:06:29.193933] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-21T17:06:29.193971] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-21T17:06:29.194015] [INFO ] [MAIN ] Update Progress: 58/2366 symbols completed. AHL took 1.6s. Estimated remaining: 4h 15m 26s. Rate: 9.0 symbols/min [2025-10-21T17:06:29.362003] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:06:29.406037] [DEBUG] [LOCAL ] AHR: Loaded 49006 existing records from primary storage. [2025-10-21T17:06:29.406360] [INFO ] [MAIN ] AHR: Loaded 49006 existing records. [2025-10-21T17:06:29.591935] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:06:29.592199] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-21T17:06:29.592277] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-21T17:06:29.592498] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-21T17:06:29.592624] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-21T17:06:29.751367] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T17:06:29.761784] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-21T17:06:29.973580] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:06:30.551016] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-21T17:06:31.178272] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:06:31.351021] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-21T17:06:32.106885] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T17:06:32.150979] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-21T17:06:32.929838] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T17:06:32.950976] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-21T17:06:33.469420] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-21T17:06:33.751018] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-21T17:06:34.533091] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T17:06:34.550978] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-21T17:06:35.151208] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T17:06:35.351082] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-21T17:06:36.049884] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T17:06:36.151026] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-21T17:06:36.951037] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-21T17:06:36.953281] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T17:06:37.682799] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T17:06:37.750978] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-21T17:06:38.260633] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T17:06:38.551088] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-21T17:06:39.351002] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-21T17:06:39.519776] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-21T17:06:39.576586] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T17:06:40.151028] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-21T17:06:40.818960] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-21T17:06:40.951075] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-21T17:06:41.440696] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T17:06:41.751028] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-21T17:06:42.103012] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-21T17:06:42.551055] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-21T17:06:42.997415] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T17:06:43.351024] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-21T17:06:44.159370] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-21T17:06:44.177066] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T17:06:44.539703] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-21T17:06:44.951071] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-21T17:06:45.561941] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T17:06:45.751064] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-21T17:06:46.502462] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T17:06:46.550989] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-21T17:06:47.349593] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T17:06:47.355367] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-21T17:06:47.357180] [INFO ] [REMOTE ] AHH: Full fetch complete (59540 records). [2025-10-21T17:06:47.357331] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-21T17:06:47.764192] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-21T17:06:47.764273] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-21T17:06:47.764928] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-21T17:06:47.764990] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-21T17:06:47.766239] [DEBUG] [LOCAL ] AHH: Trimmed 59540 records to 40272 (keeping 200 days of data) [2025-10-21T17:06:47.991125] [DEBUG] [LOCAL ] AHH: Primary data saved (40272 records). [2025-10-21T17:06:47.991245] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-21T17:06:47.991318] [INFO ] [MAIN ] Update Progress: 59/2366 symbols completed. AHH took 25.8s. Estimated remaining: 4h 23m 15s. Rate: 8.8 symbols/min [2025-10-21T17:06:48.152819] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-21T17:06:48.175042] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:06:48.211871] [DEBUG] [LOCAL ] AHT: Loaded 6438 existing records from primary storage. [2025-10-21T17:06:48.212137] [INFO ] [MAIN ] AHT: Loaded 6438 existing records. [2025-10-21T17:06:48.272131] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T17:06:48.409055] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:06:48.409246] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-21T17:06:48.409293] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-21T17:06:48.409597] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-21T17:06:48.409680] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-21T17:06:48.810853] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:06:48.952362] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-21T17:06:48.958558] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-21T17:06:49.534321] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T17:06:49.751089] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-21T17:06:50.551042] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-21T17:06:50.632325] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T17:06:51.052816] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T17:06:51.057531] [INFO ] [REMOTE ] AGX: Full fetch complete (48977 records). [2025-10-21T17:06:51.057636] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-21T17:06:51.359175] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-21T17:06:51.355806] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-21T17:06:51.450843] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-21T17:06:51.450911] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-21T17:06:51.451421] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-21T17:06:51.451461] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-21T17:06:51.452422] [DEBUG] [LOCAL ] AGX: Trimmed 48977 records to 32682 (keeping 200 days of data) [2025-10-21T17:06:51.645342] [DEBUG] [LOCAL ] AGX: Primary data saved (32682 records). [2025-10-21T17:06:51.645459] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-21T17:06:51.645531] [INFO ] [MAIN ] Update Progress: 60/2366 symbols completed. AGX took 32.9s. Estimated remaining: 4h 21m 5s. Rate: 8.8 symbols/min [2025-10-21T17:06:51.812554] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:06:51.812718] [DEBUG] [LOCAL ] AI: No existing data file found in primary storage. [2025-10-21T17:06:51.812768] [WARN ] [MAIN ] AI: No existing data found, performing full refresh instead. [2025-10-21T17:06:51.812872] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-21T17:06:51.812912] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-21T17:06:51.812975] [DEBUG] [LOCAL ] AI: No primary data file found to delete. [2025-10-21T17:06:51.813040] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-21T17:06:52.165849] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-21T17:06:52.171139] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:06:52.905504] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-21T17:06:52.951016] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-21T17:06:53.114580] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T17:06:53.751080] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-21T17:06:54.060827] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T17:06:54.065763] [INFO ] [REMOTE ] AGRO: Full fetch complete (48937 records). [2025-10-21T17:06:54.065846] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-21T17:06:54.436610] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-21T17:06:54.436715] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-21T17:06:54.437241] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-21T17:06:54.437282] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-21T17:06:54.438257] [DEBUG] [LOCAL ] AGRO: Trimmed 48937 records to 32640 (keeping 200 days of data) [2025-10-21T17:06:54.552622] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-21T17:06:54.623060] [DEBUG] [LOCAL ] AGRO: Primary data saved (32640 records). [2025-10-21T17:06:54.623172] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-21T17:06:54.623238] [INFO ] [MAIN ] Update Progress: 61/2366 symbols completed. AGRO took 37.6s. Estimated remaining: 4h 18m 34s. Rate: 8.9 symbols/min [2025-10-21T17:06:54.793098] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:06:54.844622] [DEBUG] [LOCAL ] AIG: Loaded 53465 existing records from primary storage. [2025-10-21T17:06:54.844950] [INFO ] [MAIN ] AIG: Loaded 53465 existing records. [2025-10-21T17:06:55.020109] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:06:55.020300] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-21T17:06:55.020346] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-21T17:06:55.020529] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-21T17:06:55.020565] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-21T17:06:55.355044] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-21T17:06:55.367984] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:06:56.151002] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-21T17:06:56.202782] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T17:06:56.201805] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-21T17:06:56.323881] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-21T17:06:56.951075] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-21T17:06:57.567952] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-21T17:06:57.751058] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-21T17:06:58.080827] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T17:06:58.551059] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-21T17:06:59.351102] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-21T17:07:00.156219] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-21T17:07:00.158038] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T17:07:00.167155] [INFO ] [REMOTE ] AHR: Full fetch complete (70785 records). [2025-10-21T17:07:00.167354] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-21T17:07:00.495200] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.74 seconds). [2025-10-21T17:07:00.601081] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-21T17:07:00.601164] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-21T17:07:00.601877] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-21T17:07:00.601939] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-21T17:07:00.603329] [DEBUG] [LOCAL ] AHR: Trimmed 70785 records to 48969 (keeping 200 days of data) [2025-10-21T17:07:00.893535] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-21T17:07:00.903151] [DEBUG] [LOCAL ] AHR: Primary data saved (48969 records). [2025-10-21T17:07:00.903257] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-21T17:07:00.903331] [INFO ] [MAIN ] Update Progress: 62/2366 symbols completed. AHR took 31.7s. Estimated remaining: 4h 18m 11s. Rate: 8.9 symbols/min [2025-10-21T17:07:00.958038] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-21T17:07:01.078335] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:07:01.078508] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-21T17:07:01.078672] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-21T17:07:01.078915] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-21T17:07:01.078962] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-21T17:07:01.087838] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-21T17:07:01.093717] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-21T17:07:01.175062] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T17:07:01.469247] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:07:01.751027] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-10-21T17:07:01.969518] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:07:01.969897] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-10-21T17:07:01.969988] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:07:01.970082] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-21T17:07:01.970152] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:07:01.970222] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-21T17:07:01.970285] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-21T17:07:01.970321] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-21T17:07:01.970360] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-21T17:07:01.970404] [INFO ] [MAIN ] Update Progress: 63/2366 symbols completed. AII took 1.1s. Estimated remaining: 4h 14m 37s. Rate: 9.0 symbols/min [2025-10-21T17:07:02.141580] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:07:02.165212] [DEBUG] [LOCAL ] AIN: Loaded 24466 existing records from primary storage. [2025-10-21T17:07:02.165455] [INFO ] [MAIN ] AIN: Loaded 24466 existing records. [2025-10-21T17:07:02.343838] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:07:02.344045] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-21T17:07:02.344092] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-21T17:07:02.344286] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-21T17:07:02.344342] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-21T17:07:02.556325] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-21T17:07:02.697145] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:07:03.351043] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-21T17:07:03.412455] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-21T17:07:04.151048] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-21T17:07:04.501877] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T17:07:04.526237] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T17:07:04.951005] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-21T17:07:05.012359] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-21T17:07:05.751018] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-21T17:07:05.898173] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T17:07:06.279301] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-21T17:07:06.551072] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-21T17:07:07.351061] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-21T17:07:07.732260] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-21T17:07:08.151033] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-21T17:07:08.951004] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-21T17:07:09.338381] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-21T17:07:09.475945] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T17:07:09.751017] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-21T17:07:10.551072] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-21T17:07:11.099602] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-21T17:07:11.284452] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T17:07:11.351066] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-21T17:07:11.661045] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T17:07:12.115303] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T17:07:12.151116] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-21T17:07:12.884122] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-21T17:07:12.951021] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-21T17:07:13.751031] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-21T17:07:14.551034] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-21T17:07:15.342607] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-21T17:07:15.353324] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-21T17:07:15.478497] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T17:07:15.730887] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T17:07:15.995466] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-21T17:07:15.997094] [INFO ] [REMOTE ] AHT: Full fetch complete (9104 records). [2025-10-21T17:07:15.997165] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-21T17:07:16.161920] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-21T17:07:16.366377] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-21T17:07:16.366451] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-21T17:07:16.366668] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-21T17:07:16.366728] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-21T17:07:16.367123] [DEBUG] [LOCAL ] AHT: Trimmed 9104 records to 6381 (keeping 200 days of data) [2025-10-21T17:07:16.402484] [DEBUG] [LOCAL ] AHT: Primary data saved (6381 records). [2025-10-21T17:07:16.402574] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-21T17:07:16.402671] [INFO ] [MAIN ] Update Progress: 64/2366 symbols completed. AHT took 28.4s. Estimated remaining: 4h 19m 11s. Rate: 8.9 symbols/min [2025-10-21T17:07:16.567041] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:07:16.583246] [DEBUG] [LOCAL ] AIO: Loaded 13123 existing records from primary storage. [2025-10-21T17:07:16.583449] [INFO ] [MAIN ] AIO: Loaded 13123 existing records. [2025-10-21T17:07:16.760227] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:07:16.760467] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-21T17:07:16.760513] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-21T17:07:16.760772] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-21T17:07:16.760829] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-21T17:07:16.962913] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-21T17:07:17.108677] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:07:17.751109] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-21T17:07:18.105024] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-21T17:07:18.273917] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-21T17:07:18.551047] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-21T17:07:18.816297] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T17:07:19.351033] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-21T17:07:20.151051] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-21T17:07:20.950992] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-21T17:07:20.991584] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-21T17:07:21.012317] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T17:07:21.349481] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-21T17:07:21.751020] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-21T17:07:21.810719] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T17:07:22.550999] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-21T17:07:22.708725] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-21T17:07:23.351011] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-21T17:07:24.151076] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-21T17:07:24.951002] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-21T17:07:25.084286] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-21T17:07:25.108074] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-21T17:07:25.213839] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T17:07:25.751082] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-21T17:07:26.249172] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T17:07:26.551027] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-21T17:07:27.351025] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-21T17:07:28.151006] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-21T17:07:28.409069] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-21T17:07:28.582445] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-21T17:07:28.630412] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T17:07:28.634379] [INFO ] [REMOTE ] AIN: Full fetch complete (33707 records). [2025-10-21T17:07:28.634458] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-21T17:07:28.956777] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-21T17:07:29.006752] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-21T17:07:29.006851] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-21T17:07:29.007276] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-21T17:07:29.007321] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-21T17:07:29.008323] [DEBUG] [LOCAL ] AIN: Trimmed 33707 records to 24431 (keeping 200 days of data) [2025-10-21T17:07:29.162672] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T17:07:29.173260] [DEBUG] [LOCAL ] AIN: Primary data saved (24431 records). [2025-10-21T17:07:29.173391] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-21T17:07:29.173470] [INFO ] [MAIN ] Update Progress: 65/2366 symbols completed. AIN took 27.2s. Estimated remaining: 4h 22m 37s. Rate: 8.8 symbols/min [2025-10-21T17:07:29.340476] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:07:29.367429] [DEBUG] [LOCAL ] AIR: Loaded 28742 existing records from primary storage. [2025-10-21T17:07:29.367681] [INFO ] [MAIN ] AIR: Loaded 28742 existing records. [2025-10-21T17:07:29.543759] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:07:29.543982] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-21T17:07:29.544033] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-21T17:07:29.544268] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-21T17:07:29.544330] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-21T17:07:29.759004] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-21T17:07:29.894817] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:07:30.551023] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-21T17:07:30.809910] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T17:07:31.350987] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-21T17:07:31.643983] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.69 seconds). [2025-10-21T17:07:31.653543] [INFO ] [REMOTE ] AI: Full fetch complete (77915 records). [2025-10-21T17:07:31.653784] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-21T17:07:32.025215] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T17:07:32.126277] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-21T17:07:32.126406] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-21T17:07:32.127452] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-21T17:07:32.127550] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-21T17:07:32.129948] [DEBUG] [LOCAL ] AI: Trimmed 77915 records to 53765 (keeping 200 days of data) [2025-10-21T17:07:32.184580] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-21T17:07:32.257036] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-21T17:07:32.519836] [DEBUG] [LOCAL ] AI: Primary data saved (53765 records). [2025-10-21T17:07:32.520071] [INFO ] [MAIN ] AI: Full history saved. [2025-10-21T17:07:32.520297] [INFO ] [MAIN ] Update Progress: 66/2366 symbols completed. AI took 40.9s. Estimated remaining: 4h 20m 28s. Rate: 8.8 symbols/min [2025-10-21T17:07:32.713495] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:07:32.740538] [DEBUG] [LOCAL ] AIT: Loaded 26804 existing records from primary storage. [2025-10-21T17:07:32.740916] [INFO ] [MAIN ] AIT: Loaded 26804 existing records. [2025-10-21T17:07:32.922998] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:07:32.923286] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-21T17:07:32.923357] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-21T17:07:32.923590] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-21T17:07:32.923697] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-21T17:07:32.955256] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-21T17:07:33.091052] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-21T17:07:33.304955] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:07:33.671255] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T17:07:33.751038] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-21T17:07:34.549935] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T17:07:34.552888] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-21T17:07:35.351108] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-21T17:07:35.907885] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-21T17:07:36.151033] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-21T17:07:36.352740] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T17:07:36.950998] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-21T17:07:37.047196] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T17:07:37.056343] [INFO ] [REMOTE ] AIG: Full fetch complete (77566 records). [2025-10-21T17:07:37.056501] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-21T17:07:37.458619] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-21T17:07:37.458731] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-21T17:07:37.459510] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-21T17:07:37.459574] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-21T17:07:37.461101] [DEBUG] [LOCAL ] AIG: Trimmed 77566 records to 53461 (keeping 200 days of data) [2025-10-21T17:07:37.765587] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-21T17:07:37.790430] [DEBUG] [LOCAL ] AIG: Primary data saved (53461 records). [2025-10-21T17:07:37.790593] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-21T17:07:37.792120] [INFO ] [MAIN ] Update Progress: 67/2366 symbols completed. AIG took 43.2s. Estimated remaining: 4h 19m 29s. Rate: 8.9 symbols/min [2025-10-21T17:07:37.899843] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-21T17:07:37.918863] [INFO ] [REMOTE ] AIO: Full fetch complete (20061 records). [2025-10-21T17:07:37.941906] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-21T17:07:38.010803] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:07:38.348635] [DEBUG] [LOCAL ] AIV: Loaded 41799 existing records from primary storage. [2025-10-21T17:07:38.367570] [INFO ] [MAIN ] AIV: Loaded 41799 existing records. [2025-10-21T17:07:38.561542] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-21T17:07:38.607243] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-21T17:07:38.607421] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-21T17:07:38.634540] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-21T17:07:38.642564] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-21T17:07:38.642375] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:07:38.643010] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-21T17:07:38.643279] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-21T17:07:38.643734] [DEBUG] [LOCAL ] AIO: Trimmed 20061 records to 13039 (keeping 200 days of data) [2025-10-21T17:07:38.643788] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-21T17:07:38.643944] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-21T17:07:38.896610] [DEBUG] [LOCAL ] AIO: Primary data saved (13039 records). [2025-10-21T17:07:38.916233] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-21T17:07:38.922131] [INFO ] [MAIN ] Update Progress: 68/2366 symbols completed. AIO took 22.5s. Estimated remaining: 4h 16m 12s. Rate: 9.0 symbols/min [2025-10-21T17:07:39.313211] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:07:39.326329] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:07:39.344480] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T17:07:39.351115] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-21T17:07:39.382938] [DEBUG] [LOCAL ] AIZ: Loaded 29471 existing records from primary storage. [2025-10-21T17:07:39.383233] [INFO ] [MAIN ] AIZ: Loaded 29471 existing records. [2025-10-21T17:07:39.589253] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:07:39.589518] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-21T17:07:39.589572] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-21T17:07:39.589792] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-21T17:07:39.589851] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-21T17:07:39.978766] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:07:39.982372] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:07:40.151039] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-21T17:07:40.833401] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T17:07:40.950982] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-21T17:07:41.670432] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T17:07:41.750986] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-21T17:07:42.366611] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:07:42.551070] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-21T17:07:43.043029] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T17:07:43.351075] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-21T17:07:44.007273] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-21T17:07:44.070942] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-21T17:07:44.151062] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-21T17:07:44.951037] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-21T17:07:45.648659] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-21T17:07:45.751044] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-21T17:07:46.108206] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-21T17:07:46.551087] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-21T17:07:47.151673] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-21T17:07:47.351015] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-21T17:07:47.993012] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T17:07:48.151035] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-21T17:07:48.904290] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T17:07:48.951010] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-21T17:07:49.136501] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T17:07:49.751027] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-21T17:07:50.132446] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T17:07:50.551000] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-21T17:07:50.842372] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T17:07:51.351019] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-21T17:07:51.864955] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T17:07:52.151087] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-21T17:07:52.951027] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-21T17:07:53.082064] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T17:07:53.221726] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-21T17:07:53.751131] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-21T17:07:53.988818] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-21T17:07:54.551071] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-21T17:07:54.611401] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T17:07:55.351012] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-21T17:07:55.514621] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-21T17:07:56.151032] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-21T17:07:56.951067] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-21T17:07:57.027048] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T17:07:57.705071] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T17:07:57.751052] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-21T17:07:58.340435] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T17:07:58.551062] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-21T17:07:58.840491] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-21T17:07:59.351044] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-21T17:08:00.117878] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T17:08:00.129361] [INFO ] [REMOTE ] AIV: Full fetch complete (60368 records). [2025-10-21T17:08:00.129540] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-21T17:08:00.160064] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-21T17:08:00.574262] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-21T17:08:00.574383] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-21T17:08:00.575061] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-21T17:08:00.590429] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-21T17:08:00.592388] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T17:08:00.599374] [DEBUG] [LOCAL ] AIV: Trimmed 60368 records to 41856 (keeping 200 days of data) [2025-10-21T17:08:00.836204] [DEBUG] [LOCAL ] AIV: Primary data saved (41856 records). [2025-10-21T17:08:00.836357] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-21T17:08:00.836458] [INFO ] [MAIN ] Update Progress: 69/2366 symbols completed. AIV took 23.0s. Estimated remaining: 4h 24m 32s. Rate: 8.7 symbols/min [2025-10-21T17:08:00.956142] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-21T17:08:01.004995] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:08:01.010324] [DEBUG] [LOCAL ] AIZN: Loaded 3848 existing records from primary storage. [2025-10-21T17:08:01.010499] [INFO ] [MAIN ] AIZN: Loaded 3848 existing records. [2025-10-21T17:08:01.188522] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:08:01.188793] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-21T17:08:01.188850] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-21T17:08:01.188986] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-21T17:08:01.189033] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-21T17:08:01.576588] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:08:01.578037] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T17:08:01.751003] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-21T17:08:02.036060] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-21T17:08:02.222781] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-21T17:08:02.551033] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-21T17:08:03.351049] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-21T17:08:03.835142] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-21T17:08:03.836364] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T17:08:04.151044] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-21T17:08:04.760234] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-21T17:08:04.951118] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-21T17:08:05.541012] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-21T17:08:05.751127] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-21T17:08:06.551074] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-21T17:08:07.183053] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T17:08:07.351012] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-21T17:08:07.700965] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-21T17:08:07.704724] [INFO ] [REMOTE ] AIT: Full fetch complete (38964 records). [2025-10-21T17:08:07.705087] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-21T17:08:07.705725] [FATAL] [VALIDATOR ] AIT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:08:07.705811] [FATAL] [MAIN ] AIT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:08:07.705854] [WARN ] [MAIN ] AIT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:08:07.705917] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-21T17:08:07.705983] [DEBUG] [LOCAL ] AIT: No primary data file found to delete. [2025-10-21T17:08:07.706020] [INFO ] [LOCAL ] AIT: Starting deletion of derivative data. [2025-10-21T17:08:07.706169] [DEBUG] [LOCAL ] AIT: Deleted derivative data file. [2025-10-21T17:08:07.706258] [INFO ] [MAIN ] Update Progress: 70/2366 symbols completed. AIT took 35.2s. Estimated remaining: 4h 24m 24s. Rate: 8.7 symbols/min [2025-10-21T17:08:07.875800] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:08:07.921748] [DEBUG] [LOCAL ] AJG: Loaded 46490 existing records from primary storage. [2025-10-21T17:08:07.922266] [INFO ] [MAIN ] AJG: Loaded 46490 existing records. [2025-10-21T17:08:08.104522] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:08:08.104753] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-21T17:08:08.104807] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-21T17:08:08.104991] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-21T17:08:08.105031] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-21T17:08:08.160031] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-21T17:08:08.476435] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:08:08.552823] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-21T17:08:08.773271] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-21T17:08:08.951043] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-21T17:08:09.516818] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-21T17:08:09.751029] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-21T17:08:10.551023] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-21T17:08:10.652923] [DEBUG] [REMOTE ] AIR: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-21T17:08:10.653211] [WARN ] [REMOTE ] AIR: No data returned for month 2025-10 [2025-10-21T17:08:10.653300] [FATAL] [REMOTE ] AIR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:08:10.653377] [FATAL] [MAIN ] AIR: Failed to fetch primary data. [2025-10-21T17:08:10.653412] [WARN ] [MAIN ] AIR: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:08:10.653452] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-21T17:08:10.653506] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-10-21T17:08:10.653542] [INFO ] [LOCAL ] AIR: Starting deletion of derivative data. [2025-10-21T17:08:10.653712] [DEBUG] [LOCAL ] AIR: Deleted derivative data file. [2025-10-21T17:08:10.653793] [INFO ] [MAIN ] Update Progress: 71/2366 symbols completed. AIR took 41.5s. Estimated remaining: 4h 22m 9s. Rate: 8.8 symbols/min [2025-10-21T17:08:10.832774] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:08:10.833191] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-21T17:08:10.833250] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-21T17:08:10.833363] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-21T17:08:10.833405] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-21T17:08:10.833448] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-21T17:08:10.833482] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-21T17:08:11.213182] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-21T17:08:11.218174] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:08:11.223069] [INFO ] [REMOTE ] AIZ: Full fetch complete (42813 records). [2025-10-21T17:08:11.223182] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-21T17:08:11.356127] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-21T17:08:11.657772] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-21T17:08:11.657935] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-21T17:08:11.658598] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-21T17:08:11.658696] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-21T17:08:11.660362] [DEBUG] [LOCAL ] AIZ: Trimmed 42813 records to 29391 (keeping 200 days of data) [2025-10-21T17:08:11.868198] [DEBUG] [LOCAL ] AIZ: Primary data saved (29391 records). [2025-10-21T17:08:11.868483] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-21T17:08:11.868595] [INFO ] [MAIN ] Update Progress: 72/2366 symbols completed. AIZ took 32.9s. Estimated remaining: 4h 19m 2s. Rate: 8.9 symbols/min [2025-10-21T17:08:12.067496] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:08:12.071784] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-21T17:08:12.122361] [DEBUG] [LOCAL ] AKR: Loaded 46127 existing records from primary storage. [2025-10-21T17:08:12.122802] [INFO ] [MAIN ] AKR: Loaded 46127 existing records. [2025-10-21T17:08:12.156979] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-21T17:08:12.324690] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:08:12.325117] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-21T17:08:12.325173] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-21T17:08:12.325438] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-21T17:08:12.325479] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-21T17:08:12.720270] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:08:12.898923] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-21T17:08:12.951007] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-21T17:08:13.751033] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-21T17:08:14.551071] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-21T17:08:14.622403] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T17:08:15.019510] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-21T17:08:15.260448] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-21T17:08:15.351019] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-21T17:08:16.151038] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-21T17:08:16.745317] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-21T17:08:16.951067] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-21T17:08:17.069029] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-21T17:08:17.453210] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-21T17:08:17.751022] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-21T17:08:18.551079] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-21T17:08:19.126718] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-21T17:08:19.127901] [INFO ] [REMOTE ] AIZN: Full fetch complete (5805 records). [2025-10-21T17:08:19.127969] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-21T17:08:19.276464] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-21T17:08:19.357442] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-21T17:08:19.523404] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-21T17:08:19.523475] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-21T17:08:19.523628] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-21T17:08:19.523700] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-21T17:08:19.524057] [DEBUG] [LOCAL ] AIZN: Trimmed 5805 records to 3846 (keeping 200 days of data) [2025-10-21T17:08:19.546517] [DEBUG] [LOCAL ] AIZN: Primary data saved (3846 records). [2025-10-21T17:08:19.546593] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-21T17:08:19.546684] [INFO ] [MAIN ] Update Progress: 73/2366 symbols completed. AIZN took 18.7s. Estimated remaining: 4h 19m 24s. Rate: 8.8 symbols/min [2025-10-21T17:08:19.717622] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:08:19.758075] [DEBUG] [LOCAL ] AL: Loaded 44827 existing records from primary storage. [2025-10-21T17:08:19.758384] [INFO ] [MAIN ] AL: Loaded 44827 existing records. [2025-10-21T17:08:19.862609] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-21T17:08:19.940727] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:08:19.940957] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-21T17:08:19.941024] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-21T17:08:19.941266] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-21T17:08:19.941340] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-21T17:08:20.156230] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-21T17:08:20.291027] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:08:20.951070] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-21T17:08:21.408144] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-21T17:08:21.751069] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-21T17:08:21.922429] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T17:08:22.303201] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-21T17:08:22.551029] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-21T17:08:22.836631] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-21T17:08:23.351032] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-21T17:08:24.151045] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-21T17:08:24.874179] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T17:08:24.951018] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-21T17:08:25.750995] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-21T17:08:25.837107] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:08:26.382925] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-21T17:08:26.551012] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-21T17:08:27.350996] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-21T17:08:27.515938] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T17:08:27.697860] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-21T17:08:28.151018] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-21T17:08:28.523047] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-21T17:08:28.543331] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-21T17:08:28.951008] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-21T17:08:29.751065] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-21T17:08:30.551055] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-21T17:08:30.653805] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T17:08:30.892960] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-21T17:08:31.351056] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-21T17:08:31.377206] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T17:08:32.151032] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-21T17:08:32.634348] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-21T17:08:32.762763] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T17:08:32.951016] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-21T17:08:33.751130] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-21T17:08:34.564715] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-21T17:08:34.592550] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T17:08:35.147914] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-21T17:08:35.149252] [INFO ] [REMOTE ] AKA: Full fetch complete (2814 records). [2025-10-21T17:08:35.149345] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-21T17:08:35.329870] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-21T17:08:35.330083] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:08:35.330223] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:08:35.330300] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-21T17:08:35.330361] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-21T17:08:35.330399] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-21T17:08:35.330437] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-21T17:08:35.330493] [INFO ] [MAIN ] Update Progress: 74/2366 symbols completed. AKA took 24.7s. Estimated remaining: 4h 23m 56s. Rate: 8.7 symbols/min [2025-10-21T17:08:35.361471] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-21T17:08:35.501874] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:08:35.550775] [DEBUG] [LOCAL ] ALB: Loaded 53378 existing records from primary storage. [2025-10-21T17:08:35.551096] [INFO ] [MAIN ] ALB: Loaded 53378 existing records. [2025-10-21T17:08:35.730341] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:08:35.730694] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-21T17:08:35.730755] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-21T17:08:35.738970] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-21T17:08:35.739057] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-21T17:08:35.833282] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-21T17:08:36.120402] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:08:36.151089] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-21T17:08:36.951052] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-21T17:08:37.161952] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T17:08:37.751055] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-21T17:08:37.862022] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T17:08:38.288791] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T17:08:38.551097] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-21T17:08:39.351035] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-21T17:08:39.389011] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T17:08:40.145694] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T17:08:40.154173] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-21T17:08:40.950991] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-21T17:08:41.291902] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-21T17:08:41.701046] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T17:08:41.751108] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-21T17:08:42.551010] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-21T17:08:42.615191] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T17:08:43.273125] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T17:08:43.350988] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-21T17:08:44.150998] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-21T17:08:44.424270] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T17:08:44.921330] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T17:08:44.928744] [INFO ] [REMOTE ] AKR: Full fetch complete (65481 records). [2025-10-21T17:08:44.928869] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-21T17:08:44.959619] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-21T17:08:45.314322] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-21T17:08:45.314412] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-21T17:08:45.315070] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-21T17:08:45.315134] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-21T17:08:45.316474] [DEBUG] [LOCAL ] AKR: Trimmed 65481 records to 46115 (keeping 200 days of data) [2025-10-21T17:08:45.598761] [DEBUG] [LOCAL ] AKR: Primary data saved (46115 records). [2025-10-21T17:08:45.598906] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-21T17:08:45.601323] [INFO ] [MAIN ] Update Progress: 75/2366 symbols completed. AKR took 33.7s. Estimated remaining: 4h 25m 32s. Rate: 8.6 symbols/min [2025-10-21T17:08:45.775035] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:08:45.754297] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-21T17:08:45.841515] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T17:08:45.868755] [DEBUG] [LOCAL ] ALC: Loaded 51212 existing records from primary storage. [2025-10-21T17:08:45.869060] [INFO ] [MAIN ] ALC: Loaded 51212 existing records. [2025-10-21T17:08:46.048499] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:08:46.048733] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-21T17:08:46.048787] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-21T17:08:46.049745] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-21T17:08:46.049805] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-21T17:08:46.409036] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:08:46.551040] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-21T17:08:46.659557] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T17:08:47.351114] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-21T17:08:47.932500] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-21T17:08:48.151021] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-21T17:08:48.254024] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T17:08:48.951025] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-21T17:08:49.137167] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T17:08:49.751062] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-21T17:08:49.881757] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T17:08:50.551047] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-21T17:08:50.957721] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T17:08:51.012511] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T17:08:51.019986] [INFO ] [REMOTE ] AL: Full fetch complete (63611 records). [2025-10-21T17:08:51.020091] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-21T17:08:51.361056] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-21T17:08:51.406038] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-21T17:08:51.406104] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-21T17:08:51.406730] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-21T17:08:51.406791] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-21T17:08:51.408008] [DEBUG] [LOCAL ] AL: Trimmed 63611 records to 44794 (keeping 200 days of data) [2025-10-21T17:08:51.669536] [DEBUG] [LOCAL ] AL: Primary data saved (44794 records). [2025-10-21T17:08:51.669681] [INFO ] [MAIN ] AL: Full history saved. [2025-10-21T17:08:51.670516] [INFO ] [MAIN ] Update Progress: 76/2366 symbols completed. AL took 32.1s. Estimated remaining: 4h 24m 58s. Rate: 8.6 symbols/min [2025-10-21T17:08:51.843981] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:08:51.876828] [DEBUG] [LOCAL ] ALE: Loaded 32104 existing records from primary storage. [2025-10-21T17:08:51.877071] [INFO ] [MAIN ] ALE: Loaded 32104 existing records. [2025-10-21T17:08:52.064256] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:08:52.064686] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-21T17:08:52.064796] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-21T17:08:52.071296] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-21T17:08:52.081952] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-21T17:08:52.155905] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-21T17:08:52.149940] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T17:08:52.197341] [INFO ] [REMOTE ] AJG: Full fetch complete (68928 records). [2025-10-21T17:08:52.208234] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-21T17:08:52.739836] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:08:52.853103] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-21T17:08:52.853349] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-21T17:08:52.854067] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-21T17:08:52.854144] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-21T17:08:52.855723] [DEBUG] [LOCAL ] AJG: Trimmed 68928 records to 46428 (keeping 200 days of data) [2025-10-21T17:08:52.954738] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-21T17:08:53.096559] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T17:08:53.178864] [DEBUG] [LOCAL ] AJG: Primary data saved (46428 records). [2025-10-21T17:08:53.178983] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-21T17:08:53.179055] [INFO ] [MAIN ] Update Progress: 77/2366 symbols completed. AJG took 45.5s. Estimated remaining: 4h 22m 10s. Rate: 8.7 symbols/min [2025-10-21T17:08:53.641034] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T17:08:53.750983] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-21T17:08:54.347701] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T17:08:54.551004] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-21T17:08:55.351036] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-21T17:08:55.683486] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-21T17:08:55.731915] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T17:08:56.151071] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-21T17:08:56.951053] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-21T17:08:57.287130] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-21T17:08:57.505145] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-21T17:08:57.751024] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-21T17:08:58.454581] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-21T17:08:58.551121] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-21T17:08:59.181923] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-21T17:08:59.351021] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-21T17:09:00.151028] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-21T17:09:00.353554] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T17:09:00.951075] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-21T17:09:01.297790] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-21T17:09:01.519815] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T17:09:01.751010] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-21T17:09:02.335583] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T17:09:02.551029] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-21T17:09:02.888875] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T17:09:03.351039] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-21T17:09:04.151045] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-21T17:09:04.396816] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-21T17:09:04.951061] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-21T17:09:05.015857] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T17:09:05.751074] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-21T17:09:06.564140] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-21T17:09:06.576891] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-21T17:09:06.911907] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-21T17:09:07.052362] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-21T17:09:07.351014] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-21T17:09:07.454451] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T17:09:07.462984] [INFO ] [REMOTE ] ALB: Full fetch complete (77070 records). [2025-10-21T17:09:07.463170] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-21T17:09:07.888837] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-21T17:09:07.888975] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-21T17:09:07.889972] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-21T17:09:07.890046] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-21T17:09:07.891749] [DEBUG] [LOCAL ] ALB: Trimmed 77070 records to 53366 (keeping 200 days of data) [2025-10-21T17:09:08.151749] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-21T17:09:08.239672] [DEBUG] [LOCAL ] ALB: Primary data saved (53366 records). [2025-10-21T17:09:08.239827] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-21T17:09:08.239925] [INFO ] [MAIN ] Update Progress: 78/2366 symbols completed. ALB took 32.9s. Estimated remaining: 4h 26m 3s. Rate: 8.6 symbols/min [2025-10-21T17:09:09.465403] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-21T17:09:09.476731] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-21T17:09:09.580160] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T17:09:09.751007] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-21T17:09:11.311485] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T17:09:11.329800] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T17:09:11.336388] [INFO ] [REMOTE ] ALE: Full fetch complete (44228 records). [2025-10-21T17:09:11.336544] [INFO ] [REMOTE ] ALC: Full fetch complete (73810 records). [2025-10-21T17:09:11.336698] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-21T17:09:11.336787] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-21T17:09:12.130434] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-21T17:09:12.133973] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-21T17:09:12.134048] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-21T17:09:12.134088] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-21T17:09:12.134588] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-21T17:09:12.135301] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-21T17:09:12.135383] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-21T17:09:12.135453] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-21T17:09:12.137259] [DEBUG] [LOCAL ] ALE: Trimmed 44228 records to 32060 (keeping 200 days of data) [2025-10-21T17:09:12.137375] [DEBUG] [LOCAL ] ALC: Trimmed 73810 records to 51216 (keeping 200 days of data) [2025-10-21T17:09:12.550690] [DEBUG] [LOCAL ] ALC: Primary data saved (51216 records). [2025-10-21T17:09:12.552476] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-21T17:09:12.554461] [INFO ] [MAIN ] Update Progress: 79/2366 symbols completed. ALC took 27.0s. Estimated remaining: 4h 24m 39s. Rate: 8.6 symbols/min [2025-10-21T17:09:12.624731] [DEBUG] [LOCAL ] ALE: Primary data saved (32060 records). [2025-10-21T17:09:12.624868] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-21T17:09:12.625932] [INFO ] [MAIN ] Update Progress: 80/2366 symbols completed. ALE took 21.0s. Estimated remaining: 4h 21m 16s. Rate: 8.7 symbols/min [2025-10-21T17:09:13.263044] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:09:13.223386] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:09:13.343168] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-21T17:09:13.343107] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:09:13.345450] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:09:13.345576] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-21T17:09:13.346365] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-21T17:09:13.346603] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-21T17:09:13.346701] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-21T17:09:13.346751] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-21T17:09:13.483383] [DEBUG] [LOCAL ] ALG: Loaded 9748 existing records from primary storage. [2025-10-21T17:09:13.515505] [INFO ] [MAIN ] ALG: Loaded 9748 existing records. [2025-10-21T17:09:13.559241] [DEBUG] [LOCAL ] ALEX: Loaded 31005 existing records from primary storage. [2025-10-21T17:09:13.618926] [INFO ] [MAIN ] ALEX: Loaded 31005 existing records. [2025-10-21T17:09:13.877239] [DEBUG] [LOCAL ] ALIT: Loaded 52790 existing records from primary storage. [2025-10-21T17:09:13.915528] [INFO ] [MAIN ] ALIT: Loaded 52790 existing records. [2025-10-21T17:09:14.058620] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:09:14.125504] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:09:14.179268] [INFO ] [REMOTE ] ALH: Fetching primary data for 2025-01. [2025-10-21T17:09:14.201479] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-21T17:09:14.206797] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-21T17:09:14.255379] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-21T17:09:14.264295] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:09:14.273359] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-21T17:09:14.273768] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-21T17:09:14.308481] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-21T17:09:14.343125] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-21T17:09:14.374140] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-21T17:09:14.414528] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:09:14.466957] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-21T17:09:14.495071] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-21T17:09:14.484573] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:09:14.542338] [WARN ] [REMOTE ] ALH: No data returned for month 2025-01 [2025-10-21T17:09:14.542717] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-21T17:09:14.542624] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:09:14.547915] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-21T17:09:14.553230] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-21T17:09:14.616552] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:09:14.731145] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-21T17:09:14.777755] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-21T17:09:14.855976] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-21T17:09:14.938034] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-21T17:09:15.030925] [INFO ] [MAIN ] Update Progress: 81/2366 symbols completed. ALH took 2.4s. Estimated remaining: 4h 19m 3s. Rate: 8.8 symbols/min [2025-10-21T17:09:15.310985] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:09:15.350811] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-21T17:09:15.601206] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:09:15.615244] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-21T17:09:15.642235] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:09:15.656177] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-21T17:09:15.692121] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:09:15.745151] [DEBUG] [LOCAL ] ALK: Loaded 53085 existing records from primary storage. [2025-10-21T17:09:15.745517] [INFO ] [MAIN ] ALK: Loaded 53085 existing records. [2025-10-21T17:09:15.924826] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:09:15.925058] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-21T17:09:15.925104] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-21T17:09:15.925889] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-21T17:09:15.925945] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-21T17:09:16.276385] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:09:16.276734] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-21T17:09:16.380892] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T17:09:16.383914] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-21T17:09:16.956788] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T17:09:16.962753] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-21T17:09:17.224881] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-21T17:09:17.227847] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-21T17:09:17.470236] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T17:09:17.480849] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-21T17:09:17.851204] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-21T17:09:17.854842] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-21T17:09:17.929631] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T17:09:18.091027] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T17:09:18.551061] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-21T17:09:18.624341] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-21T17:09:18.819483] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T17:09:19.351052] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-21T17:09:20.151147] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-21T17:09:20.298479] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T17:09:20.951015] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-21T17:09:21.072465] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T17:09:21.465943] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T17:09:21.750999] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-21T17:09:22.551025] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-21T17:09:22.894137] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T17:09:23.304096] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T17:09:23.350986] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-21T17:09:24.160248] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-21T17:09:24.180368] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T17:09:24.232232] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-21T17:09:24.951056] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-21T17:09:25.196495] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T17:09:25.751022] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-21T17:09:26.551053] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-21T17:09:26.734851] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T17:09:26.822948] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T17:09:27.351030] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-21T17:09:28.151017] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-21T17:09:28.510303] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-21T17:09:28.797736] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-21T17:09:28.951022] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-21T17:09:29.466531] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-21T17:09:29.735482] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-21T17:09:29.750982] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-21T17:09:30.488713] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T17:09:30.551026] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-21T17:09:31.292622] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-21T17:09:31.294570] [INFO ] [REMOTE ] ALG: Full fetch complete (15246 records). [2025-10-21T17:09:31.294704] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-21T17:09:31.356191] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-21T17:09:31.677819] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-21T17:09:31.677897] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-21T17:09:31.678144] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-21T17:09:31.678183] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-21T17:09:31.678723] [DEBUG] [LOCAL ] ALG: Trimmed 15246 records to 9723 (keeping 200 days of data) [2025-10-21T17:09:31.742104] [DEBUG] [LOCAL ] ALG: Primary data saved (9723 records). [2025-10-21T17:09:31.742248] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-21T17:09:31.742327] [INFO ] [MAIN ] Update Progress: 82/2366 symbols completed. ALG took 19.1s. Estimated remaining: 4h 23m 32s. Rate: 8.7 symbols/min [2025-10-21T17:09:31.913422] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:09:31.961988] [DEBUG] [LOCAL ] ALL: Loaded 49721 existing records from primary storage. [2025-10-21T17:09:31.962326] [INFO ] [MAIN ] ALL: Loaded 49721 existing records. [2025-10-21T17:09:32.140081] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:09:32.140329] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-21T17:09:32.140386] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-21T17:09:32.140806] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-21T17:09:32.140862] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-21T17:09:32.161590] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-21T17:09:32.501855] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:09:32.950997] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-21T17:09:33.103846] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T17:09:33.756087] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-21T17:09:33.768773] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T17:09:33.985190] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T17:09:34.551058] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-21T17:09:35.351031] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-21T17:09:35.717928] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-21T17:09:35.796361] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T17:09:36.151075] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-21T17:09:36.950993] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-21T17:09:37.194804] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T17:09:37.689698] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T17:09:37.750992] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-21T17:09:38.243791] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T17:09:38.551092] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-21T17:09:39.351009] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-21T17:09:39.652550] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T17:09:40.154389] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-21T17:09:40.157180] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T17:09:40.951019] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-21T17:09:40.993417] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T17:09:41.751028] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-21T17:09:42.013605] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T17:09:42.118306] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-21T17:09:42.551051] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-21T17:09:43.351016] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-21T17:09:43.731857] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T17:09:44.151048] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-21T17:09:44.412621] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-21T17:09:44.421028] [INFO ] [REMOTE ] ALIT: Full fetch complete (76614 records). [2025-10-21T17:09:44.421154] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-21T17:09:44.823874] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-21T17:09:44.823997] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-21T17:09:44.824825] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-21T17:09:44.824889] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-21T17:09:44.826282] [DEBUG] [LOCAL ] ALIT: Trimmed 76614 records to 52785 (keeping 200 days of data) [2025-10-21T17:09:44.990143] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-21T17:09:45.129359] [DEBUG] [LOCAL ] ALIT: Primary data saved (52785 records). [2025-10-21T17:09:45.129585] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-21T17:09:45.130493] [INFO ] [MAIN ] Update Progress: 83/2366 symbols completed. ALIT took 32.5s. Estimated remaining: 4h 26m 23s. Rate: 8.6 symbols/min [2025-10-21T17:09:45.312550] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:09:45.346202] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-21T17:09:45.397612] [DEBUG] [LOCAL ] ALLE: Loaded 44026 existing records from primary storage. [2025-10-21T17:09:45.397938] [INFO ] [MAIN ] ALLE: Loaded 44026 existing records. [2025-10-21T17:09:45.580572] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:09:45.580894] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-21T17:09:45.580976] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-21T17:09:45.581200] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-21T17:09:45.581258] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-21T17:09:45.760326] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-21T17:09:45.969411] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:09:45.988373] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T17:09:46.022044] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T17:09:46.551089] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-21T17:09:47.351076] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-21T17:09:47.781670] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-21T17:09:47.789965] [INFO ] [REMOTE ] ALK: Full fetch complete (77032 records). [2025-10-21T17:09:47.790098] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-21T17:09:48.170907] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-21T17:09:48.197333] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-21T17:09:48.197517] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-21T17:09:48.198403] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-21T17:09:48.198471] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-21T17:09:48.200244] [DEBUG] [LOCAL ] ALK: Trimmed 77032 records to 53087 (keeping 200 days of data) [2025-10-21T17:09:48.448595] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T17:09:48.550070] [DEBUG] [LOCAL ] ALK: Primary data saved (53087 records). [2025-10-21T17:09:48.550218] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-21T17:09:48.550297] [INFO ] [MAIN ] Update Progress: 84/2366 symbols completed. ALK took 33.5s. Estimated remaining: 4h 24m 39s. Rate: 8.6 symbols/min [2025-10-21T17:09:48.721719] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:09:48.774671] [DEBUG] [LOCAL ] ALLY: Loaded 53224 existing records from primary storage. [2025-10-21T17:09:48.775031] [INFO ] [MAIN ] ALLY: Loaded 53224 existing records. [2025-10-21T17:09:48.951327] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-21T17:09:48.957098] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:09:48.958222] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-21T17:09:48.958398] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-21T17:09:48.958596] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-21T17:09:48.958636] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-21T17:09:49.257734] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T17:09:49.370175] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:09:49.583461] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-21T17:09:49.589050] [INFO ] [REMOTE ] ALEX: Full fetch complete (44501 records). [2025-10-21T17:09:49.589175] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-21T17:09:49.755015] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-21T17:09:49.964052] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-21T17:09:49.964127] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-21T17:09:49.964621] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-21T17:09:49.964697] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-21T17:09:49.965617] [DEBUG] [LOCAL ] ALEX: Trimmed 44501 records to 30881 (keeping 200 days of data) [2025-10-21T17:09:50.147768] [DEBUG] [LOCAL ] ALEX: Primary data saved (30881 records). [2025-10-21T17:09:50.148002] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-21T17:09:50.148110] [INFO ] [MAIN ] Update Progress: 85/2366 symbols completed. ALEX took 37.5s. Estimated remaining: 4h 22m 8s. Rate: 8.7 symbols/min [2025-10-21T17:09:50.345189] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-21T17:09:50.348120] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:09:50.394049] [DEBUG] [LOCAL ] ALSN: Loaded 43332 existing records from primary storage. [2025-10-21T17:09:50.394325] [INFO ] [MAIN ] ALSN: Loaded 43332 existing records. [2025-10-21T17:09:50.565575] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-21T17:09:50.593415] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:09:50.593738] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-21T17:09:50.593790] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-21T17:09:50.593995] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-21T17:09:50.594032] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-21T17:09:50.950143] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:09:51.351004] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-21T17:09:51.435207] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T17:09:52.151040] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-21T17:09:52.201305] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T17:09:52.951018] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-21T17:09:53.346186] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-21T17:09:53.403409] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T17:09:53.751100] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-21T17:09:54.551019] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-21T17:09:54.622490] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T17:09:55.278191] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-21T17:09:55.351000] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-21T17:09:56.151016] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-21T17:09:56.430891] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T17:09:56.951023] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-21T17:09:57.029243] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T17:09:57.545237] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-21T17:09:57.751083] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-21T17:09:58.347860] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-21T17:09:58.551029] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-21T17:09:59.351058] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-21T17:09:59.412231] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-21T17:10:00.156121] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-21T17:10:00.171889] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T17:10:00.472845] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-21T17:10:00.951107] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-21T17:10:01.116925] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-21T17:10:01.124378] [INFO ] [REMOTE ] ALL: Full fetch complete (72487 records). [2025-10-21T17:10:01.124500] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-21T17:10:01.529848] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-21T17:10:01.529938] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-21T17:10:01.530620] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-21T17:10:01.530704] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-21T17:10:01.532105] [DEBUG] [LOCAL ] ALL: Trimmed 72487 records to 49648 (keeping 200 days of data) [2025-10-21T17:10:01.759296] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-21T17:10:01.858711] [DEBUG] [LOCAL ] ALL: Primary data saved (49648 records). [2025-10-21T17:10:01.858877] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-21T17:10:01.860111] [INFO ] [MAIN ] Update Progress: 86/2366 symbols completed. ALL took 30.1s. Estimated remaining: 4h 24m 9s. Rate: 8.6 symbols/min [2025-10-21T17:10:02.058992] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:10:02.085532] [DEBUG] [LOCAL ] ALTG: Loaded 23275 existing records from primary storage. [2025-10-21T17:10:02.085833] [INFO ] [MAIN ] ALTG: Loaded 23275 existing records. [2025-10-21T17:10:02.275215] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:10:02.275517] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-21T17:10:02.275572] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-21T17:10:02.275838] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-21T17:10:02.275895] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-21T17:10:02.564139] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-21T17:10:02.684848] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:10:02.714606] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T17:10:03.351087] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-21T17:10:04.097193] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-21T17:10:04.151044] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-21T17:10:04.433419] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T17:10:04.479108] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-21T17:10:04.951041] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-21T17:10:05.742068] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T17:10:05.751059] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-21T17:10:05.961594] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-21T17:10:06.551005] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-21T17:10:07.351130] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-21T17:10:07.494509] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T17:10:07.929375] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T17:10:08.151088] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-21T17:10:08.951038] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-21T17:10:09.131277] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T17:10:09.751043] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-21T17:10:09.819006] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-21T17:10:09.919352] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T17:10:10.551073] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-21T17:10:11.323131] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T17:10:11.329850] [INFO ] [REMOTE ] ALLE: Full fetch complete (64914 records). [2025-10-21T17:10:11.330003] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-21T17:10:11.362850] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-21T17:10:11.746462] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-21T17:10:11.746586] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-21T17:10:11.747447] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-21T17:10:11.747527] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-21T17:10:11.748981] [DEBUG] [LOCAL ] ALLE: Trimmed 64914 records to 43990 (keeping 200 days of data) [2025-10-21T17:10:12.044887] [DEBUG] [LOCAL ] ALLE: Primary data saved (43990 records). [2025-10-21T17:10:12.045023] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-21T17:10:12.045961] [INFO ] [MAIN ] Update Progress: 87/2366 symbols completed. ALLE took 26.9s. Estimated remaining: 4h 25m 27s. Rate: 8.6 symbols/min [2025-10-21T17:10:12.151104] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-21T17:10:12.225483] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:10:12.236954] [DEBUG] [LOCAL ] ALUR: Loaded 9345 existing records from primary storage. [2025-10-21T17:10:12.237178] [INFO ] [MAIN ] ALUR: Loaded 9345 existing records. [2025-10-21T17:10:12.419760] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:10:12.420580] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-21T17:10:12.420713] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-21T17:10:12.421150] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-21T17:10:12.421211] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-21T17:10:12.667376] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-21T17:10:12.684174] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-21T17:10:12.907571] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:10:12.951055] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-21T17:10:13.751025] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-21T17:10:13.789310] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T17:10:14.088488] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T17:10:14.551059] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-21T17:10:15.351025] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-21T17:10:15.634455] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T17:10:15.919445] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-21T17:10:16.151027] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-21T17:10:16.950999] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-21T17:10:17.257311] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T17:10:17.281295] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T17:10:17.751052] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-21T17:10:18.551035] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-21T17:10:18.751103] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-21T17:10:18.814790] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T17:10:19.267756] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-21T17:10:19.350981] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-21T17:10:20.151043] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-21T17:10:20.452697] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T17:10:20.458157] [INFO ] [REMOTE ] ALTG: Full fetch complete (33427 records). [2025-10-21T17:10:20.458369] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-21T17:10:20.836230] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-21T17:10:20.836311] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-21T17:10:20.836754] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-21T17:10:20.836821] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-21T17:10:20.837720] [DEBUG] [LOCAL ] ALTG: Trimmed 33427 records to 23188 (keeping 200 days of data) [2025-10-21T17:10:20.957366] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-21T17:10:20.969310] [DEBUG] [LOCAL ] ALTG: Primary data saved (23188 records). [2025-10-21T17:10:20.969445] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-21T17:10:20.969531] [INFO ] [MAIN ] Update Progress: 88/2366 symbols completed. ALTG took 19.1s. Estimated remaining: 4h 26m 10s. Rate: 8.6 symbols/min [2025-10-21T17:10:21.147278] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:10:21.189398] [DEBUG] [LOCAL ] ALV: Loaded 42190 existing records from primary storage. [2025-10-21T17:10:21.189729] [INFO ] [MAIN ] ALV: Loaded 42190 existing records. [2025-10-21T17:10:21.376470] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:10:21.387020] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-21T17:10:21.387683] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-21T17:10:21.388223] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T17:10:21.392671] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-21T17:10:21.393287] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-21T17:10:21.755878] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-21T17:10:21.755811] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:10:22.550995] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-21T17:10:22.578091] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-21T17:10:22.909161] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-21T17:10:23.351037] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-21T17:10:23.840877] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T17:10:24.151025] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-21T17:10:24.950990] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-21T17:10:25.428046] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-21T17:10:25.436418] [INFO ] [REMOTE ] ALLY: Full fetch complete (77240 records). [2025-10-21T17:10:25.436545] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-21T17:10:25.758304] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-21T17:10:25.828868] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-21T17:10:25.828994] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-21T17:10:25.829939] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-21T17:10:25.830107] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-21T17:10:25.859846] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T17:10:25.870029] [DEBUG] [LOCAL ] ALLY: Trimmed 77240 records to 53223 (keeping 200 days of data) [2025-10-21T17:10:26.177829] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-21T17:10:26.202084] [DEBUG] [LOCAL ] ALLY: Primary data saved (53223 records). [2025-10-21T17:10:26.202204] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-21T17:10:26.202290] [INFO ] [MAIN ] Update Progress: 89/2366 symbols completed. ALLY took 37.7s. Estimated remaining: 4h 25m 17s. Rate: 8.6 symbols/min [2025-10-21T17:10:26.367866] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:10:26.376595] [DEBUG] [LOCAL ] ALX: Loaded 7183 existing records from primary storage. [2025-10-21T17:10:26.376797] [INFO ] [MAIN ] ALX: Loaded 7183 existing records. [2025-10-21T17:10:26.556845] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-21T17:10:26.562697] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:10:26.563563] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-21T17:10:26.563626] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-21T17:10:26.563817] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-21T17:10:26.563863] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-21T17:10:26.921704] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:10:27.350994] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-21T17:10:27.823280] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-21T17:10:27.901818] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T17:10:27.969904] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-21T17:10:28.151004] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-21T17:10:28.667578] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-21T17:10:28.951010] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-21T17:10:29.751011] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-21T17:10:30.211197] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-21T17:10:30.550995] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-21T17:10:30.628431] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T17:10:31.035297] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-21T17:10:31.351007] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-21T17:10:31.880377] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-21T17:10:32.151032] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-21T17:10:32.812275] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-21T17:10:32.951004] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-21T17:10:33.751011] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-21T17:10:33.764818] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T17:10:34.551033] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-21T17:10:35.157356] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T17:10:35.209941] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-21T17:10:35.351067] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-21T17:10:36.151069] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-21T17:10:36.408553] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-21T17:10:36.951437] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-21T17:10:36.966867] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T17:10:37.750992] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-21T17:10:37.788940] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-21T17:10:38.551029] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-21T17:10:39.351007] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-21T17:10:39.487520] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T17:10:39.504051] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-21T17:10:39.905074] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-21T17:10:40.151032] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-21T17:10:40.951045] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-21T17:10:41.741547] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T17:10:41.743251] [INFO ] [REMOTE ] ALUR: Full fetch complete (18348 records). [2025-10-21T17:10:41.743320] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-21T17:10:41.756329] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-21T17:10:41.903030] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T17:10:42.177818] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-21T17:10:42.177899] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-21T17:10:42.178192] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-21T17:10:42.178234] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-21T17:10:42.178906] [DEBUG] [LOCAL ] ALUR: Trimmed 18348 records to 9307 (keeping 200 days of data) [2025-10-21T17:10:42.231964] [DEBUG] [LOCAL ] ALUR: Primary data saved (9307 records). [2025-10-21T17:10:42.232104] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-21T17:10:42.232185] [INFO ] [MAIN ] Update Progress: 90/2366 symbols completed. ALUR took 30.2s. Estimated remaining: 4h 28m 59s. Rate: 8.5 symbols/min [2025-10-21T17:10:42.401360] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:10:42.452182] [DEBUG] [LOCAL ] AM: Loaded 51887 existing records from primary storage. [2025-10-21T17:10:42.452478] [INFO ] [MAIN ] AM: Loaded 51887 existing records. [2025-10-21T17:10:42.554823] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-21T17:10:42.609317] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-21T17:10:42.619774] [INFO ] [REMOTE ] ALX: Full fetch complete (8047 records). [2025-10-21T17:10:42.648541] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-21T17:10:42.652540] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:10:42.653028] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-21T17:10:42.697441] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-21T17:10:42.718355] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-21T17:10:42.729745] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-21T17:10:43.356083] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-21T17:10:43.362460] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-21T17:10:43.368667] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-21T17:10:43.368996] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-21T17:10:43.374325] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-21T17:10:43.385936] [DEBUG] [LOCAL ] ALX: Trimmed 8047 records to 7228 (keeping 200 days of data) [2025-10-21T17:10:43.469491] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:10:43.496063] [DEBUG] [LOCAL ] ALX: Primary data saved (7228 records). [2025-10-21T17:10:43.496193] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-21T17:10:43.496275] [INFO ] [MAIN ] Update Progress: 91/2366 symbols completed. ALX took 17.3s. Estimated remaining: 4h 26m 26s. Rate: 8.5 symbols/min [2025-10-21T17:10:43.666817] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:10:43.699932] [DEBUG] [LOCAL ] AMBC: Loaded 36189 existing records from primary storage. [2025-10-21T17:10:43.700218] [INFO ] [MAIN ] AMBC: Loaded 36189 existing records. [2025-10-21T17:10:43.883726] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:10:43.884503] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-21T17:10:43.884551] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-21T17:10:43.884938] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-21T17:10:43.884994] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-21T17:10:44.161531] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-21T17:10:44.256204] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:10:44.367903] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T17:10:44.376749] [INFO ] [REMOTE ] ALSN: Full fetch complete (62616 records). [2025-10-21T17:10:44.376880] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-21T17:10:44.844344] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-21T17:10:44.844688] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-21T17:10:44.845523] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-21T17:10:44.854455] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-21T17:10:44.870302] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-21T17:10:44.880226] [DEBUG] [LOCAL ] ALSN: Trimmed 62616 records to 43269 (keeping 200 days of data) [2025-10-21T17:10:44.951153] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-21T17:10:45.150669] [DEBUG] [LOCAL ] ALSN: Primary data saved (43269 records). [2025-10-21T17:10:45.150804] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-21T17:10:45.150888] [INFO ] [MAIN ] Update Progress: 92/2366 symbols completed. ALSN took 55.0s. Estimated remaining: 4h 24m 6s. Rate: 8.6 symbols/min [2025-10-21T17:10:45.318125] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:10:45.318362] [DEBUG] [LOCAL ] AMBP: No existing data file found in primary storage. [2025-10-21T17:10:45.318409] [WARN ] [MAIN ] AMBP: No existing data found, performing full refresh instead. [2025-10-21T17:10:45.318551] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-21T17:10:45.318593] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-21T17:10:45.318633] [DEBUG] [LOCAL ] AMBP: No primary data file found to delete. [2025-10-21T17:10:45.318706] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-21T17:10:45.744890] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:10:45.756112] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-21T17:10:45.775119] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T17:10:46.551054] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-21T17:10:46.645162] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T17:10:47.203674] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T17:10:47.350992] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-21T17:10:48.151008] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-21T17:10:48.311622] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T17:10:48.932876] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T17:10:48.951003] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-21T17:10:49.663841] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-21T17:10:49.750995] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-21T17:10:50.219227] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T17:10:50.551036] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-21T17:10:51.351006] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-21T17:10:51.523468] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T17:10:52.078731] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T17:10:52.151019] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-21T17:10:52.499675] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-21T17:10:52.951027] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-21T17:10:53.751003] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-21T17:10:53.940183] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T17:10:54.551045] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-21T17:10:54.623057] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T17:10:54.815634] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T17:10:55.351055] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-21T17:10:56.151008] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-21T17:10:56.340557] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T17:10:56.913249] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T17:10:56.950982] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-21T17:10:57.751006] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-21T17:10:57.896415] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T17:10:58.551055] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-21T17:10:58.680453] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T17:10:58.687863] [INFO ] [REMOTE ] ALV: Full fetch complete (62354 records). [2025-10-21T17:10:58.688040] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-21T17:10:59.101795] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-21T17:10:59.102103] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-21T17:10:59.102765] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-21T17:10:59.102830] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-21T17:10:59.104349] [DEBUG] [LOCAL ] ALV: Trimmed 62354 records to 42182 (keeping 200 days of data) [2025-10-21T17:10:59.132512] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T17:10:59.364770] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-21T17:10:59.406486] [DEBUG] [LOCAL ] ALV: Primary data saved (42182 records). [2025-10-21T17:10:59.406634] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-21T17:10:59.408313] [INFO ] [MAIN ] Update Progress: 93/2366 symbols completed. ALV took 38.4s. Estimated remaining: 4h 26m 58s. Rate: 8.5 symbols/min [2025-10-21T17:10:59.585913] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:10:59.586076] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-21T17:10:59.586115] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-21T17:10:59.586277] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-21T17:10:59.586319] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-21T17:10:59.586359] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-21T17:10:59.586390] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-21T17:10:59.975706] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:11:00.086431] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T17:11:00.151024] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-21T17:11:00.951057] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-10-21T17:11:01.118033] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T17:11:01.180802] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:11:01.181216] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-10-21T17:11:01.181324] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:11:01.181415] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-21T17:11:01.181498] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:11:01.181593] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-21T17:11:01.181708] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-21T17:11:01.181763] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-21T17:11:01.181843] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-21T17:11:01.181905] [INFO ] [MAIN ] Update Progress: 94/2366 symbols completed. AMBQ took 1.8s. Estimated remaining: 4h 24m 43s. Rate: 8.6 symbols/min [2025-10-21T17:11:01.410778] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:11:01.453189] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-21T17:11:01.516844] [DEBUG] [LOCAL ] AMC: Loaded 53766 existing records from primary storage. [2025-10-21T17:11:01.517282] [INFO ] [MAIN ] AMC: Loaded 53766 existing records. [2025-10-21T17:11:01.758164] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-21T17:11:01.769566] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:11:01.769917] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-21T17:11:01.770098] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-21T17:11:01.770494] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-21T17:11:01.770571] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-21T17:11:02.298737] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:11:02.551162] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-21T17:11:03.351084] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-21T17:11:03.682618] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-21T17:11:04.151029] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-21T17:11:04.698928] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T17:11:04.801259] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-21T17:11:04.951036] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-21T17:11:05.605269] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T17:11:05.750994] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-21T17:11:06.508835] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T17:11:06.550989] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-21T17:11:07.109411] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T17:11:07.351028] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-21T17:11:08.151020] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-21T17:11:08.832703] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T17:11:08.912781] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-21T17:11:08.951078] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-21T17:11:09.751067] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-21T17:11:10.292574] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-21T17:11:10.372686] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T17:11:10.551055] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-21T17:11:11.351042] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-21T17:11:12.022276] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-21T17:11:12.150989] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-21T17:11:12.215843] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-21T17:11:12.735244] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T17:11:12.951065] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-21T17:11:13.751098] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-21T17:11:14.437986] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T17:11:14.444392] [INFO ] [REMOTE ] AMBC: Full fetch complete (51858 records). [2025-10-21T17:11:14.444499] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-21T17:11:14.555015] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-21T17:11:14.787109] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-21T17:11:14.908774] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-21T17:11:14.908865] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-21T17:11:14.909488] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-21T17:11:14.909531] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-21T17:11:14.910585] [DEBUG] [LOCAL ] AMBC: Trimmed 51858 records to 36048 (keeping 200 days of data) [2025-10-21T17:11:15.108454] [DEBUG] [LOCAL ] AMBC: Primary data saved (36048 records). [2025-10-21T17:11:15.108595] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-21T17:11:15.108696] [INFO ] [MAIN ] Update Progress: 95/2366 symbols completed. AMBC took 31.6s. Estimated remaining: 4h 27m 22s. Rate: 8.5 symbols/min [2025-10-21T17:11:15.296736] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:11:15.297972] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-21T17:11:15.304964] [INFO ] [REMOTE ] AMBP: Full fetch complete (65070 records). [2025-10-21T17:11:15.305124] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-21T17:11:15.360151] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-21T17:11:15.688561] [DEBUG] [LOCAL ] AMCR: Loaded 53670 existing records from primary storage. [2025-10-21T17:11:15.695357] [INFO ] [MAIN ] AMCR: Loaded 53670 existing records. [2025-10-21T17:11:15.824617] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-21T17:11:15.835768] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-21T17:11:15.836632] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-21T17:11:15.836774] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-21T17:11:15.888720] [DEBUG] [LOCAL ] AMBP: Trimmed 65070 records to 44418 (keeping 200 days of data) [2025-10-21T17:11:15.915311] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:11:15.915511] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-21T17:11:15.915564] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-21T17:11:15.915796] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-21T17:11:15.915853] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-21T17:11:16.480544] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:11:16.488916] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-21T17:11:16.537122] [DEBUG] [LOCAL ] AMBP: Primary data saved (44418 records). [2025-10-21T17:11:16.537216] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-21T17:11:16.537287] [INFO ] [MAIN ] Update Progress: 96/2366 symbols completed. AMBP took 31.4s. Estimated remaining: 4h 25m 2s. Rate: 8.6 symbols/min [2025-10-21T17:11:16.706697] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:11:16.752859] [DEBUG] [LOCAL ] AME: Loaded 48570 existing records from primary storage. [2025-10-21T17:11:16.753182] [INFO ] [MAIN ] AME: Loaded 48570 existing records. [2025-10-21T17:11:16.935669] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:11:16.935943] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-21T17:11:16.936045] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-21T17:11:16.936476] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-21T17:11:16.936546] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-21T17:11:17.028009] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-21T17:11:17.074743] [INFO ] [REMOTE ] AM: Full fetch complete (75670 records). [2025-10-21T17:11:17.092246] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-21T17:11:17.590352] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:11:17.628085] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-21T17:11:17.746846] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-21T17:11:17.747027] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-21T17:11:17.747763] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-21T17:11:17.747842] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-21T17:11:17.749476] [DEBUG] [LOCAL ] AM: Trimmed 75670 records to 51857 (keeping 200 days of data) [2025-10-21T17:11:18.096167] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-10-21T17:11:18.118975] [DEBUG] [LOCAL ] AM: Primary data saved (51857 records). [2025-10-21T17:11:18.119192] [INFO ] [MAIN ] AM: Full history saved. [2025-10-21T17:11:18.120416] [INFO ] [MAIN ] Update Progress: 97/2366 symbols completed. AM took 35.9s. Estimated remaining: 4h 22m 48s. Rate: 8.6 symbols/min [2025-10-21T17:11:18.121140] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-21T17:11:18.324845] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:11:18.327593] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T17:11:18.357668] [DEBUG] [LOCAL ] AMG: Loaded 20174 existing records from primary storage. [2025-10-21T17:11:18.357917] [INFO ] [MAIN ] AMG: Loaded 20174 existing records. [2025-10-21T17:11:18.531794] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:11:18.531995] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-21T17:11:18.532042] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-21T17:11:18.532212] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-21T17:11:18.532250] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-21T17:11:18.562699] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-21T17:11:18.885728] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:11:19.152219] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T17:11:19.350993] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-21T17:11:20.151045] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-21T17:11:20.396678] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T17:11:20.448676] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T17:11:20.563282] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-21T17:11:20.951026] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-21T17:11:21.748951] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T17:11:21.758304] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-21T17:11:22.066184] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T17:11:22.551041] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-21T17:11:23.350995] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-21T17:11:23.647315] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-21T17:11:23.779247] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-21T17:11:24.151026] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-21T17:11:24.951005] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-21T17:11:25.198925] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T17:11:25.751021] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-21T17:11:25.860205] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T17:11:26.319617] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-21T17:11:26.551040] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-21T17:11:27.345786] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T17:11:27.356155] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-21T17:11:27.663099] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-21T17:11:28.151006] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-21T17:11:28.951028] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-21T17:11:29.153481] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-21T17:11:29.746463] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-21T17:11:29.757882] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-21T17:11:30.476899] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T17:11:30.551065] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-21T17:11:31.351048] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-21T17:11:31.564428] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T17:11:32.145195] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-21T17:11:32.150968] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-21T17:11:32.796487] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-21T17:11:32.950994] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-21T17:11:33.230027] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-21T17:11:33.751084] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-21T17:11:34.551041] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-21T17:11:35.356111] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-21T17:11:35.373517] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T17:11:35.432053] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T17:11:35.609121] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-21T17:11:35.617413] [INFO ] [REMOTE ] AMC: Full fetch complete (77930 records). [2025-10-21T17:11:35.617524] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-21T17:11:36.009718] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-21T17:11:36.009818] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-21T17:11:36.010636] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-21T17:11:36.010728] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-21T17:11:36.012188] [DEBUG] [LOCAL ] AMC: Trimmed 77930 records to 53766 (keeping 200 days of data) [2025-10-21T17:11:36.169429] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-21T17:11:36.316131] [DEBUG] [LOCAL ] AMC: Primary data saved (53766 records). [2025-10-21T17:11:36.316293] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-21T17:11:36.316372] [INFO ] [MAIN ] Update Progress: 98/2366 symbols completed. AMC took 35.1s. Estimated remaining: 4h 27m 1s. Rate: 8.5 symbols/min [2025-10-21T17:11:36.482680] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:11:36.529948] [DEBUG] [LOCAL ] AMH: Loaded 51831 existing records from primary storage. [2025-10-21T17:11:36.530268] [INFO ] [MAIN ] AMH: Loaded 51831 existing records. [2025-10-21T17:11:36.712689] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:11:36.713000] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-21T17:11:36.713096] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-21T17:11:36.713531] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-21T17:11:36.713589] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-21T17:11:36.951317] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-21T17:11:37.099956] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:11:37.129978] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-21T17:11:37.751080] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-21T17:11:38.136610] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-21T17:11:38.161828] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T17:11:38.166828] [INFO ] [REMOTE ] AMG: Full fetch complete (29598 records). [2025-10-21T17:11:38.166928] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-21T17:11:38.553288] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-21T17:11:38.554327] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-21T17:11:38.554382] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-21T17:11:38.554765] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-21T17:11:38.554825] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-21T17:11:38.555699] [DEBUG] [LOCAL ] AMG: Trimmed 29598 records to 20131 (keeping 200 days of data) [2025-10-21T17:11:38.682327] [DEBUG] [LOCAL ] AMG: Primary data saved (20131 records). [2025-10-21T17:11:38.682445] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-21T17:11:38.682530] [INFO ] [MAIN ] Update Progress: 99/2366 symbols completed. AMG took 20.6s. Estimated remaining: 4h 25m 6s. Rate: 8.6 symbols/min [2025-10-21T17:11:38.848949] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:11:38.889414] [DEBUG] [LOCAL ] AMN: Loaded 41731 existing records from primary storage. [2025-10-21T17:11:38.889726] [INFO ] [MAIN ] AMN: Loaded 41731 existing records. [2025-10-21T17:11:39.065620] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:11:39.065862] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-21T17:11:39.065908] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-21T17:11:39.066109] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-21T17:11:39.066164] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-21T17:11:39.352278] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-21T17:11:39.421518] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:11:39.509629] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T17:11:39.882346] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T17:11:40.151100] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-21T17:11:40.951036] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-21T17:11:41.202524] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-21T17:11:41.751485] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-21T17:11:41.752673] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T17:11:42.403019] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T17:11:42.551032] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-21T17:11:43.351012] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-21T17:11:43.686969] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T17:11:44.151046] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-21T17:11:44.238601] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:11:44.951088] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-21T17:11:45.253916] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T17:11:45.602405] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T17:11:45.751035] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-21T17:11:46.416001] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T17:11:46.551028] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-21T17:11:47.307954] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T17:11:47.351019] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-21T17:11:48.151005] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-21T17:11:48.400957] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-21T17:11:48.408497] [INFO ] [REMOTE ] AME: Full fetch complete (70000 records). [2025-10-21T17:11:48.408636] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-21T17:11:48.808443] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-21T17:11:48.808540] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-21T17:11:48.809270] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-21T17:11:48.809350] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-21T17:11:48.810638] [DEBUG] [LOCAL ] AME: Trimmed 70000 records to 48489 (keeping 200 days of data) [2025-10-21T17:11:48.991162] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-21T17:11:49.121709] [DEBUG] [LOCAL ] AME: Primary data saved (48489 records). [2025-10-21T17:11:49.121869] [INFO ] [MAIN ] AME: Full history saved. [2025-10-21T17:11:49.121959] [INFO ] [MAIN ] Update Progress: 100/2366 symbols completed. AME took 32.6s. Estimated remaining: 4h 26m 17s. Rate: 8.5 symbols/min [2025-10-21T17:11:49.313001] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:11:49.349421] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T17:11:49.391035] [DEBUG] [LOCAL ] AMP: Loaded 31952 existing records from primary storage. [2025-10-21T17:11:49.391447] [INFO ] [MAIN ] AMP: Loaded 31952 existing records. [2025-10-21T17:11:49.579170] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:11:49.579791] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-21T17:11:49.579964] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-21T17:11:49.590846] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-21T17:11:49.607631] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-21T17:11:49.670439] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T17:11:49.756121] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-21T17:11:50.006010] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:11:50.550990] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-21T17:11:50.666462] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T17:11:51.326334] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T17:11:51.350990] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-21T17:11:52.151010] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-21T17:11:52.353895] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-21T17:11:52.800358] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T17:11:52.951069] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-21T17:11:53.767422] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-21T17:11:53.770136] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T17:11:54.541997] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T17:11:54.551122] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-21T17:11:55.301340] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T17:11:55.351084] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-21T17:11:56.151042] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-21T17:11:56.344405] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T17:11:56.353041] [INFO ] [REMOTE ] AMCR: Full fetch complete (77842 records). [2025-10-21T17:11:56.353203] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-21T17:11:56.741342] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-21T17:11:56.741513] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-21T17:11:56.742353] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-21T17:11:56.742419] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-21T17:11:56.743882] [DEBUG] [LOCAL ] AMCR: Trimmed 77842 records to 53670 (keeping 200 days of data) [2025-10-21T17:11:56.951314] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-21T17:11:57.084588] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T17:11:57.104696] [DEBUG] [LOCAL ] AMCR: Primary data saved (53670 records). [2025-10-21T17:11:57.104809] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-21T17:11:57.107514] [INFO ] [MAIN ] Update Progress: 101/2366 symbols completed. AMCR took 42.0s. Estimated remaining: 4h 26m 31s. Rate: 8.5 symbols/min [2025-10-21T17:11:57.275605] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:11:57.332299] [DEBUG] [LOCAL ] AMPX: Loaded 52385 existing records from primary storage. [2025-10-21T17:11:57.332602] [INFO ] [MAIN ] AMPX: Loaded 52385 existing records. [2025-10-21T17:11:57.514586] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:11:57.514931] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-21T17:11:57.515057] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-21T17:11:57.515357] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-21T17:11:57.515430] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-21T17:11:57.755635] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-21T17:11:57.898947] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T17:11:57.903189] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:11:58.403818] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T17:11:58.551045] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-21T17:11:59.129458] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T17:11:59.351033] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-21T17:12:00.070351] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T17:12:00.151007] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-21T17:12:00.951050] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-21T17:12:01.184259] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-21T17:12:01.751040] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-21T17:12:02.251735] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-21T17:12:02.501761] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-21T17:12:02.509439] [INFO ] [REMOTE ] AMN: Full fetch complete (59943 records). [2025-10-21T17:12:02.509606] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-21T17:12:02.510436] [FATAL] [VALIDATOR ] AMN: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:12:02.510555] [FATAL] [MAIN ] AMN: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:12:02.510630] [WARN ] [MAIN ] AMN: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:12:02.510736] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-21T17:12:02.510831] [DEBUG] [LOCAL ] AMN: No primary data file found to delete. [2025-10-21T17:12:02.510890] [INFO ] [LOCAL ] AMN: Starting deletion of derivative data. [2025-10-21T17:12:02.511075] [DEBUG] [LOCAL ] AMN: Deleted derivative data file. [2025-10-21T17:12:02.511673] [INFO ] [MAIN ] Update Progress: 102/2366 symbols completed. AMN took 23.8s. Estimated remaining: 4h 25m 47s. Rate: 8.5 symbols/min [2025-10-21T17:12:02.560300] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-21T17:12:02.706202] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:12:02.746822] [DEBUG] [LOCAL ] AMPY: Loaded 39461 existing records from primary storage. [2025-10-21T17:12:02.747156] [INFO ] [MAIN ] AMPY: Loaded 39461 existing records. [2025-10-21T17:12:02.935321] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:12:02.935627] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-21T17:12:02.935726] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-21T17:12:02.936032] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-21T17:12:02.936089] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-21T17:12:03.294575] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:12:03.361326] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-21T17:12:03.367281] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-21T17:12:03.376451] [INFO ] [REMOTE ] AMH: Full fetch complete (74703 records). [2025-10-21T17:12:03.376682] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-21T17:12:03.377804] [FATAL] [VALIDATOR ] AMH: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:12:03.377901] [FATAL] [MAIN ] AMH: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:12:03.378035] [WARN ] [MAIN ] AMH: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:12:03.378116] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-21T17:12:03.378198] [DEBUG] [LOCAL ] AMH: No primary data file found to delete. [2025-10-21T17:12:03.378288] [INFO ] [LOCAL ] AMH: Starting deletion of derivative data. [2025-10-21T17:12:03.378472] [DEBUG] [LOCAL ] AMH: Deleted derivative data file. [2025-10-21T17:12:03.378566] [INFO ] [MAIN ] Update Progress: 103/2366 symbols completed. AMH took 27.1s. Estimated remaining: 4h 23m 24s. Rate: 8.6 symbols/min [2025-10-21T17:12:03.561877] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:12:03.605610] [DEBUG] [LOCAL ] AMR: Loaded 28978 existing records from primary storage. [2025-10-21T17:12:03.606176] [INFO ] [MAIN ] AMR: Loaded 28978 existing records. [2025-10-21T17:12:03.802463] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:12:03.802839] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-21T17:12:03.802895] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-21T17:12:03.803140] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-21T17:12:03.803201] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-21T17:12:04.156205] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-21T17:12:04.189744] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:12:04.228925] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T17:12:04.951029] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-21T17:12:05.143845] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T17:12:05.210898] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T17:12:05.751031] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-21T17:12:06.550988] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-21T17:12:06.580222] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T17:12:06.642291] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T17:12:07.351148] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-21T17:12:07.798818] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T17:12:08.151029] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-21T17:12:08.951061] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-21T17:12:09.078570] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T17:12:09.589148] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-21T17:12:09.751049] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-21T17:12:10.297795] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T17:12:10.551035] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-21T17:12:11.351000] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-21T17:12:11.766980] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-21T17:12:11.915723] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T17:12:12.151027] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-21T17:12:12.740914] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T17:12:12.951024] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-21T17:12:13.751092] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-21T17:12:14.165286] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T17:12:14.292882] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-21T17:12:14.551067] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-21T17:12:15.191832] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T17:12:15.351022] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-21T17:12:15.668331] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-21T17:12:16.151032] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-21T17:12:16.750785] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-21T17:12:16.951092] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-21T17:12:17.606354] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T17:12:17.751041] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-21T17:12:18.235410] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T17:12:18.551036] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-21T17:12:19.183786] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T17:12:19.351031] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-21T17:12:20.076242] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T17:12:20.151009] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-21T17:12:20.951029] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-21T17:12:21.150839] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T17:12:21.516024] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T17:12:21.521286] [INFO ] [REMOTE ] AMP: Full fetch complete (47577 records). [2025-10-21T17:12:21.521399] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-21T17:12:21.756203] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-21T17:12:21.902345] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-21T17:12:21.902441] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-21T17:12:21.903016] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-21T17:12:21.903081] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-21T17:12:21.904190] [DEBUG] [LOCAL ] AMP: Trimmed 47577 records to 31914 (keeping 200 days of data) [2025-10-21T17:12:22.101786] [DEBUG] [LOCAL ] AMP: Primary data saved (31914 records). [2025-10-21T17:12:22.102104] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-21T17:12:22.102203] [INFO ] [MAIN ] Update Progress: 104/2366 symbols completed. AMP took 33.0s. Estimated remaining: 4h 27m 33s. Rate: 8.5 symbols/min [2025-10-21T17:12:22.294721] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-21T17:12:22.296971] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:12:22.342593] [DEBUG] [LOCAL ] AMRC: Loaded 38558 existing records from primary storage. [2025-10-21T17:12:22.342904] [INFO ] [MAIN ] AMRC: Loaded 38558 existing records. [2025-10-21T17:12:22.515061] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:12:22.515293] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-21T17:12:22.515340] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-21T17:12:22.515514] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-21T17:12:22.515552] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-21T17:12:22.556691] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-21T17:12:22.866077] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:12:23.351078] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-21T17:12:23.658433] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-21T17:12:24.161103] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-21T17:12:24.183253] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-21T17:12:24.588160] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T17:12:24.951064] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-21T17:12:25.294279] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T17:12:25.751075] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-21T17:12:26.551019] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-21T17:12:26.881942] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-21T17:12:27.017702] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T17:12:27.350997] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-21T17:12:28.151014] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-21T17:12:28.444546] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T17:12:28.453085] [INFO ] [REMOTE ] AMPY: Full fetch complete (53227 records). [2025-10-21T17:12:28.453316] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-21T17:12:28.878104] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-21T17:12:28.878297] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-21T17:12:28.879037] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-21T17:12:28.879177] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-21T17:12:28.880514] [DEBUG] [LOCAL ] AMPY: Trimmed 53227 records to 39389 (keeping 200 days of data) [2025-10-21T17:12:28.958773] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-21T17:12:28.996241] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T17:12:29.133295] [DEBUG] [LOCAL ] AMPY: Primary data saved (39389 records). [2025-10-21T17:12:29.133437] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-21T17:12:29.134087] [INFO ] [MAIN ] Update Progress: 105/2366 symbols completed. AMPY took 26.6s. Estimated remaining: 4h 27m 24s. Rate: 8.5 symbols/min [2025-10-21T17:12:29.304012] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:12:29.304223] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-21T17:12:29.304267] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-21T17:12:29.304369] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-21T17:12:29.304410] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-21T17:12:29.304449] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-21T17:12:29.304480] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-21T17:12:29.677263] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T17:12:29.711172] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:12:29.750990] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-21T17:12:30.551038] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-10-21T17:12:30.828414] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-21T17:12:31.145790] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:12:31.146164] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-10-21T17:12:31.146256] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:12:31.146303] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-21T17:12:31.146339] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:12:31.146403] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-21T17:12:31.146470] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-21T17:12:31.146508] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-21T17:12:31.146548] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-21T17:12:31.146598] [INFO ] [MAIN ] Update Progress: 106/2366 symbols completed. AMRZ took 2.0s. Estimated remaining: 4h 25m 29s. Rate: 8.5 symbols/min [2025-10-21T17:12:31.354177] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-21T17:12:31.359889] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:12:31.385294] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-21T17:12:31.448034] [DEBUG] [LOCAL ] AMT: Loaded 52454 existing records from primary storage. [2025-10-21T17:12:31.448381] [INFO ] [MAIN ] AMT: Loaded 52454 existing records. [2025-10-21T17:12:31.638561] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:12:31.638801] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-21T17:12:31.638852] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-21T17:12:31.639239] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-21T17:12:31.639296] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-21T17:12:31.992417] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:12:32.151031] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-21T17:12:32.718335] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T17:12:32.951080] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-21T17:12:33.751070] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-21T17:12:33.980222] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-21T17:12:34.373179] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T17:12:34.551073] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-21T17:12:35.122988] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-21T17:12:35.351084] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-21T17:12:35.705832] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-21T17:12:36.151042] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-21T17:12:36.772271] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T17:12:36.951074] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-21T17:12:37.485849] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T17:12:37.490344] [INFO ] [REMOTE ] AMR: Full fetch complete (40705 records). [2025-10-21T17:12:37.490446] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-21T17:12:37.756134] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-21T17:12:37.867292] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-21T17:12:37.867368] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-21T17:12:37.867841] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-21T17:12:37.867904] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-21T17:12:37.868808] [DEBUG] [LOCAL ] AMR: Trimmed 40705 records to 28870 (keeping 200 days of data) [2025-10-21T17:12:38.036937] [DEBUG] [LOCAL ] AMR: Primary data saved (28870 records). [2025-10-21T17:12:38.037060] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-21T17:12:38.037137] [INFO ] [MAIN ] Update Progress: 107/2366 symbols completed. AMR took 34.7s. Estimated remaining: 4h 25m 18s. Rate: 8.5 symbols/min [2025-10-21T17:12:38.207245] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:12:38.228288] [DEBUG] [LOCAL ] AMTB: Loaded 20539 existing records from primary storage. [2025-10-21T17:12:38.228529] [INFO ] [MAIN ] AMTB: Loaded 20539 existing records. [2025-10-21T17:12:38.411076] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:12:38.411563] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-21T17:12:38.411616] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-21T17:12:38.411938] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-21T17:12:38.411994] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-21T17:12:38.559791] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-21T17:12:38.765707] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:12:39.351006] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-21T17:12:39.483251] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.53 seconds). [2025-10-21T17:12:39.493270] [INFO ] [REMOTE ] AMPX: Full fetch complete (75235 records). [2025-10-21T17:12:39.493454] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-21T17:12:39.632719] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-21T17:12:39.938337] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-21T17:12:39.938483] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-21T17:12:39.939297] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-21T17:12:39.939402] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-21T17:12:39.940876] [DEBUG] [LOCAL ] AMPX: Trimmed 75235 records to 52398 (keeping 200 days of data) [2025-10-21T17:12:40.151095] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T17:12:40.151395] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-21T17:12:40.260426] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T17:12:40.285193] [DEBUG] [LOCAL ] AMPX: Primary data saved (52398 records). [2025-10-21T17:12:40.285293] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-21T17:12:40.285362] [INFO ] [MAIN ] Update Progress: 108/2366 symbols completed. AMPX took 43.2s. Estimated remaining: 4h 23m 31s. Rate: 8.6 symbols/min [2025-10-21T17:12:40.459352] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:12:40.464337] [DEBUG] [LOCAL ] AMTD: Loaded 3824 existing records from primary storage. [2025-10-21T17:12:40.464479] [INFO ] [MAIN ] AMTD: Loaded 3824 existing records. [2025-10-21T17:12:40.637971] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:12:40.638169] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-21T17:12:40.638216] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-21T17:12:40.638406] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-21T17:12:40.638461] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-21T17:12:40.956091] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-21T17:12:40.992132] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:12:41.754273] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-21T17:12:41.768130] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T17:12:41.835136] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T17:12:42.447124] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-21T17:12:42.550992] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-21T17:12:43.164386] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T17:12:43.350990] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-21T17:12:44.151060] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-21T17:12:44.951033] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-21T17:12:45.304313] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T17:12:45.651999] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-21T17:12:45.751036] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-21T17:12:45.812106] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T17:12:46.224285] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-21T17:12:46.551023] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-21T17:12:47.351000] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-21T17:12:47.641254] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-21T17:12:48.151045] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-21T17:12:48.649044] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-21T17:12:48.927952] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T17:12:48.951049] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-21T17:12:49.751062] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-21T17:12:50.210447] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-21T17:12:50.534362] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T17:12:50.550977] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-21T17:12:51.351027] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-21T17:12:52.140375] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-21T17:12:52.147402] [INFO ] [REMOTE ] AMRC: Full fetch complete (54532 records). [2025-10-21T17:12:52.147546] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-21T17:12:52.159691] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-21T17:12:52.551946] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-21T17:12:52.552490] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-21T17:12:52.552959] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T17:12:52.558060] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-21T17:12:52.558440] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-21T17:12:52.559469] [DEBUG] [LOCAL ] AMRC: Trimmed 54532 records to 38589 (keeping 200 days of data) [2025-10-21T17:12:52.773975] [DEBUG] [LOCAL ] AMRC: Primary data saved (38589 records). [2025-10-21T17:12:52.774107] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-21T17:12:52.774185] [INFO ] [MAIN ] Update Progress: 109/2366 symbols completed. AMRC took 30.7s. Estimated remaining: 4h 25m 18s. Rate: 8.5 symbols/min [2025-10-21T17:12:52.964668] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-21T17:12:52.967136] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:12:53.011966] [DEBUG] [LOCAL ] AMTM: Loaded 50401 existing records from primary storage. [2025-10-21T17:12:53.012265] [INFO ] [MAIN ] AMTM: Loaded 50401 existing records. [2025-10-21T17:12:53.186969] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:12:53.187316] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-21T17:12:53.187448] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-21T17:12:53.188035] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-21T17:12:53.188094] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-21T17:12:53.545198] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:12:53.751019] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-21T17:12:53.804977] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T17:12:53.834533] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-21T17:12:54.511823] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-21T17:12:54.551059] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-21T17:12:55.351139] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-21T17:12:55.785064] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-21T17:12:56.151104] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-21T17:12:56.719777] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-21T17:12:56.951050] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-21T17:12:57.153790] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T17:12:57.398955] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-21T17:12:57.751112] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-21T17:12:58.551040] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-21T17:12:59.178044] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-21T17:12:59.351042] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-21T17:12:59.731434] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-21T17:12:59.971418] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-21T17:12:59.972691] [INFO ] [REMOTE ] AMTD: Full fetch complete (5444 records). [2025-10-21T17:12:59.972758] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-21T17:13:00.156133] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-21T17:13:00.349915] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-21T17:13:00.349992] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-21T17:13:00.350159] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-21T17:13:00.350198] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-21T17:13:00.350562] [DEBUG] [LOCAL ] AMTD: Trimmed 5444 records to 3827 (keeping 200 days of data) [2025-10-21T17:13:00.371710] [DEBUG] [LOCAL ] AMTD: Primary data saved (3827 records). [2025-10-21T17:13:00.371798] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-21T17:13:00.371873] [INFO ] [MAIN ] Update Progress: 110/2366 symbols completed. AMTD took 20.1s. Estimated remaining: 4h 25m 22s. Rate: 8.5 symbols/min [2025-10-21T17:13:00.544372] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:13:00.555280] [DEBUG] [LOCAL ] AMWL: Loaded 9705 existing records from primary storage. [2025-10-21T17:13:00.555465] [INFO ] [MAIN ] AMWL: Loaded 9705 existing records. [2025-10-21T17:13:00.739554] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:13:00.739803] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-21T17:13:00.739853] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-21T17:13:00.740014] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-21T17:13:00.740079] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-21T17:13:00.959270] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-21T17:13:01.116205] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:13:01.751038] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-21T17:13:02.061616] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T17:13:02.551047] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-21T17:13:02.917787] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-21T17:13:03.041112] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T17:13:03.253886] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-21T17:13:03.350986] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-21T17:13:04.151050] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-21T17:13:04.272223] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T17:13:04.951087] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-21T17:13:05.751018] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-21T17:13:05.879750] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-21T17:13:06.003035] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T17:13:06.551021] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-21T17:13:07.350993] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-21T17:13:07.633695] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T17:13:07.662755] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T17:13:07.666564] [INFO ] [REMOTE ] AMTB: Full fetch complete (29621 records). [2025-10-21T17:13:07.666731] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-21T17:13:08.048157] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-21T17:13:08.048269] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-21T17:13:08.048772] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-21T17:13:08.048836] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-21T17:13:08.049556] [DEBUG] [LOCAL ] AMTB: Trimmed 29621 records to 20430 (keeping 200 days of data) [2025-10-21T17:13:08.160815] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-21T17:13:08.170122] [DEBUG] [LOCAL ] AMTB: Primary data saved (20430 records). [2025-10-21T17:13:08.170247] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-21T17:13:08.170327] [INFO ] [MAIN ] Update Progress: 111/2366 symbols completed. AMTB took 30.1s. Estimated remaining: 4h 25m 30s. Rate: 8.5 symbols/min [2025-10-21T17:13:08.342086] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:13:08.386716] [DEBUG] [LOCAL ] AMX: Loaded 49207 existing records from primary storage. [2025-10-21T17:13:08.387062] [INFO ] [MAIN ] AMX: Loaded 49207 existing records. [2025-10-21T17:13:08.567129] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:13:08.567336] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-21T17:13:08.567385] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-21T17:13:08.567707] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-21T17:13:08.567766] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-21T17:13:08.927086] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:13:08.950981] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-21T17:13:09.019437] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T17:13:09.260191] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-21T17:13:09.751072] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-21T17:13:10.495931] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-21T17:13:10.550984] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-21T17:13:10.584374] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T17:13:11.351040] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-21T17:13:11.394025] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-21T17:13:12.151081] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-21T17:13:12.951055] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-21T17:13:13.139595] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T17:13:13.751028] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-21T17:13:14.284195] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-21T17:13:14.292426] [INFO ] [REMOTE ] AMT: Full fetch complete (76176 records). [2025-10-21T17:13:14.292565] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-21T17:13:14.558383] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-21T17:13:14.700234] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-21T17:13:14.700336] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-21T17:13:14.701203] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-21T17:13:14.701289] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-21T17:13:14.725604] [DEBUG] [LOCAL ] AMT: Trimmed 76176 records to 52448 (keeping 200 days of data) [2025-10-21T17:13:14.726463] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T17:13:15.089898] [DEBUG] [LOCAL ] AMT: Primary data saved (52448 records). [2025-10-21T17:13:15.090027] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-21T17:13:15.090929] [INFO ] [MAIN ] Update Progress: 112/2366 symbols completed. AMT took 43.9s. Estimated remaining: 4h 25m 20s. Rate: 8.5 symbols/min [2025-10-21T17:13:15.274278] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:13:15.306730] [DEBUG] [LOCAL ] AN: Loaded 31264 existing records from primary storage. [2025-10-21T17:13:15.306996] [INFO ] [MAIN ] AN: Loaded 31264 existing records. [2025-10-21T17:13:15.352918] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-21T17:13:15.425427] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-21T17:13:15.507904] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:13:15.508324] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-21T17:13:15.508521] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-21T17:13:15.508920] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-21T17:13:15.509135] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-21T17:13:15.762344] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T17:13:15.906738] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:13:16.150986] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-21T17:13:16.951087] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-21T17:13:17.016798] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T17:13:17.478165] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T17:13:17.751010] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-21T17:13:18.551011] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-21T17:13:18.802720] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-21T17:13:19.029550] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T17:13:19.130966] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T17:13:19.351024] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-21T17:13:20.109750] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T17:13:20.150978] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-21T17:13:20.896550] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-21T17:13:20.951018] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-21T17:13:21.751023] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-21T17:13:21.952855] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-21T17:13:21.955797] [INFO ] [REMOTE ] AMWL: Full fetch complete (14693 records). [2025-10-21T17:13:21.955864] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-21T17:13:22.321834] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-21T17:13:22.321910] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-21T17:13:22.322194] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-21T17:13:22.322234] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-21T17:13:22.322729] [DEBUG] [LOCAL ] AMWL: Trimmed 14693 records to 9764 (keeping 200 days of data) [2025-10-21T17:13:22.375214] [DEBUG] [LOCAL ] AMWL: Primary data saved (9764 records). [2025-10-21T17:13:22.375335] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-21T17:13:22.375423] [INFO ] [MAIN ] Update Progress: 113/2366 symbols completed. AMWL took 22.0s. Estimated remaining: 4h 25m 17s. Rate: 8.5 symbols/min [2025-10-21T17:13:22.545145] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:13:22.550985] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-21T17:13:22.596419] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-21T17:13:22.596742] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-10-21T17:13:22.770988] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:13:22.771195] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-21T17:13:22.771265] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-21T17:13:22.771589] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-21T17:13:22.771634] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-21T17:13:23.119376] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:13:23.350992] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-21T17:13:23.657914] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T17:13:24.150997] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-21T17:13:24.261403] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T17:13:24.840242] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T17:13:24.951010] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-21T17:13:25.405876] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T17:13:25.751015] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-21T17:13:26.550991] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-21T17:13:26.826857] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T17:13:27.309241] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T17:13:27.351014] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-21T17:13:28.151015] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-21T17:13:28.209362] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T17:13:28.951067] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-21T17:13:29.295237] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T17:13:29.756802] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-21T17:13:29.788502] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T17:13:30.144446] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T17:13:30.551039] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-21T17:13:31.351016] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-21T17:13:31.490261] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T17:13:31.499138] [INFO ] [REMOTE ] AMTM: Full fetch complete (73658 records). [2025-10-21T17:13:31.499302] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-21T17:13:31.848822] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T17:13:31.938304] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-21T17:13:31.938396] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-21T17:13:31.939160] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-21T17:13:31.939228] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-21T17:13:31.940618] [DEBUG] [LOCAL ] AMTM: Trimmed 73658 records to 50302 (keeping 200 days of data) [2025-10-21T17:13:32.152206] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-21T17:13:32.238795] [DEBUG] [LOCAL ] AMTM: Primary data saved (50302 records). [2025-10-21T17:13:32.238937] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-21T17:13:32.239032] [INFO ] [MAIN ] Update Progress: 114/2366 symbols completed. AMTM took 39.5s. Estimated remaining: 4h 26m 5s. Rate: 8.5 symbols/min [2025-10-21T17:13:32.410782] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:13:32.458788] [DEBUG] [LOCAL ] ANF: Loaded 52054 existing records from primary storage. [2025-10-21T17:13:32.459087] [INFO ] [MAIN ] ANF: Loaded 52054 existing records. [2025-10-21T17:13:32.643696] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:13:32.643929] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-21T17:13:32.643979] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-21T17:13:32.644365] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-21T17:13:32.644404] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-21T17:13:32.951214] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-21T17:13:33.026788] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:13:33.058298] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T17:13:33.751019] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-21T17:13:34.509168] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-21T17:13:34.523075] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T17:13:34.550983] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-21T17:13:35.351057] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-21T17:13:35.573130] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T17:13:35.836781] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T17:13:36.151048] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-21T17:13:36.951093] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-21T17:13:37.323576] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-21T17:13:37.751027] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-21T17:13:38.099347] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-21T17:13:38.107271] [INFO ] [REMOTE ] AMX: Full fetch complete (71041 records). [2025-10-21T17:13:38.107402] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-21T17:13:38.535999] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-21T17:13:38.535815] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T17:13:38.536274] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-21T17:13:38.546551] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-21T17:13:38.546680] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-21T17:13:38.548913] [DEBUG] [LOCAL ] AMX: Trimmed 71041 records to 49203 (keeping 200 days of data) [2025-10-21T17:13:38.601792] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-21T17:13:38.837197] [DEBUG] [LOCAL ] AMX: Primary data saved (49203 records). [2025-10-21T17:13:38.837325] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-21T17:13:38.837399] [INFO ] [MAIN ] Update Progress: 115/2366 symbols completed. AMX took 30.7s. Estimated remaining: 4h 25m 49s. Rate: 8.5 symbols/min [2025-10-21T17:13:39.010479] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:13:39.010710] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-21T17:13:39.010764] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-21T17:13:39.010881] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-21T17:13:39.010933] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-21T17:13:39.010976] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-21T17:13:39.011031] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-21T17:13:39.363245] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-21T17:13:39.369117] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:13:39.466573] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-21T17:13:39.972855] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T17:13:39.977514] [INFO ] [REMOTE ] AN: Full fetch complete (47080 records). [2025-10-21T17:13:39.977596] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-21T17:13:40.152325] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-21T17:13:40.355359] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-21T17:13:40.355440] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-21T17:13:40.355956] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-21T17:13:40.356020] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-21T17:13:40.357017] [DEBUG] [LOCAL ] AN: Trimmed 47080 records to 31126 (keeping 200 days of data) [2025-10-21T17:13:40.535498] [DEBUG] [LOCAL ] AN: Primary data saved (31126 records). [2025-10-21T17:13:40.535637] [INFO ] [MAIN ] AN: Full history saved. [2025-10-21T17:13:40.536339] [INFO ] [MAIN ] Update Progress: 116/2366 symbols completed. AN took 25.4s. Estimated remaining: 4h 23m 57s. Rate: 8.5 symbols/min [2025-10-21T17:13:40.707491] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:13:40.726912] [DEBUG] [LOCAL ] ANRO: Loaded 19540 existing records from primary storage. [2025-10-21T17:13:40.727174] [INFO ] [MAIN ] ANRO: Loaded 19540 existing records. [2025-10-21T17:13:40.898952] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:13:40.899174] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-21T17:13:40.899220] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-21T17:13:40.899427] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-21T17:13:40.899466] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-21T17:13:40.964356] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-10-21T17:13:41.215713] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:13:41.275170] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-10-21T17:13:41.280572] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:13:41.280398] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:13:41.281317] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-21T17:13:41.281399] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:13:41.281469] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-21T17:13:41.281533] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-21T17:13:41.281568] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-21T17:13:41.281606] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-21T17:13:41.281679] [INFO ] [MAIN ] Update Progress: 117/2366 symbols completed. ANGX took 2.4s. Estimated remaining: 4h 21m 49s. Rate: 8.6 symbols/min [2025-10-21T17:13:41.730131] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-21T17:13:41.750987] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-21T17:13:41.846388] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:13:42.551021] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-21T17:13:43.351078] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-21T17:13:43.535470] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-21T17:13:44.020700] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-21T17:13:44.151031] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-21T17:13:44.951074] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-21T17:13:45.277396] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T17:13:45.751079] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-21T17:13:45.995166] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-21T17:13:46.551039] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-21T17:13:46.696371] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-21T17:13:47.351016] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-21T17:13:47.448068] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T17:13:47.892183] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T17:13:48.151058] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-21T17:13:48.951028] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-21T17:13:49.447710] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-21T17:13:49.592624] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-21T17:13:49.751008] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-21T17:13:50.551007] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-21T17:13:50.751863] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T17:13:50.795743] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T17:13:51.351024] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-21T17:13:52.151026] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-21T17:13:52.743953] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-21T17:13:52.853407] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T17:13:52.951022] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-21T17:13:53.323975] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T17:13:53.751003] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-21T17:13:54.551007] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-21T17:13:54.809589] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-21T17:13:55.086429] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-21T17:13:55.351078] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-21T17:13:56.151135] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-21T17:13:56.337038] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T17:13:56.951006] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-21T17:13:57.076357] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-21T17:13:57.540139] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-21T17:13:57.751076] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-21T17:13:58.551051] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-21T17:13:58.871349] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-21T17:13:59.351065] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-21T17:13:59.412622] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-21T17:14:00.087808] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-21T17:14:00.151013] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-21T17:14:00.951048] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-21T17:14:01.181095] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T17:14:01.189426] [INFO ] [REMOTE ] ANF: Full fetch complete (75796 records). [2025-10-21T17:14:01.189581] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-21T17:14:01.620194] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-21T17:14:01.620424] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-21T17:14:01.621390] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-21T17:14:01.626873] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-21T17:14:01.637282] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T17:14:01.643373] [INFO ] [REMOTE ] ANRO: Full fetch complete (30190 records). [2025-10-21T17:14:01.643711] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-21T17:14:01.643954] [DEBUG] [LOCAL ] ANF: Trimmed 75796 records to 52051 (keeping 200 days of data) [2025-10-21T17:14:02.086016] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T17:14:02.252869] [INFO ] [REMOTE ] ANET: Full fetch complete (77945 records). [2025-10-21T17:14:02.270370] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-21T17:14:02.421847] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-21T17:14:02.422337] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-21T17:14:02.429149] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-21T17:14:02.449684] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-21T17:14:02.498856] [DEBUG] [LOCAL ] ANRO: Trimmed 30190 records to 19651 (keeping 200 days of data) [2025-10-21T17:14:02.888535] [DEBUG] [LOCAL ] ANRO: Primary data saved (19651 records). [2025-10-21T17:14:02.894552] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-21T17:14:02.928993] [INFO ] [MAIN ] Update Progress: 118/2366 symbols completed. ANRO took 22.4s. Estimated remaining: 4h 26m 21s. Rate: 8.4 symbols/min [2025-10-21T17:14:03.051001] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-21T17:14:03.051667] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-21T17:14:03.053393] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-21T17:14:03.053482] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-21T17:14:03.061605] [DEBUG] [LOCAL ] ANF: Primary data saved (52051 records). [2025-10-21T17:14:03.062024] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-21T17:14:03.062130] [INFO ] [MAIN ] Update Progress: 119/2366 symbols completed. ANF took 30.8s. Estimated remaining: 4h 24m 3s. Rate: 8.5 symbols/min [2025-10-21T17:14:03.062334] [DEBUG] [LOCAL ] ANET: Trimmed 77945 records to 53766 (keeping 200 days of data) [2025-10-21T17:14:03.380632] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-10-21T17:14:03.380816] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-21T17:14:03.380902] [INFO ] [MAIN ] Update Progress: 120/2366 symbols completed. ANET took 41.0s. Estimated remaining: 4h 21m 49s. Rate: 8.6 symbols/min [2025-10-21T17:14:04.043543] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:04.205068] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:04.204097] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:04.205533] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-21T17:14:04.235121] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-21T17:14:04.234980] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:04.235580] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-21T17:14:04.236193] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-21T17:14:04.243369] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-21T17:14:04.243501] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-21T17:14:04.348977] [DEBUG] [LOCAL ] ANVS: Loaded 24001 existing records from primary storage. [2025-10-21T17:14:04.373298] [INFO ] [MAIN ] ANVS: Loaded 24001 existing records. [2025-10-21T17:14:04.386161] [DEBUG] [LOCAL ] AOMR: Loaded 16433 existing records from primary storage. [2025-10-21T17:14:04.402790] [INFO ] [MAIN ] AOMR: Loaded 16433 existing records. [2025-10-21T17:14:04.529441] [DEBUG] [LOCAL ] AOD: Loaded 30963 existing records from primary storage. [2025-10-21T17:14:04.667865] [INFO ] [MAIN ] AOD: Loaded 30963 existing records. [2025-10-21T17:14:05.110946] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:14:05.191089] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:14:05.203009] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-21T17:14:05.234417] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-21T17:14:05.234210] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-21T17:14:05.248613] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-21T17:14:05.293299] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:05.297267] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-10-21T17:14:05.313552] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-21T17:14:05.287265] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-21T17:14:05.321289] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-21T17:14:05.321430] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-21T17:14:05.321126] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:14:05.369206] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-21T17:14:05.410119] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-21T17:14:05.445963] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-21T17:14:05.496061] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-21T17:14:05.615558] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:14:05.657915] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-10-21T17:14:05.777225] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:14:05.851223] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-21T17:14:05.861783] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:14:05.875834] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-21T17:14:06.033407] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-21T17:14:06.116992] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-21T17:14:06.190440] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-21T17:14:06.238287] [INFO ] [MAIN ] Update Progress: 121/2366 symbols completed. AOMD took 2.9s. Estimated remaining: 4h 20m 26s. Rate: 8.6 symbols/min [2025-10-21T17:14:06.547598] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:06.594802] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-21T17:14:06.638693] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:06.711602] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-21T17:14:06.736914] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:06.790139] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:06.790973] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-21T17:14:06.832836] [DEBUG] [LOCAL ] AON: Loaded 45175 existing records from primary storage. [2025-10-21T17:14:06.833216] [INFO ] [MAIN ] AON: Loaded 45175 existing records. [2025-10-21T17:14:07.008862] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:14:07.009044] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-21T17:14:07.009095] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-21T17:14:07.009274] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-21T17:14:07.009313] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-21T17:14:07.361566] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:07.361942] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-21T17:14:07.585146] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T17:14:07.587796] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-21T17:14:08.121710] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T17:14:08.127426] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-21T17:14:08.231070] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T17:14:08.238492] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-21T17:14:08.555977] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T17:14:08.560167] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-21T17:14:09.060228] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T17:14:09.066222] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-21T17:14:09.108891] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-21T17:14:09.155841] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-21T17:14:09.587215] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T17:14:09.751034] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-21T17:14:09.999842] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-21T17:14:10.551073] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-21T17:14:10.870550] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T17:14:11.351039] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-21T17:14:12.151017] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-21T17:14:12.187153] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T17:14:12.415047] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-21T17:14:12.950992] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-21T17:14:12.977626] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-21T17:14:13.751023] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-21T17:14:14.551001] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-21T17:14:14.884619] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-21T17:14:14.962273] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T17:14:15.351009] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-21T17:14:15.882673] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T17:14:16.151013] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-21T17:14:16.951045] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-21T17:14:17.179736] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T17:14:17.270464] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-21T17:14:17.677251] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T17:14:17.750979] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-21T17:14:18.551010] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-21T17:14:18.657557] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-21T17:14:19.351023] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-21T17:14:19.891793] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T17:14:20.151017] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-21T17:14:20.823730] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-21T17:14:20.823415] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T17:14:20.950998] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-21T17:14:21.751062] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-21T17:14:22.171768] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-21T17:14:22.550995] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-21T17:14:22.742699] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T17:14:23.351019] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-21T17:14:23.872503] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T17:14:24.151002] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-21T17:14:24.291735] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-21T17:14:24.910572] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-21T17:14:24.950990] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-21T17:14:25.751005] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-21T17:14:25.883056] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T17:14:25.885321] [INFO ] [REMOTE ] AOMR: Full fetch complete (23183 records). [2025-10-21T17:14:25.885392] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-21T17:14:26.259924] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-21T17:14:26.260020] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-21T17:14:26.260383] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-21T17:14:26.260456] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-21T17:14:26.261118] [DEBUG] [LOCAL ] AOMR: Trimmed 23183 records to 16383 (keeping 200 days of data) [2025-10-21T17:14:26.354257] [DEBUG] [LOCAL ] AOMR: Primary data saved (16383 records). [2025-10-21T17:14:26.354417] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-21T17:14:26.354504] [INFO ] [MAIN ] Update Progress: 122/2366 symbols completed. AOMR took 23.0s. Estimated remaining: 4h 24m 21s. Rate: 8.5 symbols/min [2025-10-21T17:14:26.524761] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:26.550850] [DEBUG] [LOCAL ] AORT: Loaded 28981 existing records from primary storage. [2025-10-21T17:14:26.550983] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-21T17:14:26.551315] [INFO ] [MAIN ] AORT: Loaded 28981 existing records. [2025-10-21T17:14:26.739974] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:14:26.740174] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-21T17:14:26.740222] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-21T17:14:26.740396] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-21T17:14:26.740434] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-21T17:14:27.023531] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T17:14:27.140002] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:27.351003] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-21T17:14:27.527746] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-21T17:14:28.151009] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-21T17:14:28.488559] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T17:14:28.951017] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-21T17:14:29.751030] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-21T17:14:29.832610] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T17:14:30.382232] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T17:14:30.387593] [INFO ] [REMOTE ] ANVS: Full fetch complete (36880 records). [2025-10-21T17:14:30.387726] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-21T17:14:30.562993] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-21T17:14:30.770492] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-21T17:14:30.770568] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-21T17:14:30.771042] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-21T17:14:30.771106] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-21T17:14:30.771904] [DEBUG] [LOCAL ] ANVS: Trimmed 36880 records to 23984 (keeping 200 days of data) [2025-10-21T17:14:30.903470] [DEBUG] [LOCAL ] ANVS: Primary data saved (23984 records). [2025-10-21T17:14:30.903597] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-21T17:14:30.903693] [INFO ] [MAIN ] Update Progress: 123/2366 symbols completed. ANVS took 27.5s. Estimated remaining: 4h 23m 28s. Rate: 8.5 symbols/min [2025-10-21T17:14:31.077072] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:31.093948] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T17:14:31.140768] [DEBUG] [LOCAL ] AOS: Loaded 48689 existing records from primary storage. [2025-10-21T17:14:31.141083] [INFO ] [MAIN ] AOS: Loaded 48689 existing records. [2025-10-21T17:14:31.319242] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:14:31.319437] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-21T17:14:31.319483] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-21T17:14:31.319726] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-21T17:14:31.319782] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-21T17:14:31.356143] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-21T17:14:31.670775] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:31.862028] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T17:14:32.151021] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-21T17:14:32.601321] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T17:14:32.951048] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-21T17:14:33.625612] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T17:14:33.751093] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-21T17:14:34.258047] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T17:14:34.551052] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-21T17:14:35.094580] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-21T17:14:35.351031] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-21T17:14:35.992107] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-21T17:14:36.151023] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-21T17:14:36.951002] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-21T17:14:37.192369] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T17:14:37.407532] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-21T17:14:37.751072] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-21T17:14:38.551027] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-21T17:14:38.742239] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T17:14:39.184768] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T17:14:39.351010] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-21T17:14:39.801454] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T17:14:40.151035] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-21T17:14:40.755145] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T17:14:40.951003] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-21T17:14:41.501590] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T17:14:41.751029] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-21T17:14:42.550998] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-21T17:14:42.629601] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T17:14:43.351016] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-21T17:14:43.447525] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T17:14:44.151048] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-21T17:14:44.258146] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T17:14:44.263698] [INFO ] [REMOTE ] AOD: Full fetch complete (44843 records). [2025-10-21T17:14:44.263803] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-21T17:14:44.652079] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-21T17:14:44.652154] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-21T17:14:44.652721] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-21T17:14:44.652784] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-21T17:14:44.653741] [DEBUG] [LOCAL ] AOD: Trimmed 44843 records to 30971 (keeping 200 days of data) [2025-10-21T17:14:44.834750] [DEBUG] [LOCAL ] AOD: Primary data saved (30971 records). [2025-10-21T17:14:44.834937] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-21T17:14:44.835038] [INFO ] [MAIN ] Update Progress: 124/2366 symbols completed. AOD took 41.4s. Estimated remaining: 4h 25m 25s. Rate: 8.4 symbols/min [2025-10-21T17:14:44.960215] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-21T17:14:45.010569] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:45.032859] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T17:14:45.043464] [DEBUG] [LOCAL ] AP: Loaded 7408 existing records from primary storage. [2025-10-21T17:14:45.043962] [INFO ] [MAIN ] AP: Loaded 7408 existing records. [2025-10-21T17:14:45.228956] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:14:45.229173] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-21T17:14:45.229219] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-21T17:14:45.229386] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-21T17:14:45.229442] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-21T17:14:45.607282] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:45.755517] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-21T17:14:45.757964] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T17:14:46.550995] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-21T17:14:46.609762] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T17:14:46.616380] [INFO ] [REMOTE ] AON: Full fetch complete (65119 records). [2025-10-21T17:14:46.616496] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-21T17:14:47.002890] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-21T17:14:47.002967] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-21T17:14:47.003604] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-21T17:14:47.003666] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-21T17:14:47.004920] [DEBUG] [LOCAL ] AON: Trimmed 65119 records to 45103 (keeping 200 days of data) [2025-10-21T17:14:47.123215] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T17:14:47.130170] [INFO ] [REMOTE ] AORT: Full fetch complete (42368 records). [2025-10-21T17:14:47.131851] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-21T17:14:47.353961] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-21T17:14:47.702702] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-21T17:14:47.708393] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-21T17:14:47.709393] [DEBUG] [LOCAL ] AON: Primary data saved (45103 records). [2025-10-21T17:14:47.709995] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-21T17:14:47.710094] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-21T17:14:47.710210] [INFO ] [MAIN ] AON: Full history saved. [2025-10-21T17:14:47.710350] [INFO ] [MAIN ] Update Progress: 125/2366 symbols completed. AON took 41.4s. Estimated remaining: 4h 24m 2s. Rate: 8.5 symbols/min [2025-10-21T17:14:47.814971] [DEBUG] [LOCAL ] AORT: Trimmed 42368 records to 28922 (keeping 200 days of data) [2025-10-21T17:14:47.943533] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:48.086615] [DEBUG] [LOCAL ] AORT: Primary data saved (28922 records). [2025-10-21T17:14:48.087062] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-21T17:14:48.087232] [INFO ] [MAIN ] Update Progress: 126/2366 symbols completed. AORT took 21.7s. Estimated remaining: 4h 21m 56s. Rate: 8.6 symbols/min [2025-10-21T17:14:48.151269] [DEBUG] [LOCAL ] APAM: Loaded 36007 existing records from primary storage. [2025-10-21T17:14:48.179527] [INFO ] [MAIN ] APAM: Loaded 36007 existing records. [2025-10-21T17:14:48.259482] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T17:14:48.385300] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:48.376278] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-21T17:14:48.521560] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:14:48.523060] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-21T17:14:48.525601] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-21T17:14:48.525468] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-21T17:14:48.538622] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-21T17:14:48.539208] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-21T17:14:48.705931] [DEBUG] [LOCAL ] APD: Loaded 45522 existing records from primary storage. [2025-10-21T17:14:48.726634] [INFO ] [MAIN ] APD: Loaded 45522 existing records. [2025-10-21T17:14:48.956521] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-21T17:14:49.082624] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-21T17:14:49.171084] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:14:49.166794] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:49.173048] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-21T17:14:49.173109] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-21T17:14:49.173380] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-21T17:14:49.173436] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-21T17:14:49.545314] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:49.751053] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-21T17:14:50.551068] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-21T17:14:50.717607] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T17:14:51.113149] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-21T17:14:51.351093] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-21T17:14:51.733128] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-21T17:14:52.151057] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-21T17:14:52.628360] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T17:14:52.951024] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-21T17:14:53.180094] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T17:14:53.487365] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-21T17:14:53.751063] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-21T17:14:54.551092] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-21T17:14:55.325722] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T17:14:55.350988] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-21T17:14:55.368296] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T17:14:56.151065] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-21T17:14:56.893403] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-21T17:14:56.901195] [INFO ] [REMOTE ] AOS: Full fetch complete (71050 records). [2025-10-21T17:14:56.901363] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-21T17:14:56.961762] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-21T17:14:57.313257] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-21T17:14:57.313337] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-21T17:14:57.314046] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-21T17:14:57.314110] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-21T17:14:57.315435] [DEBUG] [LOCAL ] AOS: Trimmed 71050 records to 48651 (keeping 200 days of data) [2025-10-21T17:14:57.608603] [DEBUG] [LOCAL ] AOS: Primary data saved (48651 records). [2025-10-21T17:14:57.608740] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-21T17:14:57.608820] [INFO ] [MAIN ] Update Progress: 127/2366 symbols completed. AOS took 26.7s. Estimated remaining: 4h 22m 33s. Rate: 8.5 symbols/min [2025-10-21T17:14:57.761604] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-21T17:14:57.796165] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:57.805047] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T17:14:57.834198] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T17:14:57.884928] [DEBUG] [LOCAL ] APG: Loaded 50628 existing records from primary storage. [2025-10-21T17:14:57.885250] [INFO ] [MAIN ] APG: Loaded 50628 existing records. [2025-10-21T17:14:58.069946] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:14:58.070171] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-21T17:14:58.070218] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-21T17:14:58.070701] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-21T17:14:58.070757] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-21T17:14:58.418975] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:58.551046] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-21T17:14:59.177059] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:14:59.351055] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-21T17:14:59.908449] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T17:15:00.151075] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-21T17:15:00.951062] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-21T17:15:01.010712] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T17:15:01.751036] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-21T17:15:01.892502] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T17:15:02.551037] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-21T17:15:02.933480] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T17:15:03.351083] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-21T17:15:03.520327] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-21T17:15:04.151100] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-21T17:15:04.510539] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-21T17:15:04.818007] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T17:15:04.951074] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-21T17:15:05.655211] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-21T17:15:05.751068] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-21T17:15:06.015501] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T17:15:06.267723] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-21T17:15:06.551097] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-21T17:15:07.351060] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-21T17:15:07.965326] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T17:15:08.151042] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-21T17:15:08.951032] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-21T17:15:09.055414] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T17:15:09.208487] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-21T17:15:09.585464] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-21T17:15:09.587053] [INFO ] [REMOTE ] AP: Full fetch complete (9054 records). [2025-10-21T17:15:09.587125] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-21T17:15:09.754525] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-21T17:15:09.968455] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-21T17:15:09.968541] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-21T17:15:09.968797] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-21T17:15:09.968859] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-21T17:15:09.969282] [DEBUG] [LOCAL ] AP: Trimmed 9054 records to 7409 (keeping 200 days of data) [2025-10-21T17:15:10.014462] [DEBUG] [LOCAL ] AP: Primary data saved (7409 records). [2025-10-21T17:15:10.014610] [INFO ] [MAIN ] AP: Full history saved. [2025-10-21T17:15:10.014725] [INFO ] [MAIN ] Update Progress: 128/2366 symbols completed. AP took 25.2s. Estimated remaining: 4h 24m 0s. Rate: 8.5 symbols/min [2025-10-21T17:15:10.193380] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:15:10.253704] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-21T17:15:10.254042] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-10-21T17:15:10.432356] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:15:10.432568] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-21T17:15:10.432617] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-21T17:15:10.432890] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-21T17:15:10.432983] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-21T17:15:10.556144] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-21T17:15:10.808139] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:15:11.351068] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-21T17:15:11.452430] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T17:15:12.151003] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-21T17:15:12.343212] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T17:15:12.951007] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-21T17:15:13.069693] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T17:15:13.751032] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-21T17:15:13.906570] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T17:15:14.551059] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-21T17:15:14.580878] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T17:15:15.352843] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-21T17:15:15.355198] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T17:15:16.150999] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-21T17:15:16.240930] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T17:15:16.951053] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-21T17:15:17.140580] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-21T17:15:17.214452] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-21T17:15:17.751036] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-21T17:15:18.558718] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-21T17:15:18.576455] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T17:15:19.351024] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-21T17:15:19.751103] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-21T17:15:19.776735] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T17:15:19.783572] [INFO ] [REMOTE ] APAM: Full fetch complete (52047 records). [2025-10-21T17:15:19.783742] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-21T17:15:20.156112] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-21T17:15:20.174453] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-21T17:15:20.174521] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-21T17:15:20.175132] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-21T17:15:20.175199] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-21T17:15:20.176377] [DEBUG] [LOCAL ] APAM: Trimmed 52047 records to 35815 (keeping 200 days of data) [2025-10-21T17:15:20.386353] [DEBUG] [LOCAL ] APAM: Primary data saved (35815 records). [2025-10-21T17:15:20.386480] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-21T17:15:20.386557] [INFO ] [MAIN ] Update Progress: 129/2366 symbols completed. APAM took 32.7s. Estimated remaining: 4h 24m 50s. Rate: 8.4 symbols/min [2025-10-21T17:15:20.557117] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:15:20.604980] [DEBUG] [LOCAL ] APLE: Loaded 51975 existing records from primary storage. [2025-10-21T17:15:20.605278] [INFO ] [MAIN ] APLE: Loaded 51975 existing records. [2025-10-21T17:15:20.786847] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:15:20.787080] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-21T17:15:20.787140] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-21T17:15:20.787388] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-21T17:15:20.787426] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-21T17:15:20.967560] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-21T17:15:21.158938] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:15:21.178714] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T17:15:21.186173] [INFO ] [REMOTE ] APD: Full fetch complete (67377 records). [2025-10-21T17:15:21.186296] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-21T17:15:21.576376] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-21T17:15:21.576449] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-21T17:15:21.577119] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-21T17:15:21.577182] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-21T17:15:21.578440] [DEBUG] [LOCAL ] APD: Trimmed 67377 records to 45477 (keeping 200 days of data) [2025-10-21T17:15:21.760680] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-21T17:15:21.872373] [DEBUG] [LOCAL ] APD: Primary data saved (45477 records). [2025-10-21T17:15:21.872522] [INFO ] [MAIN ] APD: Full history saved. [2025-10-21T17:15:21.872614] [INFO ] [MAIN ] Update Progress: 130/2366 symbols completed. APD took 33.8s. Estimated remaining: 4h 23m 7s. Rate: 8.5 symbols/min [2025-10-21T17:15:22.048477] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:15:22.048810] [DEBUG] [LOCAL ] APO: No existing data file found in primary storage. [2025-10-21T17:15:22.048912] [WARN ] [MAIN ] APO: No existing data found, performing full refresh instead. [2025-10-21T17:15:22.049054] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-21T17:15:22.049147] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-21T17:15:22.049332] [DEBUG] [LOCAL ] APO: No primary data file found to delete. [2025-10-21T17:15:22.049504] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-21T17:15:22.440832] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-21T17:15:22.461916] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:15:22.550998] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-21T17:15:22.885807] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T17:15:23.304980] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T17:15:23.350991] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-21T17:15:24.151024] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-21T17:15:24.714176] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-21T17:15:24.951003] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-21T17:15:25.001869] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T17:15:25.751055] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-21T17:15:25.841714] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T17:15:26.551010] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-21T17:15:26.707343] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T17:15:27.104913] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T17:15:27.351026] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-21T17:15:28.151065] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-21T17:15:28.330575] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T17:15:28.808160] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T17:15:28.951070] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-21T17:15:29.751040] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-21T17:15:30.250377] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-21T17:15:30.333196] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T17:15:30.551029] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-21T17:15:31.351056] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-21T17:15:31.463262] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T17:15:32.151078] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-21T17:15:32.199315] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T17:15:32.887567] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T17:15:32.951004] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-21T17:15:33.751033] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-21T17:15:34.550998] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-21T17:15:34.685460] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-21T17:15:34.725722] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T17:15:35.351034] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-21T17:15:35.487484] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T17:15:35.495628] [INFO ] [REMOTE ] APG: Full fetch complete (72162 records). [2025-10-21T17:15:35.495794] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-21T17:15:35.908291] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-21T17:15:35.908373] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-21T17:15:35.909150] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-21T17:15:35.909216] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-21T17:15:35.910580] [DEBUG] [LOCAL ] APG: Trimmed 72162 records to 50625 (keeping 200 days of data) [2025-10-21T17:15:36.152112] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-21T17:15:36.216347] [DEBUG] [LOCAL ] APG: Primary data saved (50625 records). [2025-10-21T17:15:36.216477] [INFO ] [MAIN ] APG: Full history saved. [2025-10-21T17:15:36.216553] [INFO ] [MAIN ] Update Progress: 131/2366 symbols completed. APG took 38.6s. Estimated remaining: 4h 25m 4s. Rate: 8.4 symbols/min [2025-10-21T17:15:36.391104] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:15:36.427490] [DEBUG] [LOCAL ] APOS: Loaded 7187 existing records from primary storage. [2025-10-21T17:15:36.427864] [INFO ] [MAIN ] APOS: Loaded 7187 existing records. [2025-10-21T17:15:36.462859] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-21T17:15:36.622198] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:15:36.622392] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-21T17:15:36.622452] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-21T17:15:36.622627] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-21T17:15:36.622728] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-21T17:15:36.952766] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-21T17:15:37.006738] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:15:37.039930] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:15:37.751001] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-21T17:15:38.019862] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T17:15:38.551028] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-21T17:15:39.195261] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-21T17:15:39.351049] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-21T17:15:39.961359] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-21T17:15:40.151037] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-21T17:15:40.280448] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-21T17:15:40.457706] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-21T17:15:40.951018] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-21T17:15:41.746626] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-21T17:15:41.750976] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-21T17:15:41.981580] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T17:15:42.480598] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T17:15:42.551044] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-21T17:15:43.351053] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-21T17:15:44.151127] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-21T17:15:44.621768] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-21T17:15:44.951050] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-21T17:15:45.309256] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T17:15:45.317708] [INFO ] [REMOTE ] APH: Full fetch complete (77869 records). [2025-10-21T17:15:45.317871] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-21T17:15:45.596245] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-21T17:15:45.744368] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-21T17:15:45.744480] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-21T17:15:45.745334] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-21T17:15:45.745414] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-21T17:15:45.747016] [DEBUG] [LOCAL ] APH: Trimmed 77869 records to 53691 (keeping 200 days of data) [2025-10-21T17:15:45.802295] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-21T17:15:46.099727] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-21T17:15:46.133039] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-10-21T17:15:46.133556] [INFO ] [MAIN ] APH: Full history saved. [2025-10-21T17:15:46.134318] [INFO ] [MAIN ] Update Progress: 132/2366 symbols completed. APH took 36.1s. Estimated remaining: 4h 25m 44s. Rate: 8.4 symbols/min [2025-10-21T17:15:46.307477] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:15:46.307664] [DEBUG] [LOCAL ] APTV: No existing data file found in primary storage. [2025-10-21T17:15:46.307720] [WARN ] [MAIN ] APTV: No existing data found, performing full refresh instead. [2025-10-21T17:15:46.307850] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-21T17:15:46.307891] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-21T17:15:46.307932] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-10-21T17:15:46.307964] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-21T17:15:46.551064] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-21T17:15:46.596923] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T17:15:46.677896] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:15:47.351022] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-21T17:15:48.144733] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-21T17:15:48.150975] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-21T17:15:48.575193] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-21T17:15:48.641627] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T17:15:48.951024] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-21T17:15:49.629716] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-21T17:15:49.751027] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-21T17:15:50.551097] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-21T17:15:51.351021] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-21T17:15:51.435404] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T17:15:51.737778] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T17:15:51.745340] [INFO ] [REMOTE ] APLE: Full fetch complete (74378 records). [2025-10-21T17:15:51.745460] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-21T17:15:51.746263] [FATAL] [VALIDATOR ] APLE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:15:51.746349] [FATAL] [MAIN ] APLE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:15:51.746394] [WARN ] [MAIN ] APLE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:15:51.746463] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-21T17:15:51.746526] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-21T17:15:51.746562] [INFO ] [LOCAL ] APLE: Starting deletion of derivative data. [2025-10-21T17:15:51.746749] [DEBUG] [LOCAL ] APLE: Deleted derivative data file. [2025-10-21T17:15:51.746835] [INFO ] [MAIN ] Update Progress: 133/2366 symbols completed. APLE took 31.4s. Estimated remaining: 4h 25m 11s. Rate: 8.4 symbols/min [2025-10-21T17:15:51.915285] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:15:51.960724] [DEBUG] [LOCAL ] AQN: Loaded 51714 existing records from primary storage. [2025-10-21T17:15:51.961078] [INFO ] [MAIN ] AQN: Loaded 51714 existing records. [2025-10-21T17:15:52.139095] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:15:52.139319] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-21T17:15:52.139366] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-21T17:15:52.139629] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-10-21T17:15:52.139707] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-21T17:15:52.160381] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-21T17:15:52.498108] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:15:52.951003] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-21T17:15:53.133801] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T17:15:53.180682] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T17:15:53.182024] [INFO ] [REMOTE ] APOS: Full fetch complete (10222 records). [2025-10-21T17:15:53.182179] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-21T17:15:53.572054] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-21T17:15:53.572134] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-21T17:15:53.572360] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-21T17:15:53.572398] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-21T17:15:53.572885] [DEBUG] [LOCAL ] APOS: Trimmed 10222 records to 7132 (keeping 200 days of data) [2025-10-21T17:15:53.616785] [DEBUG] [LOCAL ] APOS: Primary data saved (7132 records). [2025-10-21T17:15:53.616915] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-21T17:15:53.616992] [INFO ] [MAIN ] Update Progress: 134/2366 symbols completed. APOS took 17.4s. Estimated remaining: 4h 23m 37s. Rate: 8.5 symbols/min [2025-10-21T17:15:53.765390] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-21T17:15:53.799281] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:15:53.806080] [DEBUG] [LOCAL ] AQNB: Loaded 3972 existing records from primary storage. [2025-10-21T17:15:53.806293] [INFO ] [MAIN ] AQNB: Loaded 3972 existing records. [2025-10-21T17:15:53.994475] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:15:53.994762] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-21T17:15:53.994823] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-21T17:15:53.994990] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-21T17:15:53.995046] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-21T17:15:54.353835] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:15:54.551030] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-21T17:15:54.890076] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-21T17:15:55.351039] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-21T17:15:55.853969] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-21T17:15:55.968673] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-21T17:15:56.151011] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-21T17:15:56.265996] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-21T17:15:56.508507] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-21T17:15:56.951035] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-21T17:15:57.751047] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-21T17:15:58.551106] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-21T17:15:58.708778] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T17:15:59.109480] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-21T17:15:59.351006] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-21T17:15:59.611990] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T17:16:00.151068] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-21T17:16:00.951013] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-21T17:16:01.225770] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-21T17:16:01.751069] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-21T17:16:02.091291] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T17:16:02.389748] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-21T17:16:02.551032] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-21T17:16:02.982550] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-21T17:16:02.991461] [INFO ] [REMOTE ] APO: Full fetch complete (77467 records). [2025-10-21T17:16:02.991691] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-21T17:16:03.365563] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-21T17:16:03.425305] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-21T17:16:03.425390] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-21T17:16:03.426183] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-21T17:16:03.426251] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-21T17:16:03.427819] [DEBUG] [LOCAL ] APO: Trimmed 77467 records to 53390 (keeping 200 days of data) [2025-10-21T17:16:03.756809] [DEBUG] [LOCAL ] APO: Primary data saved (53390 records). [2025-10-21T17:16:03.756951] [INFO ] [MAIN ] APO: Full history saved. [2025-10-21T17:16:03.757022] [INFO ] [MAIN ] Update Progress: 135/2366 symbols completed. APO took 41.9s. Estimated remaining: 4h 24m 20s. Rate: 8.4 symbols/min [2025-10-21T17:16:03.929562] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:16:03.979166] [DEBUG] [LOCAL ] AR: Loaded 53590 existing records from primary storage. [2025-10-21T17:16:03.979495] [INFO ] [MAIN ] AR: Loaded 53590 existing records. [2025-10-21T17:16:04.156111] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-21T17:16:04.161973] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:16:04.162222] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-21T17:16:04.163035] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-21T17:16:04.163557] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-21T17:16:04.163616] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-21T17:16:04.564218] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:16:04.559949] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T17:16:04.587378] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-21T17:16:04.951011] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-21T17:16:05.280487] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T17:16:05.597067] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-21T17:16:05.751082] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-21T17:16:06.551088] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-21T17:16:07.351063] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-21T17:16:07.619232] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T17:16:08.104705] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T17:16:08.151030] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-21T17:16:08.742985] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-21T17:16:08.951063] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-21T17:16:09.571845] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-21T17:16:09.599308] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-21T17:16:09.751020] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-21T17:16:10.311004] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T17:16:10.551076] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-21T17:16:11.351049] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-21T17:16:12.151046] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-21T17:16:12.286243] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T17:16:12.951022] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-21T17:16:13.067693] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T17:16:13.751063] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-21T17:16:13.900436] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T17:16:14.083976] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-21T17:16:14.551064] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-21T17:16:14.915365] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-21T17:16:15.351067] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-21T17:16:15.808906] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-21T17:16:15.809837] [INFO ] [REMOTE ] AQNB: Full fetch complete (5412 records). [2025-10-21T17:16:15.809903] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-21T17:16:16.154098] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-21T17:16:16.179109] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-21T17:16:16.179251] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-21T17:16:16.179451] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-21T17:16:16.179537] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-21T17:16:16.180093] [DEBUG] [LOCAL ] AQNB: Trimmed 5412 records to 3940 (keeping 200 days of data) [2025-10-21T17:16:16.203255] [DEBUG] [LOCAL ] AQNB: Primary data saved (3940 records). [2025-10-21T17:16:16.203318] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-21T17:16:16.203387] [INFO ] [MAIN ] Update Progress: 136/2366 symbols completed. AQNB took 22.6s. Estimated remaining: 4h 25m 40s. Rate: 8.4 symbols/min [2025-10-21T17:16:16.371475] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:16:16.408489] [DEBUG] [LOCAL ] ARCO: Loaded 44434 existing records from primary storage. [2025-10-21T17:16:16.408961] [INFO ] [MAIN ] ARCO: Loaded 44434 existing records. [2025-10-21T17:16:16.610571] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-21T17:16:16.614848] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:16:16.615060] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-21T17:16:16.625291] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-21T17:16:16.626055] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-21T17:16:16.626112] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-21T17:16:16.954339] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-21T17:16:16.975616] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:16:17.751064] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-21T17:16:17.798979] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-21T17:16:17.807248] [INFO ] [REMOTE ] APTV: Full fetch complete (75853 records). [2025-10-21T17:16:17.807399] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-21T17:16:18.098777] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-21T17:16:18.232207] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-21T17:16:18.232279] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-21T17:16:18.233000] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-21T17:16:18.233064] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-21T17:16:18.234362] [DEBUG] [LOCAL ] APTV: Trimmed 75853 records to 51874 (keeping 200 days of data) [2025-10-21T17:16:18.523159] [DEBUG] [LOCAL ] APTV: Primary data saved (51874 records). [2025-10-21T17:16:18.523272] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-21T17:16:18.523344] [INFO ] [MAIN ] Update Progress: 137/2366 symbols completed. APTV took 32.4s. Estimated remaining: 4h 24m 15s. Rate: 8.4 symbols/min [2025-10-21T17:16:18.555120] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-21T17:16:18.695973] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:16:18.711697] [DEBUG] [LOCAL ] ARDC: Loaded 15280 existing records from primary storage. [2025-10-21T17:16:18.711887] [INFO ] [MAIN ] ARDC: Loaded 15280 existing records. [2025-10-21T17:16:18.896052] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:16:18.896211] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-21T17:16:18.896261] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-21T17:16:18.896440] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-21T17:16:18.896495] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-21T17:16:19.258414] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:16:19.283178] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T17:16:19.350974] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-21T17:16:20.151043] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-21T17:16:20.486908] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T17:16:20.951045] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-21T17:16:21.103499] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T17:16:21.153556] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T17:16:21.751045] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-21T17:16:22.551056] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-21T17:16:22.715991] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T17:16:23.351068] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-21T17:16:23.853953] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-21T17:16:24.046250] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T17:16:24.151031] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-21T17:16:24.951047] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-21T17:16:25.169763] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T17:16:25.358360] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-21T17:16:25.749188] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-21T17:16:25.752152] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-21T17:16:26.551072] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-21T17:16:27.351022] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-21T17:16:27.704607] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-21T17:16:27.715596] [INFO ] [REMOTE ] AQN: Full fetch complete (75342 records). [2025-10-21T17:16:27.715805] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-21T17:16:28.049634] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T17:16:28.159048] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-21T17:16:28.160824] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-10-21T17:16:28.160960] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-10-21T17:16:28.161764] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-10-21T17:16:28.162032] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-10-21T17:16:28.163558] [DEBUG] [LOCAL ] AQN: Trimmed 75342 records to 51684 (keeping 200 days of data) [2025-10-21T17:16:28.393708] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T17:16:28.498634] [DEBUG] [LOCAL ] AQN: Primary data saved (51684 records). [2025-10-21T17:16:28.498798] [INFO ] [MAIN ] AQN: Full history saved. [2025-10-21T17:16:28.498881] [INFO ] [MAIN ] Update Progress: 138/2366 symbols completed. AQN took 36.8s. Estimated remaining: 4h 24m 54s. Rate: 8.4 symbols/min [2025-10-21T17:16:28.666346] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:16:28.693462] [DEBUG] [LOCAL ] ARDT: Loaded 27434 existing records from primary storage. [2025-10-21T17:16:28.693760] [INFO ] [MAIN ] ARDT: Loaded 27434 existing records. [2025-10-21T17:16:28.868537] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:16:28.868779] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-21T17:16:28.868832] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-21T17:16:28.869081] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-21T17:16:28.869121] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-21T17:16:28.956153] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-21T17:16:29.256907] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:16:29.675886] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T17:16:29.751058] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-21T17:16:29.935364] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T17:16:30.551028] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-21T17:16:31.356231] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-21T17:16:31.374077] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T17:16:31.920927] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T17:16:32.151040] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-21T17:16:32.328425] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-21T17:16:32.951028] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-21T17:16:33.482548] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T17:16:33.497417] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-21T17:16:33.751053] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-21T17:16:34.551039] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-21T17:16:35.305130] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T17:16:35.351020] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-21T17:16:36.151044] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-21T17:16:36.881563] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-21T17:16:36.950384] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T17:16:36.961888] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-21T17:16:37.162187] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-21T17:16:37.751122] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-21T17:16:38.551004] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-21T17:16:38.750483] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T17:16:38.941226] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T17:16:39.290334] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-21T17:16:39.351032] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-21T17:16:40.151082] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-21T17:16:40.609611] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-21T17:16:40.951074] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-21T17:16:41.750984] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-21T17:16:42.012168] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T17:16:42.551097] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-21T17:16:42.913204] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-21T17:16:42.990266] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T17:16:43.351016] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-21T17:16:43.629439] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T17:16:43.632669] [INFO ] [REMOTE ] ARDC: Full fetch complete (21470 records). [2025-10-21T17:16:43.632742] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-21T17:16:43.989093] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-21T17:16:43.989184] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-21T17:16:43.989523] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-21T17:16:43.989564] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-21T17:16:43.990158] [DEBUG] [LOCAL ] ARDC: Trimmed 21470 records to 15258 (keeping 200 days of data) [2025-10-21T17:16:44.080248] [DEBUG] [LOCAL ] ARDC: Primary data saved (15258 records). [2025-10-21T17:16:44.080362] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-21T17:16:44.080437] [INFO ] [MAIN ] Update Progress: 139/2366 symbols completed. ARDC took 25.6s. Estimated remaining: 4h 27m 2s. Rate: 8.3 symbols/min [2025-10-21T17:16:44.156102] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-21T17:16:44.247106] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:16:44.294458] [DEBUG] [LOCAL ] ARE: Loaded 50965 existing records from primary storage. [2025-10-21T17:16:44.294797] [INFO ] [MAIN ] ARE: Loaded 50965 existing records. [2025-10-21T17:16:44.466676] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:16:44.466890] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-21T17:16:44.466937] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-21T17:16:44.467236] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-21T17:16:44.467275] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-21T17:16:44.814748] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:16:44.951048] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-21T17:16:45.034498] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T17:16:45.042867] [INFO ] [REMOTE ] AR: Full fetch complete (77738 records). [2025-10-21T17:16:45.043006] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-21T17:16:45.426240] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-21T17:16:45.426323] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-21T17:16:45.427092] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-21T17:16:45.427155] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-21T17:16:45.428578] [DEBUG] [LOCAL ] AR: Trimmed 77738 records to 53590 (keeping 200 days of data) [2025-10-21T17:16:45.538806] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T17:16:45.547747] [INFO ] [REMOTE ] ARCO: Full fetch complete (64768 records). [2025-10-21T17:16:45.549221] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-21T17:16:45.550695] [FATAL] [VALIDATOR ] ARCO: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:16:45.561562] [FATAL] [MAIN ] ARCO: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:16:45.561695] [WARN ] [MAIN ] ARCO: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:16:45.570243] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-21T17:16:45.570339] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-21T17:16:45.570380] [INFO ] [LOCAL ] ARCO: Starting deletion of derivative data. [2025-10-21T17:16:45.570550] [DEBUG] [LOCAL ] ARCO: Deleted derivative data file. [2025-10-21T17:16:45.570699] [INFO ] [MAIN ] Update Progress: 140/2366 symbols completed. ARCO took 29.4s. Estimated remaining: 4h 25m 24s. Rate: 8.4 symbols/min [2025-10-21T17:16:45.754164] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-21T17:16:45.844046] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:16:45.954743] [DEBUG] [LOCAL ] AR: Primary data saved (53590 records). [2025-10-21T17:16:45.954878] [INFO ] [MAIN ] AR: Full history saved. [2025-10-21T17:16:45.954998] [INFO ] [MAIN ] Update Progress: 141/2366 symbols completed. AR took 42.2s. Estimated remaining: 4h 23m 30s. Rate: 8.4 symbols/min [2025-10-21T17:16:46.079233] [DEBUG] [LOCAL ] ARES: Loaded 49703 existing records from primary storage. [2025-10-21T17:16:46.085110] [INFO ] [MAIN ] ARES: Loaded 49703 existing records. [2025-10-21T17:16:46.222323] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:16:46.234513] [DEBUG] [LOCAL ] ARI: No existing data file found in primary storage. [2025-10-21T17:16:46.239859] [WARN ] [MAIN ] ARI: No existing data found, performing full refresh instead. [2025-10-21T17:16:46.257392] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-21T17:16:46.263224] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-21T17:16:46.273593] [DEBUG] [LOCAL ] ARI: No primary data file found to delete. [2025-10-21T17:16:46.279045] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-21T17:16:46.397192] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:16:46.406699] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-21T17:16:46.435486] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-21T17:16:46.452282] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-21T17:16:46.538304] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-21T17:16:46.773420] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T17:16:46.884954] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:16:46.890538] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-21T17:16:47.131298] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:16:47.351009] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-21T17:16:47.566340] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T17:16:47.939725] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-21T17:16:48.151093] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-21T17:16:48.857846] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-21T17:16:48.951014] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-21T17:16:48.982123] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-21T17:16:49.751086] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-21T17:16:50.551020] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-21T17:16:50.693106] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T17:16:51.330511] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T17:16:51.350987] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-21T17:16:51.761901] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-21T17:16:52.151052] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-21T17:16:52.951070] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-21T17:16:53.219441] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T17:16:53.342218] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-21T17:16:53.751066] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-21T17:16:54.196580] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T17:16:54.551072] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-21T17:16:55.351056] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-21T17:16:55.630440] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T17:16:55.870797] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-21T17:16:56.151060] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-21T17:16:56.557882] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-21T17:16:56.951033] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-21T17:16:57.663023] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-21T17:16:57.751035] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-21T17:16:58.551048] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-21T17:16:58.858415] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T17:16:58.895344] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T17:16:58.900631] [INFO ] [REMOTE ] ARDT: Full fetch complete (41575 records). [2025-10-21T17:16:58.900789] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-21T17:16:59.284415] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-21T17:16:59.284491] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-21T17:16:59.284968] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-21T17:16:59.285029] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-21T17:16:59.285903] [DEBUG] [LOCAL ] ARDT: Trimmed 41575 records to 27405 (keeping 200 days of data) [2025-10-21T17:16:59.365719] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-21T17:16:59.441834] [DEBUG] [LOCAL ] ARDT: Primary data saved (27405 records). [2025-10-21T17:16:59.441965] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-21T17:16:59.442043] [INFO ] [MAIN ] Update Progress: 142/2366 symbols completed. ARDT took 30.9s. Estimated remaining: 4h 25m 3s. Rate: 8.4 symbols/min [2025-10-21T17:16:59.620867] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:16:59.621044] [DEBUG] [LOCAL ] ARLO: No existing data file found in primary storage. [2025-10-21T17:16:59.621081] [WARN ] [MAIN ] ARLO: No existing data found, performing full refresh instead. [2025-10-21T17:16:59.621234] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-21T17:16:59.621276] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-21T17:16:59.621317] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-21T17:16:59.621350] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-21T17:16:59.981585] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:17:00.151086] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-21T17:17:00.512436] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-21T17:17:00.951019] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-21T17:17:01.346476] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T17:17:01.751081] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-21T17:17:01.933491] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T17:17:02.550992] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-21T17:17:02.762044] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T17:17:03.351005] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-21T17:17:03.611823] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T17:17:03.681939] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T17:17:04.151063] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-21T17:17:04.951031] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-21T17:17:05.105717] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T17:17:05.675826] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T17:17:05.751075] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-21T17:17:06.551009] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-21T17:17:06.583405] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T17:17:07.351034] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-21T17:17:07.404739] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T17:17:08.151003] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-21T17:17:08.637998] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-21T17:17:08.810806] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T17:17:08.951009] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-21T17:17:09.751063] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-21T17:17:10.066279] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-21T17:17:10.551036] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-21T17:17:10.858251] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-21T17:17:11.274109] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T17:17:11.351077] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-21T17:17:12.109671] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T17:17:12.151022] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-21T17:17:12.632701] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-21T17:17:12.951018] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-21T17:17:13.673010] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T17:17:13.750984] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-21T17:17:14.551011] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-21T17:17:14.913291] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-21T17:17:15.275492] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T17:17:15.351038] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-21T17:17:16.150997] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-21T17:17:16.269110] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-21T17:17:16.951057] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-21T17:17:17.161836] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T17:17:17.169863] [INFO ] [REMOTE ] ARE: Full fetch complete (72656 records). [2025-10-21T17:17:17.170031] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-21T17:17:17.170880] [FATAL] [VALIDATOR ] ARE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:17:17.170971] [FATAL] [MAIN ] ARE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:17:17.171014] [WARN ] [MAIN ] ARE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:17:17.171060] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-21T17:17:17.171162] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-10-21T17:17:17.171211] [INFO ] [LOCAL ] ARE: Starting deletion of derivative data. [2025-10-21T17:17:17.171471] [DEBUG] [LOCAL ] ARE: Deleted derivative data file. [2025-10-21T17:17:17.172130] [INFO ] [MAIN ] Update Progress: 143/2366 symbols completed. ARE took 33.1s. Estimated remaining: 4h 27m 40s. Rate: 8.3 symbols/min [2025-10-21T17:17:17.353466] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:17:17.400174] [DEBUG] [LOCAL ] ARMK: Loaded 50421 existing records from primary storage. [2025-10-21T17:17:17.400529] [INFO ] [MAIN ] ARMK: Loaded 50421 existing records. [2025-10-21T17:17:17.576126] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:17:17.576353] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-21T17:17:17.576442] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-21T17:17:17.576969] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-21T17:17:17.577029] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-21T17:17:17.764909] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-21T17:17:17.795806] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T17:17:17.985305] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:17:18.551008] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-21T17:17:18.899195] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-21T17:17:19.351018] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-21T17:17:19.518576] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T17:17:20.124194] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T17:17:20.151051] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-21T17:17:20.950999] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-21T17:17:21.473281] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-21T17:17:21.481345] [INFO ] [REMOTE ] ARES: Full fetch complete (71641 records). [2025-10-21T17:17:21.481459] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-21T17:17:21.770908] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-21T17:17:21.878398] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-21T17:17:21.878546] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-21T17:17:21.879327] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-21T17:17:21.879409] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-21T17:17:21.904790] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T17:17:21.914293] [DEBUG] [LOCAL ] ARES: Trimmed 71641 records to 49679 (keeping 200 days of data) [2025-10-21T17:17:22.216129] [DEBUG] [LOCAL ] ARES: Primary data saved (49679 records). [2025-10-21T17:17:22.216232] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-21T17:17:22.217175] [INFO ] [MAIN ] Update Progress: 144/2366 symbols completed. ARES took 36.6s. Estimated remaining: 4h 26m 59s. Rate: 8.3 symbols/min [2025-10-21T17:17:22.386592] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:17:22.434112] [DEBUG] [LOCAL ] AROC: Loaded 49092 existing records from primary storage. [2025-10-21T17:17:22.434433] [INFO ] [MAIN ] AROC: Loaded 49092 existing records. [2025-10-21T17:17:22.551913] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-21T17:17:22.622049] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:17:22.622428] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-21T17:17:22.622565] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-21T17:17:22.623303] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-21T17:17:22.623362] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-21T17:17:22.929949] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-21T17:17:23.016996] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:17:23.351007] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-21T17:17:23.377107] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T17:17:23.384412] [INFO ] [REMOTE ] ARI: Full fetch complete (62039 records). [2025-10-21T17:17:23.384627] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-21T17:17:23.385672] [FATAL] [VALIDATOR ] ARI: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:17:23.385768] [FATAL] [MAIN ] ARI: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:17:23.385813] [WARN ] [MAIN ] ARI: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:17:23.385856] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-21T17:17:23.385925] [DEBUG] [LOCAL ] ARI: No primary data file found to delete. [2025-10-21T17:17:23.385964] [INFO ] [LOCAL ] ARI: Starting deletion of derivative data. [2025-10-21T17:17:23.386005] [DEBUG] [LOCAL ] ARI: No derivative data file found to delete. [2025-10-21T17:17:23.386076] [INFO ] [MAIN ] Update Progress: 145/2366 symbols completed. ARI took 37.4s. Estimated remaining: 4h 25m 20s. Rate: 8.4 symbols/min [2025-10-21T17:17:23.571315] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:17:23.571491] [DEBUG] [LOCAL ] ARR: No existing data file found in primary storage. [2025-10-21T17:17:23.571531] [WARN ] [MAIN ] ARR: No existing data found, performing full refresh instead. [2025-10-21T17:17:23.571661] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-21T17:17:23.571728] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-21T17:17:23.571803] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-21T17:17:23.571847] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-21T17:17:23.915440] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:17:24.151017] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-21T17:17:24.326432] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-21T17:17:24.333303] [INFO ] [REMOTE ] ARLO: Full fetch complete (63121 records). [2025-10-21T17:17:24.333450] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-21T17:17:24.719011] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-21T17:17:24.719090] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-21T17:17:24.719735] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-21T17:17:24.719797] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-21T17:17:24.720958] [DEBUG] [LOCAL ] ARLO: Trimmed 63121 records to 43536 (keeping 200 days of data) [2025-10-21T17:17:24.956479] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-21T17:17:24.970994] [DEBUG] [LOCAL ] ARLO: Primary data saved (43536 records). [2025-10-21T17:17:24.971127] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-21T17:17:24.971302] [INFO ] [MAIN ] Update Progress: 146/2366 symbols completed. ARLO took 25.5s. Estimated remaining: 4h 23m 48s. Rate: 8.4 symbols/min [2025-10-21T17:17:25.151489] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:17:25.191202] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T17:17:25.231448] [DEBUG] [LOCAL ] ARW: Loaded 33236 existing records from primary storage. [2025-10-21T17:17:25.231707] [INFO ] [MAIN ] ARW: Loaded 33236 existing records. [2025-10-21T17:17:25.406324] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:17:25.406526] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-21T17:17:25.406573] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-21T17:17:25.406860] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-21T17:17:25.406915] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-21T17:17:25.761280] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:17:25.756730] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-21T17:17:26.205380] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-21T17:17:26.551050] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-21T17:17:26.660148] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T17:17:27.351011] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-21T17:17:27.388127] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T17:17:28.137709] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T17:17:28.150970] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-21T17:17:28.951005] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-21T17:17:29.255930] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-21T17:17:29.330343] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T17:17:29.751024] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-21T17:17:30.551017] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-21T17:17:31.005788] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-21T17:17:31.351012] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-21T17:17:31.444288] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:17:31.984743] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-21T17:17:32.151054] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-21T17:17:32.952161] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-21T17:17:32.957931] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T17:17:33.432590] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-21T17:17:33.751047] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-21T17:17:34.551050] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-21T17:17:35.012036] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-21T17:17:35.351018] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-21T17:17:35.503950] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T17:17:35.750966] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-21T17:17:36.151076] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-21T17:17:36.951048] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-21T17:17:37.084326] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T17:17:37.558708] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T17:17:37.751063] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-21T17:17:38.551008] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-21T17:17:38.597759] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T17:17:39.323352] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T17:17:39.350979] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-21T17:17:40.151055] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-21T17:17:40.224374] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T17:17:40.837020] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T17:17:40.951021] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-21T17:17:41.751046] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-21T17:17:41.962080] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T17:17:42.551081] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-21T17:17:43.115519] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-21T17:17:43.255194] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T17:17:43.350998] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-21T17:17:44.151011] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-21T17:17:44.391471] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-21T17:17:44.930787] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T17:17:44.950991] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-21T17:17:45.661042] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T17:17:45.751064] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-21T17:17:46.550993] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-21T17:17:46.636619] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T17:17:47.351089] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-21T17:17:47.989437] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-21T17:17:48.156165] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-21T17:17:48.174504] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-21T17:17:48.950988] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-21T17:17:49.684712] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T17:17:49.690184] [INFO ] [REMOTE ] ARW: Full fetch complete (48391 records). [2025-10-21T17:17:49.690315] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-21T17:17:49.690930] [FATAL] [VALIDATOR ] ARW: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:17:49.691013] [FATAL] [MAIN ] ARW: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:17:49.691058] [WARN ] [MAIN ] ARW: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:17:49.691144] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-21T17:17:49.691234] [DEBUG] [LOCAL ] ARW: No primary data file found to delete. [2025-10-21T17:17:49.691293] [INFO ] [LOCAL ] ARW: Starting deletion of derivative data. [2025-10-21T17:17:49.691431] [DEBUG] [LOCAL ] ARW: Deleted derivative data file. [2025-10-21T17:17:49.691524] [INFO ] [MAIN ] Update Progress: 147/2366 symbols completed. ARW took 24.7s. Estimated remaining: 4h 28m 6s. Rate: 8.3 symbols/min [2025-10-21T17:17:49.752628] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-21T17:17:49.858715] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-10-21T17:17:49.944116] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:17:49.944366] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-21T17:17:49.944436] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-21T17:17:49.944576] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-21T17:17:49.944671] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-21T17:17:49.944772] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-21T17:17:49.944827] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-21T17:17:50.365984] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:17:50.512433] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-21T17:17:50.519822] [INFO ] [REMOTE ] AROC: Full fetch complete (71017 records). [2025-10-21T17:17:50.519928] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-21T17:17:50.520731] [FATAL] [VALIDATOR ] AROC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:17:50.520852] [FATAL] [MAIN ] AROC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:17:50.520895] [WARN ] [MAIN ] AROC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:17:50.520934] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-21T17:17:50.520988] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-10-21T17:17:50.521023] [INFO ] [LOCAL ] AROC: Starting deletion of derivative data. [2025-10-21T17:17:50.521161] [DEBUG] [LOCAL ] AROC: Deleted derivative data file. [2025-10-21T17:17:50.522100] [INFO ] [MAIN ] Update Progress: 148/2366 symbols completed. AROC took 28.3s. Estimated remaining: 4h 26m 23s. Rate: 8.3 symbols/min [2025-10-21T17:17:50.556249] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-10-21T17:17:50.695568] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:17:50.695762] [DEBUG] [LOCAL ] AS: No existing data file found in primary storage. [2025-10-21T17:17:50.695806] [WARN ] [MAIN ] AS: No existing data found, performing full refresh instead. [2025-10-21T17:17:50.695914] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-21T17:17:50.695954] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-21T17:17:50.695993] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-10-21T17:17:50.696025] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-21T17:17:50.823619] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:17:50.847529] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-10-21T17:17:50.871104] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:17:50.910075] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-21T17:17:50.921848] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:17:50.948749] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-21T17:17:50.959828] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-21T17:17:50.979113] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-21T17:17:50.981927] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-21T17:17:50.982019] [INFO ] [MAIN ] Update Progress: 149/2366 symbols completed. ARX took 1.3s. Estimated remaining: 4h 24m 35s. Rate: 8.4 symbols/min [2025-10-21T17:17:51.191419] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:17:51.260748] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:17:51.260939] [DEBUG] [LOCAL ] ASA: No existing data file found in primary storage. [2025-10-21T17:17:51.260977] [WARN ] [MAIN ] ASA: No existing data found, performing full refresh instead. [2025-10-21T17:17:51.261109] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-21T17:17:51.261184] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-21T17:17:51.261237] [DEBUG] [LOCAL ] ASA: No primary data file found to delete. [2025-10-21T17:17:51.261269] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-21T17:17:51.352880] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-21T17:17:51.630444] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:17:51.658148] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-21T17:17:52.151080] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-21T17:17:52.765511] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T17:17:52.951010] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-21T17:17:53.751067] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-21T17:17:54.203946] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-21T17:17:54.551035] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-21T17:17:54.614716] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-21T17:17:54.622335] [INFO ] [REMOTE ] ARMK: Full fetch complete (72624 records). [2025-10-21T17:17:54.622473] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-21T17:17:54.623287] [FATAL] [VALIDATOR ] ARMK: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:17:54.623376] [FATAL] [MAIN ] ARMK: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:17:54.623417] [WARN ] [MAIN ] ARMK: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:17:54.623457] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-21T17:17:54.623512] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-10-21T17:17:54.623547] [INFO ] [LOCAL ] ARMK: Starting deletion of derivative data. [2025-10-21T17:17:54.623726] [DEBUG] [LOCAL ] ARMK: Deleted derivative data file. [2025-10-21T17:17:54.624315] [INFO ] [MAIN ] Update Progress: 150/2366 symbols completed. ARMK took 37.5s. Estimated remaining: 4h 23m 36s. Rate: 8.4 symbols/min [2025-10-21T17:17:54.804125] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:17:54.824124] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T17:17:54.864313] [DEBUG] [LOCAL ] ASAN: Loaded 52732 existing records from primary storage. [2025-10-21T17:17:54.864611] [INFO ] [MAIN ] ASAN: Loaded 52732 existing records. [2025-10-21T17:17:55.056061] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:17:55.056324] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-21T17:17:55.056402] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-21T17:17:55.056776] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-21T17:17:55.056844] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-21T17:17:55.356150] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-21T17:17:55.416928] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:17:56.151031] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-21T17:17:56.305547] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T17:17:56.951045] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-21T17:17:56.995463] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-21T17:17:57.089441] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T17:17:57.751058] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-21T17:17:58.551030] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-21T17:17:58.834263] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T17:17:59.086073] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-21T17:17:59.351013] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-21T17:17:59.834285] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-21T17:18:00.151072] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-21T17:18:00.260590] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T17:18:00.951023] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-21T17:18:01.751065] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-21T17:18:01.965288] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T17:18:02.551062] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-21T17:18:02.756438] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T17:18:02.764445] [INFO ] [REMOTE ] ARR: Full fetch complete (75122 records). [2025-10-21T17:18:02.764601] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-21T17:18:02.765399] [FATAL] [VALIDATOR ] ARR: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:18:02.765488] [FATAL] [MAIN ] ARR: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:18:02.765530] [WARN ] [MAIN ] ARR: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:18:02.765594] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-21T17:18:02.765682] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-21T17:18:02.765737] [INFO ] [LOCAL ] ARR: Starting deletion of derivative data. [2025-10-21T17:18:02.765778] [DEBUG] [LOCAL ] ARR: No derivative data file found to delete. [2025-10-21T17:18:02.765837] [INFO ] [MAIN ] Update Progress: 151/2366 symbols completed. ARR took 39.4s. Estimated remaining: 4h 23m 44s. Rate: 8.4 symbols/min [2025-10-21T17:18:02.939154] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:18:02.939337] [DEBUG] [LOCAL ] ASB: No existing data file found in primary storage. [2025-10-21T17:18:02.939400] [WARN ] [MAIN ] ASB: No existing data found, performing full refresh instead. [2025-10-21T17:18:02.939508] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-21T17:18:02.939549] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-21T17:18:02.939589] [DEBUG] [LOCAL ] ASB: No primary data file found to delete. [2025-10-21T17:18:02.939619] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-21T17:18:03.295697] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:18:03.351023] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-21T17:18:03.584829] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T17:18:04.151010] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-21T17:18:04.359311] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T17:18:04.951027] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-21T17:18:05.094739] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T17:18:05.749518] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-21T17:18:05.759768] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-21T17:18:05.851107] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-21T17:18:06.551051] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-21T17:18:07.351048] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-21T17:18:07.378142] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-21T17:18:07.632414] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T17:18:08.151010] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-21T17:18:08.865978] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T17:18:08.951033] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-21T17:18:09.751024] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-21T17:18:09.884926] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-21T17:18:09.886356] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T17:18:10.551000] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-21T17:18:11.351083] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-21T17:18:11.436435] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:18:12.011433] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-21T17:18:12.150986] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-21T17:18:12.330449] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-21T17:18:12.951016] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-21T17:18:13.751002] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-21T17:18:14.235971] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-21T17:18:14.287146] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-21T17:18:14.551023] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-21T17:18:15.351032] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-21T17:18:15.925321] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-21T17:18:16.151132] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-21T17:18:16.351140] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T17:18:16.951081] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-21T17:18:17.313182] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-21T17:18:17.750996] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-21T17:18:17.791347] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T17:18:18.551089] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-21T17:18:18.838498] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-21T17:18:19.351106] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-21T17:18:19.473134] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T17:18:19.477623] [INFO ] [REMOTE ] ASA: Full fetch complete (20731 records). [2025-10-21T17:18:19.477800] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-21T17:18:19.868769] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-21T17:18:19.868976] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-21T17:18:19.869371] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-21T17:18:19.869452] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-21T17:18:19.870579] [DEBUG] [LOCAL ] ASA: Trimmed 20731 records to 15663 (keeping 200 days of data) [2025-10-21T17:18:19.963614] [DEBUG] [LOCAL ] ASA: Primary data saved (15663 records). [2025-10-21T17:18:19.963932] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-21T17:18:19.964040] [INFO ] [MAIN ] Update Progress: 152/2366 symbols completed. ASA took 29.0s. Estimated remaining: 4h 26m 3s. Rate: 8.3 symbols/min [2025-10-21T17:18:20.179212] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:18:20.154243] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-21T17:18:20.182998] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T17:18:20.196890] [DEBUG] [LOCAL ] ASBA: Loaded 3520 existing records from primary storage. [2025-10-21T17:18:20.197331] [INFO ] [MAIN ] ASBA: Loaded 3520 existing records. [2025-10-21T17:18:20.379692] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:18:20.379931] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-21T17:18:20.379978] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-21T17:18:20.380146] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-21T17:18:20.380201] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-21T17:18:20.727833] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:18:20.951013] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-21T17:18:21.314214] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-21T17:18:21.692219] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-21T17:18:21.750998] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-21T17:18:21.801356] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T17:18:22.551058] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-21T17:18:23.157081] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T17:18:23.351052] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-21T17:18:23.583195] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T17:18:24.151063] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-21T17:18:24.704203] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-21T17:18:24.816225] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T17:18:24.951070] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-21T17:18:25.751044] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-21T17:18:26.551014] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-21T17:18:26.692589] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T17:18:26.700868] [INFO ] [REMOTE ] AS: Full fetch complete (76916 records). [2025-10-21T17:18:26.700994] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-21T17:18:27.094327] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-21T17:18:27.094415] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-21T17:18:27.095168] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-21T17:18:27.095234] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-21T17:18:27.096618] [DEBUG] [LOCAL ] AS: Trimmed 76916 records to 53198 (keeping 200 days of data) [2025-10-21T17:18:27.363618] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-21T17:18:27.413994] [DEBUG] [LOCAL ] AS: Primary data saved (53198 records). [2025-10-21T17:18:27.427693] [INFO ] [MAIN ] AS: Full history saved. [2025-10-21T17:18:27.437699] [INFO ] [MAIN ] Update Progress: 153/2366 symbols completed. AS took 36.9s. Estimated remaining: 4h 25m 59s. Rate: 8.3 symbols/min [2025-10-21T17:18:27.451422] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T17:18:27.623512] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:18:27.623700] [DEBUG] [LOCAL ] ASC: No existing data file found in primary storage. [2025-10-21T17:18:27.623749] [WARN ] [MAIN ] ASC: No existing data found, performing full refresh instead. [2025-10-21T17:18:27.623860] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-21T17:18:27.623900] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-21T17:18:27.623940] [DEBUG] [LOCAL ] ASC: No primary data file found to delete. [2025-10-21T17:18:27.623971] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-21T17:18:27.973459] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:18:28.021507] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-21T17:18:28.150982] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-21T17:18:28.493263] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T17:18:28.951019] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-21T17:18:29.751011] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-21T17:18:29.826602] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T17:18:30.089771] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-21T17:18:30.556091] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-21T17:18:30.570586] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T17:18:31.351036] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-21T17:18:31.816924] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-21T17:18:32.151030] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-21T17:18:32.206556] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T17:18:32.215139] [INFO ] [REMOTE ] ASAN: Full fetch complete (76633 records). [2025-10-21T17:18:32.215287] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-21T17:18:32.616850] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-21T17:18:32.616955] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-21T17:18:32.617768] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-21T17:18:32.617835] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-21T17:18:32.619310] [DEBUG] [LOCAL ] ASAN: Trimmed 76633 records to 52732 (keeping 200 days of data) [2025-10-21T17:18:32.922872] [DEBUG] [LOCAL ] ASAN: Primary data saved (52732 records). [2025-10-21T17:18:32.922995] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-21T17:18:32.923884] [INFO ] [MAIN ] Update Progress: 154/2366 symbols completed. ASAN took 38.3s. Estimated remaining: 4h 25m 27s. Rate: 8.3 symbols/min [2025-10-21T17:18:32.956070] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-21T17:18:33.099884] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:18:33.120618] [DEBUG] [LOCAL ] ASG: Loaded 19504 existing records from primary storage. [2025-10-21T17:18:33.120901] [INFO ] [MAIN ] ASG: Loaded 19504 existing records. [2025-10-21T17:18:33.308897] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:18:33.309124] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-21T17:18:33.309172] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-21T17:18:33.309399] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-21T17:18:33.309439] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-21T17:18:33.704432] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:18:33.751018] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-21T17:18:33.892165] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T17:18:34.330567] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-21T17:18:34.550992] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-21T17:18:34.888168] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-21T17:18:34.896404] [INFO ] [REMOTE ] ASB: Full fetch complete (72151 records). [2025-10-21T17:18:34.896548] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-21T17:18:35.289399] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-21T17:18:35.289483] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-21T17:18:35.290233] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-21T17:18:35.290296] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-21T17:18:35.291703] [DEBUG] [LOCAL ] ASB: Trimmed 72151 records to 49698 (keeping 200 days of data) [2025-10-21T17:18:35.352329] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-21T17:18:35.588057] [DEBUG] [LOCAL ] ASB: Primary data saved (49698 records). [2025-10-21T17:18:35.588237] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-21T17:18:35.588348] [INFO ] [MAIN ] Update Progress: 155/2366 symbols completed. ASB took 32.8s. Estimated remaining: 4h 24m 16s. Rate: 8.4 symbols/min [2025-10-21T17:18:35.767560] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:18:35.789555] [DEBUG] [LOCAL ] ASGI: Loaded 23006 existing records from primary storage. [2025-10-21T17:18:35.789809] [INFO ] [MAIN ] ASGI: Loaded 23006 existing records. [2025-10-21T17:18:35.897383] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-21T17:18:35.935082] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T17:18:35.996379] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:18:35.996609] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-21T17:18:35.996680] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-21T17:18:35.996949] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-21T17:18:35.997005] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-21T17:18:36.156668] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-21T17:18:36.352494] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:18:36.753746] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-21T17:18:36.951040] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-21T17:18:37.751008] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-21T17:18:38.309085] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T17:18:38.551080] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-21T17:18:38.670756] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T17:18:39.351022] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-21T17:18:39.770333] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T17:18:40.151106] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-21T17:18:40.649854] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T17:18:40.932525] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-21T17:18:40.934946] [INFO ] [REMOTE ] ASBA: Full fetch complete (5257 records). [2025-10-21T17:18:40.935156] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-21T17:18:40.956898] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-21T17:18:41.300534] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-21T17:18:41.300610] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-21T17:18:41.300781] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-21T17:18:41.300840] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-21T17:18:41.301188] [DEBUG] [LOCAL ] ASBA: Trimmed 5257 records to 3501 (keeping 200 days of data) [2025-10-21T17:18:41.322001] [DEBUG] [LOCAL ] ASBA: Primary data saved (3501 records). [2025-10-21T17:18:41.322060] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-21T17:18:41.322123] [INFO ] [MAIN ] Update Progress: 156/2366 symbols completed. ASBA took 21.4s. Estimated remaining: 4h 23m 48s. Rate: 8.4 symbols/min [2025-10-21T17:18:41.485541] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:18:41.517236] [DEBUG] [LOCAL ] ASGN: Loaded 36724 existing records from primary storage. [2025-10-21T17:18:41.517498] [INFO ] [MAIN ] ASGN: Loaded 36724 existing records. [2025-10-21T17:18:41.690915] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:18:41.691133] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-21T17:18:41.691179] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-21T17:18:41.691509] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-21T17:18:41.691547] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-21T17:18:41.756186] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-21T17:18:42.047127] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:18:42.551062] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-21T17:18:43.008700] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-21T17:18:43.351111] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-21T17:18:43.543198] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T17:18:44.135077] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T17:18:44.150999] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-21T17:18:44.805319] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T17:18:44.951036] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-21T17:18:45.098919] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T17:18:45.751055] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-21T17:18:46.191046] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T17:18:46.551055] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-21T17:18:46.692872] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-21T17:18:47.351062] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-21T17:18:48.004553] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T17:18:48.151048] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-21T17:18:48.421062] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T17:18:48.876300] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-21T17:18:48.951058] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-21T17:18:49.751047] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-21T17:18:50.102310] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T17:18:50.551066] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-21T17:18:51.225891] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T17:18:51.351186] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-21T17:18:51.510788] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-21T17:18:52.151048] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-21T17:18:52.904594] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T17:18:52.951010] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-21T17:18:53.230123] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-21T17:18:53.751074] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-21T17:18:54.551006] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-21T17:18:54.582620] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T17:18:55.285944] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-21T17:18:55.348372] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-21T17:18:55.353576] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-21T17:18:56.151051] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-21T17:18:56.930818] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T17:18:56.950991] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-21T17:18:57.284299] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T17:18:57.751020] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-21T17:18:58.316426] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T17:18:58.551010] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-21T17:18:58.922382] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T17:18:59.311437] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T17:18:59.351109] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-21T17:19:00.151065] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-21T17:19:00.335095] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-21T17:19:00.951045] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-21T17:19:01.716871] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T17:19:01.750992] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-21T17:19:02.378953] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T17:19:02.383048] [INFO ] [REMOTE ] ASGI: Full fetch complete (33174 records). [2025-10-21T17:19:02.383173] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-21T17:19:02.552437] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-21T17:19:02.769927] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-21T17:19:02.770027] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-21T17:19:02.770424] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-21T17:19:02.770466] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-21T17:19:02.771265] [DEBUG] [LOCAL ] ASGI: Trimmed 33174 records to 23005 (keeping 200 days of data) [2025-10-21T17:19:02.913442] [DEBUG] [LOCAL ] ASGI: Primary data saved (23005 records). [2025-10-21T17:19:02.913809] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-21T17:19:02.913945] [INFO ] [MAIN ] Update Progress: 157/2366 symbols completed. ASGI took 27.3s. Estimated remaining: 4h 27m 4s. Rate: 8.3 symbols/min [2025-10-21T17:19:02.935002] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-21T17:19:02.941001] [INFO ] [REMOTE ] ASC: Full fetch complete (55813 records). [2025-10-21T17:19:02.941150] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-21T17:19:02.941791] [FATAL] [VALIDATOR ] ASC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:19:02.941880] [FATAL] [MAIN ] ASC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:19:02.941922] [WARN ] [MAIN ] ASC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:19:02.941958] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-21T17:19:02.942014] [DEBUG] [LOCAL ] ASC: No primary data file found to delete. [2025-10-21T17:19:02.942049] [INFO ] [LOCAL ] ASC: Starting deletion of derivative data. [2025-10-21T17:19:02.942086] [DEBUG] [LOCAL ] ASC: No derivative data file found to delete. [2025-10-21T17:19:02.942140] [INFO ] [MAIN ] Update Progress: 158/2366 symbols completed. ASC took 35.5s. Estimated remaining: 4h 25m 16s. Rate: 8.3 symbols/min [2025-10-21T17:19:03.351117] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-21T17:19:03.473579] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T17:19:03.479310] [INFO ] [REMOTE ] ASG: Full fetch complete (30847 records). [2025-10-21T17:19:03.479552] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-21T17:19:03.884891] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-21T17:19:03.885062] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-21T17:19:03.885701] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-21T17:19:03.885772] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-21T17:19:03.886727] [DEBUG] [LOCAL ] ASG: Trimmed 30847 records to 19380 (keeping 200 days of data) [2025-10-21T17:19:04.003373] [DEBUG] [LOCAL ] ASG: Primary data saved (19380 records). [2025-10-21T17:19:04.003627] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-21T17:19:04.003834] [INFO ] [MAIN ] Update Progress: 159/2366 symbols completed. ASG took 31.1s. Estimated remaining: 4h 23m 43s. Rate: 8.4 symbols/min [2025-10-21T17:19:04.858938] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-21T17:19:04.867599] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-21T17:19:06.264340] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T17:19:06.273004] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-21T17:19:07.609726] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T17:19:07.618036] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-21T17:19:09.089221] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T17:19:09.097571] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-21T17:19:10.676789] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T17:19:10.683563] [INFO ] [REMOTE ] ASGN: Full fetch complete (53492 records). [2025-10-21T17:19:10.683755] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-21T17:19:11.070170] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-21T17:19:11.070254] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-21T17:19:11.070835] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-21T17:19:11.070896] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-21T17:19:11.071989] [DEBUG] [LOCAL ] ASGN: Trimmed 53492 records to 36654 (keeping 200 days of data) [2025-10-21T17:19:11.276496] [DEBUG] [LOCAL ] ASGN: Primary data saved (36654 records). [2025-10-21T17:19:11.276628] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-21T17:19:11.276740] [INFO ] [MAIN ] Update Progress: 160/2366 symbols completed. ASGN took 30.0s. Estimated remaining: 4h 23m 37s. Rate: 8.4 symbols/min [2025-10-21T17:19:12.010189] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:19:12.003671] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:19:12.058868] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:19:12.066289] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:19:12.067076] [DEBUG] [LOCAL ] ASR: No existing data file found in primary storage. [2025-10-21T17:19:12.067137] [WARN ] [MAIN ] ASR: No existing data found, performing full refresh instead. [2025-10-21T17:19:12.069696] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-21T17:19:12.069773] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-21T17:19:12.069834] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-10-21T17:19:12.069903] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-21T17:19:12.218075] [DEBUG] [LOCAL ] ASIX: Loaded 23205 existing records from primary storage. [2025-10-21T17:19:12.254200] [INFO ] [MAIN ] ASIX: Loaded 23205 existing records. [2025-10-21T17:19:12.276615] [DEBUG] [LOCAL ] ASPN: Loaded 49915 existing records from primary storage. [2025-10-21T17:19:12.265703] [DEBUG] [LOCAL ] ASH: Loaded 37563 existing records from primary storage. [2025-10-21T17:19:12.326258] [INFO ] [MAIN ] ASPN: Loaded 49915 existing records. [2025-10-21T17:19:12.340607] [INFO ] [MAIN ] ASH: Loaded 37563 existing records. [2025-10-21T17:19:13.007687] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:19:12.972774] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:19:13.031246] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-21T17:19:13.018488] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-21T17:19:13.054019] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-21T17:19:13.058579] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:19:13.059377] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-21T17:19:13.064796] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-21T17:19:13.070046] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-21T17:19:13.075321] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-21T17:19:13.064711] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-21T17:19:13.110370] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-21T17:19:13.118015] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-21T17:19:13.199371] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:19:13.219922] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-21T17:19:13.241357] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-21T17:19:13.253549] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-21T17:19:14.259275] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:19:14.303748] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-21T17:19:14.312300] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:19:14.319103] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-21T17:19:14.316667] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:19:14.322499] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-21T17:19:14.322125] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-21T17:19:14.323216] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-21T17:19:15.089148] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T17:19:15.091175] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-21T17:19:15.397638] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-21T17:19:15.401601] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-21T17:19:15.555050] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T17:19:15.562836] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-21T17:19:15.925783] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-21T17:19:15.927815] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-21T17:19:16.139314] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T17:19:16.149319] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-21T17:19:16.371476] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T17:19:16.375188] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-21T17:19:16.670445] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-21T17:19:16.673381] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-21T17:19:17.424314] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-21T17:19:17.433996] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T17:19:17.444590] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-21T17:19:17.620875] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T17:19:17.751021] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-21T17:19:17.804666] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T17:19:18.551026] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-21T17:19:18.730432] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T17:19:19.021829] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T17:19:19.351054] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-21T17:19:20.151016] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-21T17:19:20.250825] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T17:19:20.296236] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-21T17:19:20.951036] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-21T17:19:21.158282] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-21T17:19:21.751007] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-21T17:19:22.461733] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T17:19:22.550993] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-21T17:19:22.633983] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-21T17:19:23.351038] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-21T17:19:24.151013] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-21T17:19:24.174341] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-21T17:19:24.250711] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T17:19:24.951037] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-21T17:19:25.083867] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-21T17:19:25.471115] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-21T17:19:25.751008] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-21T17:19:26.551048] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-21T17:19:27.145032] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T17:19:27.351033] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-21T17:19:28.151025] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-21T17:19:28.294512] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T17:19:28.956113] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-21T17:19:28.970855] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-21T17:19:29.191735] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-21T17:19:29.751026] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-21T17:19:30.551007] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-21T17:19:30.772622] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-21T17:19:30.929800] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-21T17:19:31.351053] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-21T17:19:31.448738] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-21T17:19:32.150996] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-21T17:19:32.516975] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T17:19:32.521153] [INFO ] [REMOTE ] ASIX: Full fetch complete (31031 records). [2025-10-21T17:19:32.521257] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-21T17:19:32.960781] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-21T17:19:32.978273] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-21T17:19:32.979794] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-21T17:19:32.980500] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-21T17:19:32.980572] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-21T17:19:32.981856] [DEBUG] [LOCAL ] ASIX: Trimmed 31031 records to 23106 (keeping 200 days of data) [2025-10-21T17:19:33.097605] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-21T17:19:33.106960] [INFO ] [REMOTE ] ASR: Full fetch complete (12571 records). [2025-10-21T17:19:33.110735] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-21T17:19:33.545580] [DEBUG] [LOCAL ] ASIX: Primary data saved (23106 records). [2025-10-21T17:19:33.545826] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-21T17:19:33.546423] [INFO ] [MAIN ] Update Progress: 161/2366 symbols completed. ASIX took 22.3s. Estimated remaining: 4h 26m 57s. Rate: 8.3 symbols/min [2025-10-21T17:19:33.757143] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-21T17:19:33.777302] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-21T17:19:33.808229] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-21T17:19:33.808630] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-21T17:19:33.808737] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-21T17:19:33.831147] [DEBUG] [LOCAL ] ASR: Trimmed 12571 records to 9484 (keeping 200 days of data) [2025-10-21T17:19:33.950747] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:19:33.969445] [DEBUG] [LOCAL ] ASR: Primary data saved (9484 records). [2025-10-21T17:19:33.969636] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-21T17:19:33.969939] [INFO ] [MAIN ] Update Progress: 162/2366 symbols completed. ASR took 22.7s. Estimated remaining: 4h 25m 17s. Rate: 8.3 symbols/min [2025-10-21T17:19:34.162217] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:19:34.179419] [DEBUG] [LOCAL ] ASX: Loaded 52882 existing records from primary storage. [2025-10-21T17:19:34.179811] [INFO ] [MAIN ] ASX: Loaded 52882 existing records. [2025-10-21T17:19:34.380019] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:19:34.391860] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-21T17:19:34.392118] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-21T17:19:34.392727] [DEBUG] [LOCAL ] ATEN: Loaded 38022 existing records from primary storage. [2025-10-21T17:19:34.392923] [INFO ] [MAIN ] ATEN: Loaded 38022 existing records. [2025-10-21T17:19:34.424689] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-21T17:19:34.448285] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-21T17:19:34.660717] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:19:34.677505] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-21T17:19:34.677824] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-21T17:19:34.693710] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-21T17:19:34.704124] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-21T17:19:35.156070] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-21T17:19:35.217130] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:19:35.237053] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-21T17:19:35.347550] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:19:35.350980] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-21T17:19:35.402489] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T17:19:36.151073] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-21T17:19:36.804997] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T17:19:36.951093] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-21T17:19:37.210627] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-21T17:19:37.599994] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T17:19:37.751099] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-21T17:19:38.243286] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T17:19:38.551060] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-21T17:19:39.351002] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-21T17:19:39.600436] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T17:19:40.151055] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-21T17:19:40.465361] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T17:19:40.718794] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T17:19:40.951049] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-21T17:19:41.756187] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-21T17:19:41.777862] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-21T17:19:41.788867] [INFO ] [REMOTE ] ASPN: Full fetch complete (72613 records). [2025-10-21T17:19:41.789104] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-21T17:19:42.245510] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-21T17:19:42.245664] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-21T17:19:42.246797] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-21T17:19:42.246891] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-21T17:19:42.249324] [DEBUG] [LOCAL ] ASPN: Trimmed 72613 records to 49890 (keeping 200 days of data) [2025-10-21T17:19:42.558188] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-21T17:19:42.566906] [DEBUG] [LOCAL ] ASPN: Primary data saved (49890 records). [2025-10-21T17:19:42.567293] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-21T17:19:42.567486] [INFO ] [MAIN ] Update Progress: 163/2366 symbols completed. ASPN took 31.3s. Estimated remaining: 4h 25m 28s. Rate: 8.3 symbols/min [2025-10-21T17:19:42.767965] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:19:42.768364] [DEBUG] [LOCAL ] ATGE: No existing data file found in primary storage. [2025-10-21T17:19:42.768475] [WARN ] [MAIN ] ATGE: No existing data found, performing full refresh instead. [2025-10-21T17:19:42.769480] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-21T17:19:42.769528] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-21T17:19:42.769569] [DEBUG] [LOCAL ] ATGE: No primary data file found to delete. [2025-10-21T17:19:42.769602] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-21T17:19:43.004928] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-21T17:19:43.231101] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:19:43.351075] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-21T17:19:43.517442] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T17:19:44.151025] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-21T17:19:44.216906] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-21T17:19:44.877720] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T17:19:44.951061] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-21T17:19:45.758535] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-21T17:19:45.775052] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T17:19:45.903835] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T17:19:46.551027] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-21T17:19:47.284545] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T17:19:47.290558] [INFO ] [REMOTE ] ASH: Full fetch complete (55440 records). [2025-10-21T17:19:47.290675] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-21T17:19:47.291293] [FATAL] [VALIDATOR ] ASH: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:19:47.291389] [FATAL] [MAIN ] ASH: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:19:47.291430] [WARN ] [MAIN ] ASH: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:19:47.291499] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-21T17:19:47.291560] [DEBUG] [LOCAL ] ASH: No primary data file found to delete. [2025-10-21T17:19:47.291595] [INFO ] [LOCAL ] ASH: Starting deletion of derivative data. [2025-10-21T17:19:47.291747] [DEBUG] [LOCAL ] ASH: Deleted derivative data file. [2025-10-21T17:19:47.291832] [INFO ] [MAIN ] Update Progress: 164/2366 symbols completed. ASH took 36.0s. Estimated remaining: 4h 24m 47s. Rate: 8.3 symbols/min [2025-10-21T17:19:47.356290] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-21T17:19:47.491136] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:19:47.525047] [DEBUG] [LOCAL ] ATHM: Loaded 31516 existing records from primary storage. [2025-10-21T17:19:47.525361] [INFO ] [MAIN ] ATHM: Loaded 31516 existing records. [2025-10-21T17:19:47.698167] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:19:47.698343] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-21T17:19:47.698389] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-21T17:19:47.698985] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-21T17:19:47.699042] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-21T17:19:48.066136] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:19:48.150974] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-21T17:19:48.567892] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-21T17:19:48.951003] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-21T17:19:49.007441] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T17:19:49.721075] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T17:19:49.751068] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-21T17:19:50.126744] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-21T17:19:50.551043] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-21T17:19:51.351036] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-21T17:19:51.601424] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T17:19:51.836835] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T17:19:52.151028] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-21T17:19:52.790254] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T17:19:52.951016] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-21T17:19:53.252692] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T17:19:53.751049] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-21T17:19:54.438437] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T17:19:54.551040] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-21T17:19:55.258735] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T17:19:55.351037] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-21T17:19:55.952699] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-21T17:19:56.151123] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-21T17:19:56.421067] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-21T17:19:56.951080] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-21T17:19:57.618636] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T17:19:57.751071] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-21T17:19:58.405948] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T17:19:58.550992] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-21T17:19:59.351016] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-21T17:19:59.696982] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-21T17:19:59.726213] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T17:20:00.151035] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-21T17:20:00.678535] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T17:20:00.951040] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-21T17:20:01.751009] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-21T17:20:02.056459] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-21T17:20:02.282340] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T17:20:02.551053] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-21T17:20:02.610890] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T17:20:03.351029] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-21T17:20:04.041096] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-21T17:20:04.151006] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-21T17:20:04.577698] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-21T17:20:04.951044] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-21T17:20:05.297212] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-21T17:20:05.751019] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-21T17:20:06.551021] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-21T17:20:06.577828] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T17:20:07.141524] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T17:20:07.146937] [INFO ] [REMOTE ] ATEN: Full fetch complete (56737 records). [2025-10-21T17:20:07.147067] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-21T17:20:07.358371] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-21T17:20:07.529813] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-21T17:20:07.529893] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-21T17:20:07.530507] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-21T17:20:07.530548] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-21T17:20:07.531724] [DEBUG] [LOCAL ] ATEN: Trimmed 56737 records to 37831 (keeping 200 days of data) [2025-10-21T17:20:07.754541] [DEBUG] [LOCAL ] ATEN: Primary data saved (37831 records). [2025-10-21T17:20:07.754748] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-21T17:20:07.754850] [INFO ] [MAIN ] Update Progress: 165/2366 symbols completed. ATEN took 33.8s. Estimated remaining: 4h 27m 37s. Rate: 8.2 symbols/min [2025-10-21T17:20:07.935901] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:20:07.945138] [DEBUG] [LOCAL ] ATHS: Loaded 6572 existing records from primary storage. [2025-10-21T17:20:07.945388] [INFO ] [MAIN ] ATHS: Loaded 6572 existing records. [2025-10-21T17:20:08.135153] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:20:08.135467] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-21T17:20:08.135533] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-21T17:20:08.135871] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-21T17:20:08.135937] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-21T17:20:08.167872] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-21T17:20:08.537849] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:20:08.570465] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-21T17:20:08.704395] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T17:20:08.950996] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-21T17:20:09.331792] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T17:20:09.751043] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-21T17:20:10.221075] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T17:20:10.225748] [INFO ] [REMOTE ] ATGE: Full fetch complete (45707 records). [2025-10-21T17:20:10.225869] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-21T17:20:10.564906] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-21T17:20:10.641247] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-21T17:20:10.641335] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-21T17:20:10.641923] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-21T17:20:10.641992] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-21T17:20:10.642954] [DEBUG] [LOCAL ] ATGE: Trimmed 45707 records to 30618 (keeping 200 days of data) [2025-10-21T17:20:10.823099] [DEBUG] [LOCAL ] ATGE: Primary data saved (30618 records). [2025-10-21T17:20:10.823218] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-21T17:20:10.823289] [INFO ] [MAIN ] Update Progress: 166/2366 symbols completed. ATGE took 28.3s. Estimated remaining: 4h 26m 33s. Rate: 8.3 symbols/min [2025-10-21T17:20:10.991775] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:20:11.038405] [DEBUG] [LOCAL ] ATI: Loaded 51311 existing records from primary storage. [2025-10-21T17:20:11.038755] [INFO ] [MAIN ] ATI: Loaded 51311 existing records. [2025-10-21T17:20:11.213946] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:20:11.214154] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-21T17:20:11.214208] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-21T17:20:11.214795] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-21T17:20:11.214855] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-21T17:20:11.359584] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-21T17:20:11.464583] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T17:20:11.598713] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:20:11.789411] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-21T17:20:11.797966] [INFO ] [REMOTE ] ASX: Full fetch complete (76793 records). [2025-10-21T17:20:11.798105] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-21T17:20:12.156175] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-21T17:20:12.214465] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-21T17:20:12.214560] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-21T17:20:12.215335] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-21T17:20:12.215399] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-21T17:20:12.217047] [DEBUG] [LOCAL ] ASX: Trimmed 76793 records to 52881 (keeping 200 days of data) [2025-10-21T17:20:12.532788] [DEBUG] [LOCAL ] ASX: Primary data saved (52881 records). [2025-10-21T17:20:12.532932] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-21T17:20:12.533014] [INFO ] [MAIN ] Update Progress: 167/2366 symbols completed. ASX took 39.0s. Estimated remaining: 4h 25m 13s. Rate: 8.3 symbols/min [2025-10-21T17:20:12.711205] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:20:12.746453] [DEBUG] [LOCAL ] ATKR: Loaded 35028 existing records from primary storage. [2025-10-21T17:20:12.746797] [INFO ] [MAIN ] ATKR: Loaded 35028 existing records. [2025-10-21T17:20:12.922721] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:20:12.922976] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-21T17:20:12.923034] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-21T17:20:12.923619] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-21T17:20:12.923707] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-21T17:20:12.956238] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-21T17:20:13.281715] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:20:13.531152] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T17:20:13.751079] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-21T17:20:14.485551] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T17:20:14.551058] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-21T17:20:14.956810] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (3.60 seconds). [2025-10-21T17:20:14.961444] [INFO ] [REMOTE ] ATHM: Full fetch complete (49597 records). [2025-10-21T17:20:14.961545] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-21T17:20:15.306001] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-21T17:20:15.361861] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-21T17:20:15.362708] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-21T17:20:15.363346] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-21T17:20:15.363464] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-21T17:20:15.364638] [DEBUG] [LOCAL ] ATHM: Trimmed 49597 records to 31322 (keeping 200 days of data) [2025-10-21T17:20:15.361678] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-21T17:20:15.570340] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (3.41 seconds). [2025-10-21T17:20:15.591712] [DEBUG] [LOCAL ] ATHM: Primary data saved (31322 records). [2025-10-21T17:20:15.591848] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-21T17:20:15.592510] [INFO ] [MAIN ] Update Progress: 168/2366 symbols completed. ATHM took 28.3s. Estimated remaining: 4h 24m 11s. Rate: 8.3 symbols/min [2025-10-21T17:20:15.761704] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:20:15.797964] [DEBUG] [LOCAL ] ATMU: Loaded 38808 existing records from primary storage. [2025-10-21T17:20:15.798262] [INFO ] [MAIN ] ATMU: Loaded 38808 existing records. [2025-10-21T17:20:15.975284] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:20:15.975493] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-21T17:20:15.975538] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-21T17:20:15.976219] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-21T17:20:15.976277] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-21T17:20:16.156144] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-21T17:20:16.336768] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:20:16.924345] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T17:20:16.950998] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-21T17:20:16.980357] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T17:20:17.751042] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-21T17:20:18.471263] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T17:20:18.551030] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-21T17:20:18.995482] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-21T17:20:19.280526] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-21T17:20:19.351040] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-21T17:20:20.151026] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-21T17:20:20.832055] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T17:20:20.866822] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T17:20:20.951021] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-21T17:20:21.751032] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-21T17:20:22.360455] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T17:20:22.492437] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T17:20:22.551031] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-21T17:20:23.351016] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-21T17:20:24.151007] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-21T17:20:24.359437] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T17:20:24.736136] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T17:20:24.871921] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-21T17:20:24.873609] [INFO ] [REMOTE ] ATHS: Full fetch complete (9622 records). [2025-10-21T17:20:24.873720] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-21T17:20:24.956144] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-21T17:20:25.258875] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-21T17:20:25.258954] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-21T17:20:25.259178] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-21T17:20:25.259236] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-21T17:20:25.259688] [DEBUG] [LOCAL ] ATHS: Trimmed 9622 records to 6564 (keeping 200 days of data) [2025-10-21T17:20:25.298337] [DEBUG] [LOCAL ] ATHS: Primary data saved (6564 records). [2025-10-21T17:20:25.298447] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-21T17:20:25.298523] [INFO ] [MAIN ] Update Progress: 169/2366 symbols completed. ATHS took 17.5s. Estimated remaining: 4h 24m 36s. Rate: 8.3 symbols/min [2025-10-21T17:20:25.470013] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:20:25.509629] [DEBUG] [LOCAL ] ATO: Loaded 41744 existing records from primary storage. [2025-10-21T17:20:25.509961] [INFO ] [MAIN ] ATO: Loaded 41744 existing records. [2025-10-21T17:20:25.694239] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:20:25.694481] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-21T17:20:25.694539] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-21T17:20:25.695462] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-21T17:20:25.695538] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-21T17:20:25.757277] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-21T17:20:26.165125] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:20:26.551107] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-21T17:20:26.742246] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T17:20:27.351074] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-21T17:20:27.398542] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T17:20:28.151036] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-21T17:20:28.188183] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T17:20:28.951053] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-21T17:20:29.044567] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:20:29.751070] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-21T17:20:29.823637] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T17:20:30.051337] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T17:20:30.550991] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-21T17:20:31.216340] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T17:20:31.351056] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-21T17:20:31.761137] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-21T17:20:32.151079] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-21T17:20:32.951060] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-21T17:20:33.124311] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T17:20:33.241258] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-21T17:20:33.751070] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-21T17:20:34.200730] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T17:20:34.551109] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-21T17:20:35.351044] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-21T17:20:35.439867] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T17:20:36.097058] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T17:20:36.150980] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-21T17:20:36.656487] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T17:20:36.951066] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-21T17:20:37.262993] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T17:20:37.751081] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-21T17:20:38.551005] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-21T17:20:38.673888] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T17:20:39.351013] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-21T17:20:39.546532] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T17:20:39.979963] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T17:20:39.985180] [INFO ] [REMOTE ] ATKR: Full fetch complete (53210 records). [2025-10-21T17:20:39.985270] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-21T17:20:40.153473] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-21T17:20:40.374927] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-21T17:20:40.375037] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-21T17:20:40.375719] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-21T17:20:40.375805] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-21T17:20:40.395091] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T17:20:40.394361] [DEBUG] [LOCAL ] ATKR: Trimmed 53210 records to 34887 (keeping 200 days of data) [2025-10-21T17:20:40.613883] [DEBUG] [LOCAL ] ATKR: Primary data saved (34887 records). [2025-10-21T17:20:40.614012] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-21T17:20:40.614089] [INFO ] [MAIN ] Update Progress: 170/2366 symbols completed. ATKR took 28.1s. Estimated remaining: 4h 26m 13s. Rate: 8.2 symbols/min [2025-10-21T17:20:40.803736] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:20:40.832981] [DEBUG] [LOCAL ] ATR: Loaded 30554 existing records from primary storage. [2025-10-21T17:20:40.833238] [INFO ] [MAIN ] ATR: Loaded 30554 existing records. [2025-10-21T17:20:40.956215] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-21T17:20:41.015937] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:20:41.016082] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-21T17:20:41.016126] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-21T17:20:41.016702] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-21T17:20:41.016758] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-21T17:20:41.384427] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:20:41.756874] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-21T17:20:41.771264] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T17:20:42.147822] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T17:20:42.551038] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-21T17:20:43.111779] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T17:20:43.351037] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-21T17:20:44.151012] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-21T17:20:44.212633] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T17:20:44.768967] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T17:20:44.951011] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-21T17:20:45.663470] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T17:20:45.750993] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-21T17:20:46.212293] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T17:20:46.551037] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-21T17:20:47.351089] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-21T17:20:47.584170] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T17:20:47.787361] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T17:20:48.151024] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-21T17:20:48.951056] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-21T17:20:49.157881] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T17:20:49.500861] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T17:20:49.751027] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-21T17:20:50.551015] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-21T17:20:50.589034] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T17:20:51.063033] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T17:20:51.351022] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-21T17:20:52.041613] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T17:20:52.049758] [INFO ] [REMOTE ] ATMU: Full fetch complete (56880 records). [2025-10-21T17:20:52.049866] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-21T17:20:52.151105] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-21T17:20:52.435070] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-21T17:20:52.435142] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-21T17:20:52.435744] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-21T17:20:52.435807] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-21T17:20:52.436868] [DEBUG] [LOCAL ] ATMU: Trimmed 56880 records to 38780 (keeping 200 days of data) [2025-10-21T17:20:52.664608] [DEBUG] [LOCAL ] ATMU: Primary data saved (38780 records). [2025-10-21T17:20:52.664753] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-21T17:20:52.664837] [INFO ] [MAIN ] Update Progress: 171/2366 symbols completed. ATMU took 37.1s. Estimated remaining: 4h 27m 8s. Rate: 8.2 symbols/min [2025-10-21T17:20:52.835429] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:20:52.851235] [DEBUG] [LOCAL ] ATS: Loaded 17325 existing records from primary storage. [2025-10-21T17:20:52.851441] [INFO ] [MAIN ] ATS: Loaded 17325 existing records. [2025-10-21T17:20:52.952333] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-21T17:20:53.037197] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:20:53.037447] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-21T17:20:53.037521] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-21T17:20:53.038175] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-21T17:20:53.038325] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-21T17:20:53.175212] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T17:20:53.447789] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:20:53.659596] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T17:20:53.750999] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-21T17:20:54.552098] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-21T17:20:54.553765] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T17:20:54.560935] [INFO ] [REMOTE ] ATO: Full fetch complete (60736 records). [2025-10-21T17:20:54.561081] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-21T17:20:54.955580] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-21T17:20:54.955744] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-21T17:20:54.956420] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-21T17:20:54.956515] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-21T17:20:54.957932] [DEBUG] [LOCAL ] ATO: Trimmed 60736 records to 41624 (keeping 200 days of data) [2025-10-21T17:20:55.114279] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T17:20:55.258913] [DEBUG] [LOCAL ] ATO: Primary data saved (41624 records). [2025-10-21T17:20:55.259031] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-21T17:20:55.259104] [INFO ] [MAIN ] Update Progress: 172/2366 symbols completed. ATO took 30.0s. Estimated remaining: 4h 26m 0s. Rate: 8.2 symbols/min [2025-10-21T17:20:55.356204] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-21T17:20:55.429615] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:20:55.473587] [DEBUG] [LOCAL ] ATUS: Loaded 49947 existing records from primary storage. [2025-10-21T17:20:55.473917] [INFO ] [MAIN ] ATUS: Loaded 49947 existing records. [2025-10-21T17:20:55.669085] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:20:55.669304] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-21T17:20:55.669353] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-21T17:20:55.670237] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-21T17:20:55.670295] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-21T17:20:56.035786] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:20:56.055748] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-21T17:20:56.151000] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-21T17:20:56.951057] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-21T17:20:57.037202] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T17:20:57.045946] [INFO ] [REMOTE ] ATI: Full fetch complete (74042 records). [2025-10-21T17:20:57.046173] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-21T17:20:57.461517] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-21T17:20:57.461606] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-21T17:20:57.462448] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-21T17:20:57.462520] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-21T17:20:57.464006] [DEBUG] [LOCAL ] ATI: Trimmed 74042 records to 51304 (keeping 200 days of data) [2025-10-21T17:20:57.763286] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-21T17:20:57.784786] [DEBUG] [LOCAL ] ATI: Primary data saved (51304 records). [2025-10-21T17:20:57.785072] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-21T17:20:57.785194] [INFO ] [MAIN ] Update Progress: 173/2366 symbols completed. ATI took 47.0s. Estimated remaining: 4h 24m 53s. Rate: 8.3 symbols/min [2025-10-21T17:20:57.990115] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:20:58.019330] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T17:20:58.047870] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T17:20:58.097139] [DEBUG] [LOCAL ] AU: Loaded 53089 existing records from primary storage. [2025-10-21T17:20:58.097444] [INFO ] [MAIN ] AU: Loaded 53089 existing records. [2025-10-21T17:20:58.278459] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:20:58.278733] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-21T17:20:58.278797] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-21T17:20:58.279746] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-21T17:20:58.279807] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-21T17:20:58.556689] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-21T17:20:58.650497] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:20:58.903514] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T17:20:59.351085] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-21T17:20:59.700043] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T17:21:00.151012] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-21T17:21:00.228283] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T17:21:00.951062] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-21T17:21:01.751046] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-21T17:21:02.053942] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T17:21:02.551378] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-21T17:21:02.582990] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-21T17:21:02.771785] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T17:21:03.351072] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-21T17:21:04.156434] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-21T17:21:04.172077] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T17:21:04.658411] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T17:21:04.663462] [INFO ] [REMOTE ] ATR: Full fetch complete (43975 records). [2025-10-21T17:21:04.663623] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-21T17:21:04.952941] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-21T17:21:05.047393] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-21T17:21:05.047475] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-21T17:21:05.048202] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-21T17:21:05.048265] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-21T17:21:05.049562] [DEBUG] [LOCAL ] ATR: Trimmed 43975 records to 30495 (keeping 200 days of data) [2025-10-21T17:21:05.239411] [DEBUG] [LOCAL ] ATR: Primary data saved (30495 records). [2025-10-21T17:21:05.239547] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-21T17:21:05.239622] [INFO ] [MAIN ] Update Progress: 174/2366 symbols completed. ATR took 24.6s. Estimated remaining: 4h 24m 48s. Rate: 8.3 symbols/min [2025-10-21T17:21:05.410522] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:21:05.451203] [DEBUG] [LOCAL ] AUB: Loaded 45950 existing records from primary storage. [2025-10-21T17:21:05.451499] [INFO ] [MAIN ] AUB: Loaded 45950 existing records. [2025-10-21T17:21:05.636597] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:21:05.636811] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-21T17:21:05.636860] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-21T17:21:05.637529] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-21T17:21:05.637569] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-21T17:21:05.756114] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-21T17:21:06.007591] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:21:06.051330] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-21T17:21:06.551000] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-21T17:21:06.578050] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T17:21:06.822809] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T17:21:07.351046] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-21T17:21:07.972503] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-21T17:21:08.151041] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-21T17:21:08.883549] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T17:21:08.951081] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-21T17:21:09.751083] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-21T17:21:10.136051] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T17:21:10.204429] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T17:21:10.551074] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-21T17:21:10.892250] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T17:21:11.351021] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-21T17:21:12.072237] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T17:21:12.150987] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-21T17:21:12.951044] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-21T17:21:13.639620] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-21T17:21:13.751045] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-21T17:21:13.847968] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T17:21:14.551052] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-21T17:21:14.876283] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-21T17:21:15.351006] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-21T17:21:15.445176] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-21T17:21:16.030593] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-21T17:21:16.151045] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-21T17:21:16.786154] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-21T17:21:16.951043] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-21T17:21:17.738842] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T17:21:17.750971] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-21T17:21:18.551040] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-21T17:21:18.702394] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T17:21:19.351000] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-21T17:21:19.649005] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T17:21:20.121342] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-21T17:21:20.151028] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-21T17:21:20.561595] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-21T17:21:20.950996] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-21T17:21:21.353399] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-21T17:21:21.751042] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-21T17:21:22.551018] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-21T17:21:22.797428] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-21T17:21:23.356203] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-21T17:21:23.373626] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T17:21:23.842997] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T17:21:24.151023] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-21T17:21:24.951018] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-21T17:21:25.043627] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-21T17:21:25.258025] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T17:21:25.751071] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-21T17:21:26.551002] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-21T17:21:26.658300] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-21T17:21:26.676533] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T17:21:26.679089] [INFO ] [REMOTE ] ATS: Full fetch complete (25464 records). [2025-10-21T17:21:26.679185] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-21T17:21:27.097317] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-21T17:21:27.097473] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-21T17:21:27.097906] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-21T17:21:27.097970] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-21T17:21:27.098869] [DEBUG] [LOCAL ] ATS: Trimmed 25464 records to 17169 (keeping 200 days of data) [2025-10-21T17:21:27.203827] [DEBUG] [LOCAL ] ATS: Primary data saved (17169 records). [2025-10-21T17:21:27.203977] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-21T17:21:27.204061] [INFO ] [MAIN ] Update Progress: 175/2366 symbols completed. ATS took 34.5s. Estimated remaining: 4h 27m 45s. Rate: 8.2 symbols/min [2025-10-21T17:21:27.354493] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-21T17:21:27.373678] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:21:27.380127] [DEBUG] [LOCAL ] AUNA: Loaded 5212 existing records from primary storage. [2025-10-21T17:21:27.380328] [INFO ] [MAIN ] AUNA: Loaded 5212 existing records. [2025-10-21T17:21:27.560594] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:21:27.560841] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-21T17:21:27.560888] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-21T17:21:27.561160] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-21T17:21:27.561217] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-21T17:21:27.922062] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:21:28.151008] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-21T17:21:28.473489] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-21T17:21:28.677027] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-21T17:21:28.951036] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-21T17:21:29.043361] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T17:21:29.751063] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-21T17:21:30.550990] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-21T17:21:30.551978] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T17:21:30.560708] [INFO ] [REMOTE ] ATUS: Full fetch complete (71393 records). [2025-10-21T17:21:30.560896] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-21T17:21:30.955541] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-21T17:21:30.955615] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-21T17:21:30.956332] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-21T17:21:30.956392] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-21T17:21:30.957625] [DEBUG] [LOCAL ] ATUS: Trimmed 71393 records to 49928 (keeping 200 days of data) [2025-10-21T17:21:31.239407] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T17:21:31.269289] [DEBUG] [LOCAL ] ATUS: Primary data saved (49928 records). [2025-10-21T17:21:31.269492] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-21T17:21:31.269809] [INFO ] [MAIN ] Update Progress: 176/2366 symbols completed. ATUS took 36.0s. Estimated remaining: 4h 26m 57s. Rate: 8.2 symbols/min [2025-10-21T17:21:31.276707] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-21T17:21:31.354691] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-21T17:21:31.451942] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:21:31.488366] [DEBUG] [LOCAL ] AVA: Loaded 38503 existing records from primary storage. [2025-10-21T17:21:31.488664] [INFO ] [MAIN ] AVA: Loaded 38503 existing records. [2025-10-21T17:21:31.665716] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:21:31.665960] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-21T17:21:31.666006] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-21T17:21:31.666332] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-21T17:21:31.666388] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-21T17:21:32.023557] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:21:32.151021] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-21T17:21:32.951018] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-21T17:21:33.584698] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T17:21:33.587847] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T17:21:33.617197] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-21T17:21:33.625429] [INFO ] [REMOTE ] AU: Full fetch complete (76610 records). [2025-10-21T17:21:33.625563] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-21T17:21:33.765427] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-21T17:21:34.030616] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-21T17:21:34.030728] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-21T17:21:34.031498] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-21T17:21:34.031539] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-21T17:21:34.032916] [DEBUG] [LOCAL ] AU: Trimmed 76610 records to 53089 (keeping 200 days of data) [2025-10-21T17:21:34.381089] [DEBUG] [LOCAL ] AU: Primary data saved (53089 records). [2025-10-21T17:21:34.381253] [INFO ] [MAIN ] AU: Full history saved. [2025-10-21T17:21:34.382096] [INFO ] [MAIN ] Update Progress: 177/2366 symbols completed. AU took 36.6s. Estimated remaining: 4h 25m 58s. Rate: 8.2 symbols/min [2025-10-21T17:21:34.554666] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:21:34.553126] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-21T17:21:34.567421] [DEBUG] [LOCAL ] AVAL: Loaded 8528 existing records from primary storage. [2025-10-21T17:21:34.568089] [INFO ] [MAIN ] AVAL: Loaded 8528 existing records. [2025-10-21T17:21:34.753840] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:21:34.754071] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-21T17:21:34.754118] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-21T17:21:34.754519] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-21T17:21:34.754575] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-21T17:21:35.118770] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:21:35.181903] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:21:35.351033] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-21T17:21:36.021472] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T17:21:36.029096] [INFO ] [REMOTE ] AUB: Full fetch complete (66311 records). [2025-10-21T17:21:36.029247] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-21T17:21:36.156130] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-21T17:21:36.431108] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-21T17:21:36.431197] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-21T17:21:36.431912] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-21T17:21:36.432099] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-21T17:21:36.433390] [DEBUG] [LOCAL ] AUB: Trimmed 66311 records to 45881 (keeping 200 days of data) [2025-10-21T17:21:36.705478] [DEBUG] [LOCAL ] AUB: Primary data saved (45881 records). [2025-10-21T17:21:36.705607] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-21T17:21:36.705903] [INFO ] [MAIN ] Update Progress: 178/2366 symbols completed. AUB took 31.5s. Estimated remaining: 4h 24m 49s. Rate: 8.3 symbols/min [2025-10-21T17:21:36.883113] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:21:36.925247] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T17:21:36.926401] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-21T17:21:36.957040] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-21T17:21:36.976240] [DEBUG] [LOCAL ] AVB: Loaded 42300 existing records from primary storage. [2025-10-21T17:21:36.976503] [INFO ] [MAIN ] AVB: Loaded 42300 existing records. [2025-10-21T17:21:37.151929] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:21:37.152185] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-21T17:21:37.152249] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-21T17:21:37.152472] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-21T17:21:37.152530] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-21T17:21:37.547939] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:21:37.607143] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-21T17:21:37.751097] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-21T17:21:38.551087] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-21T17:21:39.195078] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-21T17:21:39.335166] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T17:21:39.350972] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-21T17:21:40.151018] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-21T17:21:40.804166] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T17:21:40.951053] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-21T17:21:41.751076] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-21T17:21:41.912027] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T17:21:42.363305] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T17:21:42.458852] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-21T17:21:42.551020] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-21T17:21:42.930092] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-21T17:21:43.351069] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-21T17:21:44.151057] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-21T17:21:44.933182] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T17:21:44.950983] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-21T17:21:45.710672] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T17:21:45.751084] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-21T17:21:46.448596] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T17:21:46.551037] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-21T17:21:47.115584] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T17:21:47.147136] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T17:21:47.351074] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-21T17:21:48.151026] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-21T17:21:48.951001] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-21T17:21:49.021275] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T17:21:49.125107] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T17:21:49.751019] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-21T17:21:49.759915] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T17:21:50.466348] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-21T17:21:50.550996] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-21T17:21:51.351090] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-21T17:21:51.382586] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-21T17:21:52.151028] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-21T17:21:52.894496] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-21T17:21:52.895983] [INFO ] [REMOTE ] AUNA: Full fetch complete (7781 records). [2025-10-21T17:21:52.896050] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-21T17:21:52.958339] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-21T17:21:53.284587] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-21T17:21:53.293669] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-21T17:21:53.294286] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-21T17:21:53.295175] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T17:21:53.295281] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-21T17:21:53.304939] [DEBUG] [LOCAL ] AUNA: Trimmed 7781 records to 5226 (keeping 200 days of data) [2025-10-21T17:21:53.338812] [DEBUG] [LOCAL ] AUNA: Primary data saved (5226 records). [2025-10-21T17:21:53.338956] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-21T17:21:53.339046] [INFO ] [MAIN ] Update Progress: 179/2366 symbols completed. AUNA took 26.1s. Estimated remaining: 4h 26m 37s. Rate: 8.2 symbols/min [2025-10-21T17:21:53.516181] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:21:53.516362] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-21T17:21:53.516404] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-21T17:21:53.516474] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-21T17:21:53.516509] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-21T17:21:53.516548] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-21T17:21:53.516578] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-21T17:21:53.757477] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-21T17:21:53.874896] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:21:54.280518] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T17:21:54.551018] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-21T17:21:55.132170] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T17:21:55.351018] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-10-21T17:21:55.560204] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:21:55.560471] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-10-21T17:21:55.560576] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:21:55.560699] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-21T17:21:55.560775] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:21:55.560833] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-21T17:21:55.560901] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-21T17:21:55.560952] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-21T17:21:55.561009] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-21T17:21:55.561071] [INFO ] [MAIN ] Update Progress: 180/2366 symbols completed. AVBC took 2.2s. Estimated remaining: 4h 25m 28s. Rate: 8.2 symbols/min [2025-10-21T17:21:55.743444] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:21:55.763834] [DEBUG] [LOCAL ] AVD: Loaded 21480 existing records from primary storage. [2025-10-21T17:21:55.764093] [INFO ] [MAIN ] AVD: Loaded 21480 existing records. [2025-10-21T17:21:55.954151] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:21:55.954438] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-21T17:21:55.954512] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-21T17:21:55.954764] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-21T17:21:55.954821] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-21T17:21:56.079758] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T17:21:56.145081] [INFO ] [REMOTE ] AVA: Full fetch complete (55484 records). [2025-10-21T17:21:56.160887] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-21T17:21:56.194194] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-21T17:21:56.533194] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:21:56.774320] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-21T17:21:56.774406] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-21T17:21:56.775062] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-21T17:21:56.775126] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-21T17:21:56.776214] [DEBUG] [LOCAL ] AVA: Trimmed 55484 records to 38417 (keeping 200 days of data) [2025-10-21T17:21:56.970609] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-21T17:21:57.003896] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-21T17:21:57.012670] [DEBUG] [LOCAL ] AVA: Primary data saved (38417 records). [2025-10-21T17:21:57.012770] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-21T17:21:57.012841] [INFO ] [MAIN ] Update Progress: 181/2366 symbols completed. AVA took 25.7s. Estimated remaining: 4h 24m 10s. Rate: 8.3 symbols/min [2025-10-21T17:21:57.190342] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:21:57.208816] [DEBUG] [LOCAL ] AVK: Loaded 18702 existing records from primary storage. [2025-10-21T17:21:57.209060] [INFO ] [MAIN ] AVK: Loaded 18702 existing records. [2025-10-21T17:21:57.389117] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:21:57.389337] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-21T17:21:57.389408] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-21T17:21:57.389599] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-21T17:21:57.389700] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-21T17:21:57.741995] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:21:57.750983] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-21T17:21:58.291544] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T17:21:58.551055] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-21T17:21:58.950061] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T17:21:59.055315] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-21T17:21:59.351045] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-21T17:22:00.151007] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-21T17:22:00.193241] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-21T17:22:00.951069] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-21T17:22:01.291883] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-21T17:22:01.751029] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-21T17:22:02.551074] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-21T17:22:02.631127] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T17:22:02.722073] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T17:22:03.295268] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-21T17:22:03.351034] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-21T17:22:04.151026] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-21T17:22:04.432540] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T17:22:04.942234] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-21T17:22:04.950973] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-21T17:22:05.685170] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-21T17:22:05.687039] [INFO ] [REMOTE ] AVAL: Full fetch complete (14926 records). [2025-10-21T17:22:05.687179] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-21T17:22:05.687578] [FATAL] [VALIDATOR ] AVAL: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:22:05.687684] [FATAL] [MAIN ] AVAL: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:22:05.687755] [WARN ] [MAIN ] AVAL: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:22:05.687829] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-21T17:22:05.687893] [DEBUG] [LOCAL ] AVAL: No primary data file found to delete. [2025-10-21T17:22:05.687928] [INFO ] [LOCAL ] AVAL: Starting deletion of derivative data. [2025-10-21T17:22:05.688147] [DEBUG] [LOCAL ] AVAL: Deleted derivative data file. [2025-10-21T17:22:05.688264] [INFO ] [MAIN ] Update Progress: 182/2366 symbols completed. AVAL took 31.3s. Estimated remaining: 4h 24m 20s. Rate: 8.3 symbols/min [2025-10-21T17:22:05.756200] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-21T17:22:05.882116] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:22:05.918706] [DEBUG] [LOCAL ] AVNS: Loaded 33631 existing records from primary storage. [2025-10-21T17:22:05.918975] [INFO ] [MAIN ] AVNS: Loaded 33631 existing records. [2025-10-21T17:22:06.119470] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:22:06.119692] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-21T17:22:06.119752] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-21T17:22:06.119959] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-21T17:22:06.120015] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-21T17:22:06.498097] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:22:06.551006] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-21T17:22:06.867412] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-21T17:22:07.351000] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-21T17:22:07.410872] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T17:22:08.151017] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-21T17:22:08.767012] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-21T17:22:08.951001] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-21T17:22:09.304552] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T17:22:09.751065] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-21T17:22:10.551058] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-21T17:22:10.700927] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T17:22:10.823784] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T17:22:11.168739] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-21T17:22:11.351017] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-21T17:22:12.151066] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-21T17:22:12.431217] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T17:22:12.951030] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-21T17:22:13.615004] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T17:22:13.751028] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-21T17:22:14.090396] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T17:22:14.551020] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-21T17:22:15.351075] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-21T17:22:15.462800] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-21T17:22:15.590695] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-21T17:22:16.151028] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-21T17:22:16.727843] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T17:22:16.951010] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-21T17:22:17.074927] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-21T17:22:17.751035] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-21T17:22:18.417271] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-21T17:22:18.551009] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-21T17:22:18.656392] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-21T17:22:19.351010] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-21T17:22:20.032233] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T17:22:20.151037] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-21T17:22:20.951066] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-21T17:22:21.205150] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-21T17:22:21.211688] [INFO ] [REMOTE ] AVB: Full fetch complete (59273 records). [2025-10-21T17:22:21.211830] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-21T17:22:21.642392] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T17:22:21.668030] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-21T17:22:21.668544] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-21T17:22:21.669266] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-21T17:22:21.669332] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-21T17:22:21.670622] [DEBUG] [LOCAL ] AVB: Trimmed 59273 records to 42231 (keeping 200 days of data) [2025-10-21T17:22:21.764002] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-21T17:22:21.943712] [DEBUG] [LOCAL ] AVB: Primary data saved (42231 records). [2025-10-21T17:22:21.953432] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-21T17:22:21.955223] [INFO ] [MAIN ] Update Progress: 183/2366 symbols completed. AVB took 45.2s. Estimated remaining: 4h 25m 60s. Rate: 8.2 symbols/min [2025-10-21T17:22:21.955841] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-21T17:22:22.023740] [INFO ] [REMOTE ] AVK: Full fetch complete (26707 records). [2025-10-21T17:22:22.036118] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-21T17:22:22.284196] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:22:22.552572] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-21T17:22:22.552142] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-21T17:22:22.565577] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-21T17:22:22.566223] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-21T17:22:22.567390] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-21T17:22:22.568500] [DEBUG] [LOCAL ] AVNT: Loaded 38938 existing records from primary storage. [2025-10-21T17:22:22.569551] [INFO ] [MAIN ] AVNT: Loaded 38938 existing records. [2025-10-21T17:22:22.620102] [DEBUG] [LOCAL ] AVK: Trimmed 26707 records to 18704 (keeping 200 days of data) [2025-10-21T17:22:22.869879] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:22:22.887333] [DEBUG] [LOCAL ] AVK: Primary data saved (18704 records). [2025-10-21T17:22:22.896254] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-21T17:22:22.896382] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-21T17:22:22.897783] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T17:22:22.897304] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-21T17:22:22.896688] [INFO ] [MAIN ] Update Progress: 184/2366 symbols completed. AVK took 25.9s. Estimated remaining: 4h 24m 37s. Rate: 8.2 symbols/min [2025-10-21T17:22:22.903189] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-21T17:22:22.928502] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-21T17:22:23.241783] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:22:23.353616] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-21T17:22:23.565707] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:22:23.567765] [DEBUG] [LOCAL ] AVTR: Loaded 53572 existing records from primary storage. [2025-10-21T17:22:23.568069] [INFO ] [MAIN ] AVTR: Loaded 53572 existing records. [2025-10-21T17:22:23.772076] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:22:23.772325] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-21T17:22:23.772394] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-21T17:22:23.773425] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-21T17:22:23.773491] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-21T17:22:23.925799] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T17:22:24.151361] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-21T17:22:24.178575] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:22:24.486721] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T17:22:24.951035] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-21T17:22:25.751040] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-21T17:22:25.933758] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T17:22:25.994769] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T17:22:25.998474] [INFO ] [REMOTE ] AVD: Full fetch complete (32642 records). [2025-10-21T17:22:25.998571] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-21T17:22:26.434739] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-21T17:22:26.434842] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-21T17:22:26.435374] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-21T17:22:26.435415] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-21T17:22:26.436392] [DEBUG] [LOCAL ] AVD: Trimmed 32642 records to 21426 (keeping 200 days of data) [2025-10-21T17:22:26.552558] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-21T17:22:26.558069] [DEBUG] [LOCAL ] AVD: Primary data saved (21426 records). [2025-10-21T17:22:26.558247] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-21T17:22:26.558358] [INFO ] [MAIN ] Update Progress: 185/2366 symbols completed. AVD took 31.0s. Estimated remaining: 4h 23m 47s. Rate: 8.3 symbols/min [2025-10-21T17:22:26.731408] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:22:26.769716] [DEBUG] [LOCAL ] AVY: Loaded 38172 existing records from primary storage. [2025-10-21T17:22:26.770028] [INFO ] [MAIN ] AVY: Loaded 38172 existing records. [2025-10-21T17:22:26.946281] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:22:26.964804] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-21T17:22:26.964918] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-21T17:22:26.966232] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-21T17:22:26.966297] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-21T17:22:26.973306] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-21T17:22:27.326130] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:22:27.350986] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-21T17:22:28.071677] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T17:22:28.151008] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-21T17:22:28.951006] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-21T17:22:29.048615] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T17:22:29.648100] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T17:22:29.751075] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-21T17:22:30.160709] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-21T17:22:30.551103] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-21T17:22:31.169424] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-21T17:22:31.351105] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-21T17:22:32.151176] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-21T17:22:32.246983] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T17:22:32.791318] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-21T17:22:32.951062] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-21T17:22:33.600734] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T17:22:33.751138] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-21T17:22:34.551198] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-21T17:22:34.638226] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:22:34.826115] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T17:22:35.351072] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-21T17:22:36.151125] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-21T17:22:36.234890] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T17:22:36.951033] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-21T17:22:37.265779] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T17:22:37.274328] [INFO ] [REMOTE ] AVNS: Full fetch complete (48350 records). [2025-10-21T17:22:37.274551] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-21T17:22:37.687022] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-21T17:22:37.687121] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-21T17:22:37.687718] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-21T17:22:37.687782] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-21T17:22:37.689009] [DEBUG] [LOCAL ] AVNS: Trimmed 48350 records to 33563 (keeping 200 days of data) [2025-10-21T17:22:37.751295] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-21T17:22:37.899211] [DEBUG] [LOCAL ] AVNS: Primary data saved (33563 records). [2025-10-21T17:22:37.899395] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-21T17:22:37.900192] [INFO ] [MAIN ] Update Progress: 186/2366 symbols completed. AVNS took 32.2s. Estimated remaining: 4h 24m 28s. Rate: 8.2 symbols/min [2025-10-21T17:22:38.081861] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:22:38.126616] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T17:22:38.158757] [DEBUG] [LOCAL ] AWF: Loaded 24036 existing records from primary storage. [2025-10-21T17:22:38.159025] [INFO ] [MAIN ] AWF: Loaded 24036 existing records. [2025-10-21T17:22:38.341967] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:22:38.342316] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-21T17:22:38.342367] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-21T17:22:38.342945] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-21T17:22:38.343002] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-21T17:22:38.552193] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-21T17:22:38.722010] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:22:39.269352] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T17:22:39.351044] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-21T17:22:39.770120] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-10-21T17:22:40.151045] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-21T17:22:40.770222] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T17:22:40.951005] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-21T17:22:41.322358] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-10-21T17:22:41.728621] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-21T17:22:41.750986] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-21T17:22:42.291802] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T17:22:42.551043] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-21T17:22:43.351011] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-21T17:22:43.469120] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T17:22:44.135830] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T17:22:44.150978] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-21T17:22:44.628024] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T17:22:44.951059] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-21T17:22:45.366766] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-21T17:22:45.751009] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-21T17:22:46.077354] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T17:22:46.551059] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-21T17:22:47.351034] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-21T17:22:47.778030] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-21T17:22:48.153188] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-21T17:22:48.156699] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T17:22:48.620079] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-21T17:22:48.951070] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-21T17:22:49.751033] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-21T17:22:50.551126] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-21T17:22:50.915390] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-10-21T17:22:51.001229] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T17:22:51.350998] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-21T17:22:51.720113] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-10-21T17:22:52.151062] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-21T17:22:52.951027] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-21T17:23:05.206570] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (13.86 seconds). [2025-10-21T17:23:05.211954] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-21T17:23:05.858833] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (15.31 seconds). [2025-10-21T17:23:05.866937] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-21T17:23:06.159549] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-21T17:23:06.164554] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-21T17:23:07.020246] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (14.07 seconds). [2025-10-21T17:23:07.025856] [INFO ] [REMOTE ] AVNT: Full fetch complete (56180 records). [2025-10-21T17:23:07.025959] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-21T17:23:07.367249] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T17:23:07.457950] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T17:23:07.476022] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-21T17:23:07.485808] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-21T17:23:07.486091] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-21T17:23:07.486994] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-21T17:23:07.487816] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-21T17:23:07.487998] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-21T17:23:07.500867] [DEBUG] [LOCAL ] AVNT: Trimmed 56180 records to 38781 (keeping 200 days of data) [2025-10-21T17:23:07.525058] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (15.37 seconds). [2025-10-21T17:23:07.623114] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-21T17:23:07.783949] [DEBUG] [LOCAL ] AVNT: Primary data saved (38781 records). [2025-10-21T17:23:07.784102] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-21T17:23:07.784183] [INFO ] [MAIN ] Update Progress: 187/2366 symbols completed. AVNT took 45.8s. Estimated remaining: 4h 28m 44s. Rate: 8.1 symbols/min [2025-10-21T17:23:07.952381] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:23:07.979033] [DEBUG] [LOCAL ] AWI: Loaded 25285 existing records from primary storage. [2025-10-21T17:23:07.979287] [INFO ] [MAIN ] AWI: Loaded 25285 existing records. [2025-10-21T17:23:08.154639] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:23:08.154913] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-21T17:23:08.154962] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-21T17:23:08.155387] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-21T17:23:08.155446] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-21T17:23:08.521435] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:23:08.521769] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-21T17:23:08.582038] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-21T17:23:08.588093] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-21T17:23:09.302586] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T17:23:09.313847] [INFO ] [REMOTE ] AVY: Full fetch complete (56647 records). [2025-10-21T17:23:09.334901] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-21T17:23:09.336403] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T17:23:09.399737] [INFO ] [REMOTE ] AVTR: Full fetch complete (77653 records). [2025-10-21T17:23:09.437408] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-21T17:23:10.081018] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T17:23:10.081256] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-21T17:23:10.104094] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-21T17:23:10.103940] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-21T17:23:10.118052] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-21T17:23:10.129013] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T17:23:10.139707] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-21T17:23:10.180556] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-21T17:23:10.210693] [DEBUG] [LOCAL ] AVY: Trimmed 56647 records to 38140 (keeping 200 days of data) [2025-10-21T17:23:10.234845] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-21T17:23:10.235367] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-21T17:23:10.236077] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-21T17:23:10.236177] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-21T17:23:10.326622] [DEBUG] [LOCAL ] AVTR: Trimmed 77653 records to 53572 (keeping 200 days of data) [2025-10-21T17:23:10.679079] [DEBUG] [LOCAL ] AVY: Primary data saved (38140 records). [2025-10-21T17:23:10.686704] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-21T17:23:10.697885] [INFO ] [MAIN ] Update Progress: 188/2366 symbols completed. AVY took 44.1s. Estimated remaining: 4h 27m 44s. Rate: 8.1 symbols/min [2025-10-21T17:23:10.900736] [DEBUG] [LOCAL ] AVTR: Primary data saved (53572 records). [2025-10-21T17:23:10.911153] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-21T17:23:10.916403] [INFO ] [MAIN ] Update Progress: 189/2366 symbols completed. AVTR took 48.0s. Estimated remaining: 4h 26m 15s. Rate: 8.2 symbols/min [2025-10-21T17:23:11.045059] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:23:11.145164] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:23:11.145360] [DEBUG] [LOCAL ] AWP: No existing data file found in primary storage. [2025-10-21T17:23:11.145430] [WARN ] [MAIN ] AWP: No existing data found, performing full refresh instead. [2025-10-21T17:23:11.145835] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-21T17:23:11.145914] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-21T17:23:11.145961] [DEBUG] [LOCAL ] AWP: No primary data file found to delete. [2025-10-21T17:23:11.145995] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-21T17:23:11.273458] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-21T17:23:11.367082] [INFO ] [REMOTE ] AWF: Full fetch complete (36033 records). [2025-10-21T17:23:11.388826] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-21T17:23:11.453601] [DEBUG] [LOCAL ] AWK: Loaded 48510 existing records from primary storage. [2025-10-21T17:23:11.524979] [INFO ] [MAIN ] AWK: Loaded 48510 existing records. [2025-10-21T17:23:11.757431] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T17:23:11.839090] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-21T17:23:11.936280] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:23:12.059842] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:23:12.056958] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-21T17:23:12.095444] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-21T17:23:12.101320] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-21T17:23:12.123956] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-21T17:23:12.132181] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-21T17:23:12.441045] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-21T17:23:12.479881] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-21T17:23:12.486480] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-21T17:23:12.492736] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-21T17:23:12.555321] [DEBUG] [LOCAL ] AWF: Trimmed 36033 records to 24135 (keeping 200 days of data) [2025-10-21T17:23:12.714265] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:23:12.718462] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-21T17:23:12.775426] [DEBUG] [LOCAL ] AWF: Primary data saved (24135 records). [2025-10-21T17:23:12.775523] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-21T17:23:12.775598] [INFO ] [MAIN ] Update Progress: 190/2366 symbols completed. AWF took 34.9s. Estimated remaining: 4h 25m 5s. Rate: 8.2 symbols/min [2025-10-21T17:23:12.954027] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:23:12.977358] [DEBUG] [LOCAL ] AWR: Loaded 22778 existing records from primary storage. [2025-10-21T17:23:12.977613] [INFO ] [MAIN ] AWR: Loaded 22778 existing records. [2025-10-21T17:23:13.166196] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:23:13.166462] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-21T17:23:13.166731] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-21T17:23:13.167080] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-21T17:23:13.167142] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-21T17:23:13.328105] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T17:23:13.407413] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-21T17:23:13.576775] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:23:13.577854] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T17:23:13.583438] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-21T17:23:13.583920] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-21T17:23:14.221612] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-21T17:23:14.231837] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-21T17:23:14.294921] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-21T17:23:14.299067] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-21T17:23:14.815259] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T17:23:14.820118] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-21T17:23:14.902203] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-21T17:23:14.908577] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-21T17:23:15.524062] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T17:23:15.533195] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-21T17:23:15.584136] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T17:23:15.589106] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-21T17:23:15.867926] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T17:23:15.872360] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-21T17:23:15.963325] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-21T17:23:15.968585] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-21T17:23:16.359543] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-21T17:23:16.364277] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-21T17:23:16.690909] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T17:23:16.696245] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-21T17:23:16.998142] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-21T17:23:17.003837] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-21T17:23:17.180270] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T17:23:17.191940] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-21T17:23:17.398823] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T17:23:17.403560] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-21T17:23:17.913054] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T17:23:17.918613] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-21T17:23:17.947837] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T17:23:17.953812] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-21T17:23:18.098819] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-21T17:23:18.536670] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-21T17:23:18.550985] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-21T17:23:18.851475] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-21T17:23:19.095379] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-21T17:23:19.351013] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-21T17:23:19.949706] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T17:23:20.151019] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-21T17:23:20.569676] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-21T17:23:20.951015] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-21T17:23:21.197288] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-21T17:23:21.751027] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-21T17:23:22.189146] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-21T17:23:22.195690] [INFO ] [REMOTE ] AWI: Full fetch complete (36072 records). [2025-10-21T17:23:22.195830] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-21T17:23:22.557150] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-21T17:23:22.597698] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-21T17:23:22.597794] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-21T17:23:22.598358] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-21T17:23:22.598423] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-21T17:23:22.599443] [DEBUG] [LOCAL ] AWI: Trimmed 36072 records to 25268 (keeping 200 days of data) [2025-10-21T17:23:22.755544] [DEBUG] [LOCAL ] AWI: Primary data saved (25268 records). [2025-10-21T17:23:22.755705] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-21T17:23:22.755795] [INFO ] [MAIN ] Update Progress: 191/2366 symbols completed. AWI took 15.0s. Estimated remaining: 4h 25m 28s. Rate: 8.2 symbols/min [2025-10-21T17:23:22.924465] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:23:22.949448] [DEBUG] [LOCAL ] AX: Loaded 28103 existing records from primary storage. [2025-10-21T17:23:22.949692] [INFO ] [MAIN ] AX: Loaded 28103 existing records. [2025-10-21T17:23:23.129016] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:23:23.129297] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-21T17:23:23.129353] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-21T17:23:23.129938] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-21T17:23:23.129995] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-21T17:23:23.351510] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-21T17:23:23.577283] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:23:23.623082] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T17:23:23.686626] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T17:23:24.149474] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-21T17:23:24.156518] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-21T17:23:24.951122] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-21T17:23:25.568962] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T17:23:25.750999] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-21T17:23:26.551089] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-21T17:23:26.612458] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T17:23:26.680181] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T17:23:26.684110] [INFO ] [REMOTE ] AWP: Full fetch complete (31744 records). [2025-10-21T17:23:26.684283] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-21T17:23:27.094095] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-21T17:23:27.094256] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-21T17:23:27.094895] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-21T17:23:27.094963] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-21T17:23:27.096150] [DEBUG] [LOCAL ] AWP: Trimmed 31744 records to 21668 (keeping 200 days of data) [2025-10-21T17:23:27.226485] [DEBUG] [LOCAL ] AWP: Primary data saved (21668 records). [2025-10-21T17:23:27.226616] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-21T17:23:27.226720] [INFO ] [MAIN ] Update Progress: 192/2366 symbols completed. AWP took 16.3s. Estimated remaining: 4h 24m 48s. Rate: 8.2 symbols/min [2025-10-21T17:23:27.356901] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-21T17:23:27.410609] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:23:27.433543] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T17:23:27.489887] [DEBUG] [LOCAL ] AXL: Loaded 50539 existing records from primary storage. [2025-10-21T17:23:27.490577] [INFO ] [MAIN ] AXL: Loaded 50539 existing records. [2025-10-21T17:23:27.684667] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:23:27.685014] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-21T17:23:27.685075] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-21T17:23:27.686183] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-21T17:23:27.686246] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-21T17:23:28.067844] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:23:28.151105] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-21T17:23:28.760839] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T17:23:28.951056] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-21T17:23:29.230701] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T17:23:29.751047] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-21T17:23:30.025224] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T17:23:30.551085] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-21T17:23:31.351038] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-21T17:23:31.493225] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T17:23:32.145945] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T17:23:32.152991] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-21T17:23:32.951020] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-21T17:23:33.206574] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-21T17:23:33.731725] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T17:23:33.750989] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-21T17:23:34.096339] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-21T17:23:34.551041] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-21T17:23:35.351547] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-21T17:23:35.354224] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-21T17:23:36.151055] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-21T17:23:36.188550] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T17:23:36.652719] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-21T17:23:36.950999] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-21T17:23:37.751015] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-21T17:23:37.924739] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T17:23:38.551061] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-21T17:23:38.789623] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T17:23:38.793603] [INFO ] [REMOTE ] AWR: Full fetch complete (32472 records). [2025-10-21T17:23:38.793749] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-21T17:23:39.009142] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-21T17:23:39.221886] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-21T17:23:39.221971] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-21T17:23:39.222439] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-21T17:23:39.222481] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-21T17:23:39.223401] [DEBUG] [LOCAL ] AWR: Trimmed 32472 records to 22805 (keeping 200 days of data) [2025-10-21T17:23:39.351421] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-21T17:23:39.360775] [DEBUG] [LOCAL ] AWR: Primary data saved (22805 records). [2025-10-21T17:23:39.360906] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-21T17:23:39.360985] [INFO ] [MAIN ] Update Progress: 193/2366 symbols completed. AWR took 26.6s. Estimated remaining: 4h 25m 35s. Rate: 8.2 symbols/min [2025-10-21T17:23:39.530007] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:23:39.578568] [DEBUG] [LOCAL ] AXP: Loaded 53169 existing records from primary storage. [2025-10-21T17:23:39.578910] [INFO ] [MAIN ] AXP: Loaded 53169 existing records. [2025-10-21T17:23:39.757587] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:23:39.757919] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-21T17:23:39.757967] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-21T17:23:39.758256] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-21T17:23:39.758317] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-21T17:23:40.125440] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:23:40.159420] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-21T17:23:40.179164] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T17:23:40.951008] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-21T17:23:41.198603] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-21T17:23:41.206682] [INFO ] [REMOTE ] AWK: Full fetch complete (70938 records). [2025-10-21T17:23:41.206806] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-21T17:23:41.669233] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-21T17:23:41.669345] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-21T17:23:41.670195] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-21T17:23:41.670277] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-21T17:23:41.671931] [DEBUG] [LOCAL ] AWK: Trimmed 70938 records to 48465 (keeping 200 days of data) [2025-10-21T17:23:41.775546] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-21T17:23:42.009428] [DEBUG] [LOCAL ] AWK: Primary data saved (48465 records). [2025-10-21T17:23:42.009554] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-21T17:23:42.010333] [INFO ] [MAIN ] Update Progress: 194/2366 symbols completed. AWK took 31.3s. Estimated remaining: 4h 24m 35s. Rate: 8.2 symbols/min [2025-10-21T17:23:42.225499] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:23:42.232431] [DEBUG] [LOCAL ] AXR: Loaded 2925 existing records from primary storage. [2025-10-21T17:23:42.232620] [INFO ] [MAIN ] AXR: Loaded 2925 existing records. [2025-10-21T17:23:42.476255] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:23:42.477032] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-21T17:23:42.477263] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-21T17:23:42.477831] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-21T17:23:42.477942] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-21T17:23:42.641745] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-21T17:23:42.688149] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-21T17:23:42.938063] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-21T17:23:42.967287] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:23:42.992290] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T17:23:43.351014] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-21T17:23:44.151065] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-21T17:23:44.795019] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-21T17:23:44.835156] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-21T17:23:44.950984] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-21T17:23:45.078986] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T17:23:45.751044] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-21T17:23:46.551129] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-21T17:23:47.058811] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-21T17:23:47.280345] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-21T17:23:47.351030] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-21T17:23:47.645988] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T17:23:48.151090] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-21T17:23:48.951024] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-21T17:23:49.751011] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-21T17:23:49.784624] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-21T17:23:50.203446] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-21T17:23:50.339152] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T17:23:50.398324] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-21T17:23:50.551029] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-21T17:23:51.138499] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-21T17:23:51.351082] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-21T17:23:52.151043] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-21T17:23:52.551321] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-21T17:23:52.951007] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-21T17:23:53.751022] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-21T17:23:54.353745] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-21T17:23:54.550987] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-21T17:23:54.853511] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T17:23:54.861008] [INFO ] [REMOTE ] AXL: Full fetch complete (72723 records). [2025-10-21T17:23:54.861133] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-21T17:23:54.862116] [FATAL] [VALIDATOR ] AXL: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:23:54.862203] [FATAL] [MAIN ] AXL: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:23:54.862244] [WARN ] [MAIN ] AXL: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:23:54.862281] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-21T17:23:54.862336] [DEBUG] [LOCAL ] AXL: No primary data file found to delete. [2025-10-21T17:23:54.862369] [INFO ] [LOCAL ] AXL: Starting deletion of derivative data. [2025-10-21T17:23:54.862557] [DEBUG] [LOCAL ] AXL: Deleted derivative data file. [2025-10-21T17:23:54.862675] [INFO ] [MAIN ] Update Progress: 195/2366 symbols completed. AXL took 27.6s. Estimated remaining: 4h 25m 30s. Rate: 8.2 symbols/min [2025-10-21T17:23:55.032852] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:23:55.072131] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T17:23:55.093485] [DEBUG] [LOCAL ] AXS: Loaded 38702 existing records from primary storage. [2025-10-21T17:23:55.093805] [INFO ] [MAIN ] AXS: Loaded 38702 existing records. [2025-10-21T17:23:55.267992] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:23:55.268270] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-21T17:23:55.268326] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-21T17:23:55.268975] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-21T17:23:55.269033] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-21T17:23:55.356391] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-21T17:23:55.621102] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:23:56.151025] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-21T17:23:56.492670] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-21T17:23:56.677209] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-21T17:23:56.690052] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T17:23:56.694989] [INFO ] [REMOTE ] AX: Full fetch complete (42191 records). [2025-10-21T17:23:56.695133] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-21T17:23:56.957926] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-21T17:23:57.085931] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-21T17:23:57.086009] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-21T17:23:57.086522] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-21T17:23:57.086562] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-21T17:23:57.087480] [DEBUG] [LOCAL ] AX: Trimmed 42191 records to 27940 (keeping 200 days of data) [2025-10-21T17:23:57.246775] [DEBUG] [LOCAL ] AX: Primary data saved (27940 records). [2025-10-21T17:23:57.246911] [INFO ] [MAIN ] AX: Full history saved. [2025-10-21T17:23:57.247026] [INFO ] [MAIN ] Update Progress: 196/2366 symbols completed. AX took 34.5s. Estimated remaining: 4h 24m 28s. Rate: 8.2 symbols/min [2025-10-21T17:23:57.417576] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:23:57.464280] [DEBUG] [LOCAL ] AXTA: Loaded 52286 existing records from primary storage. [2025-10-21T17:23:57.464596] [INFO ] [MAIN ] AXTA: Loaded 52286 existing records. [2025-10-21T17:23:57.609638] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-21T17:23:57.653740] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:23:57.653995] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-21T17:23:57.654047] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-21T17:23:57.654535] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-21T17:23:57.654591] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-21T17:23:57.753814] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-21T17:23:58.008336] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:23:58.551042] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-21T17:23:59.328940] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T17:23:59.350994] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-21T17:23:59.895524] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-21T17:24:00.151037] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-21T17:24:00.799666] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-21T17:24:00.951030] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-21T17:24:01.253815] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T17:24:01.751032] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-21T17:24:02.551041] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-21T17:24:02.989937] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-21T17:24:03.054212] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T17:24:03.171247] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-21T17:24:03.351038] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-21T17:24:04.150990] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-21T17:24:04.950999] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-21T17:24:04.991991] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T17:24:05.751077] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-21T17:24:06.336946] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T17:24:06.368594] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-21T17:24:06.551008] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-21T17:24:06.654027] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T17:24:07.096060] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-21T17:24:07.096918] [INFO ] [REMOTE ] AXR: Full fetch complete (4395 records). [2025-10-21T17:24:07.096986] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-21T17:24:07.356197] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-21T17:24:07.466483] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-21T17:24:07.466553] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-21T17:24:07.466705] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-21T17:24:07.466764] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-21T17:24:07.467098] [DEBUG] [LOCAL ] AXR: Trimmed 4395 records to 2916 (keeping 200 days of data) [2025-10-21T17:24:07.483404] [DEBUG] [LOCAL ] AXR: Primary data saved (2916 records). [2025-10-21T17:24:07.483461] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-21T17:24:07.483522] [INFO ] [MAIN ] Update Progress: 197/2366 symbols completed. AXR took 25.5s. Estimated remaining: 4h 24m 52s. Rate: 8.2 symbols/min [2025-10-21T17:24:08.151008] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-21T17:24:08.951014] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-21T17:24:09.289317] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-21T17:24:09.735964] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-21T17:24:09.750988] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-21T17:24:10.551038] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-21T17:24:11.191746] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T17:24:11.258121] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-21T17:24:11.268155] [INFO ] [REMOTE ] AXP: Full fetch complete (77118 records). [2025-10-21T17:24:11.271726] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-21T17:24:11.358549] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-21T17:24:11.741606] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-21T17:24:11.741715] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-21T17:24:11.742534] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-21T17:24:11.742576] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-21T17:24:11.743987] [DEBUG] [LOCAL ] AXP: Trimmed 77118 records to 53161 (keeping 200 days of data) [2025-10-21T17:24:12.076085] [DEBUG] [LOCAL ] AXP: Primary data saved (53161 records). [2025-10-21T17:24:12.076225] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-21T17:24:12.076909] [INFO ] [MAIN ] Update Progress: 198/2366 symbols completed. AXP took 32.7s. Estimated remaining: 4h 24m 15s. Rate: 8.2 symbols/min [2025-10-21T17:24:12.286392] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T17:24:12.297268] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-21T17:24:12.654176] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-21T17:24:12.951019] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-21T17:24:14.033245] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T17:24:14.044974] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-21T17:24:14.705974] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T17:24:14.714822] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-21T17:24:15.583999] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T17:24:15.595622] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-21T17:24:16.170454] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T17:24:16.180780] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-21T17:24:17.428356] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T17:24:17.445326] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-21T17:24:17.916825] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T17:24:17.926780] [INFO ] [REMOTE ] AXS: Full fetch complete (56110 records). [2025-10-21T17:24:17.926993] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-21T17:24:18.318260] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-21T17:24:18.318348] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-21T17:24:18.319026] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-21T17:24:18.319089] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-21T17:24:18.320585] [DEBUG] [LOCAL ] AXS: Trimmed 56110 records to 38784 (keeping 200 days of data) [2025-10-21T17:24:18.559821] [DEBUG] [LOCAL ] AXS: Primary data saved (38784 records). [2025-10-21T17:24:18.559957] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-21T17:24:18.560034] [INFO ] [MAIN ] Update Progress: 199/2366 symbols completed. AXS took 23.7s. Estimated remaining: 4h 23m 59s. Rate: 8.2 symbols/min [2025-10-21T17:24:19.225625] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T17:24:19.238753] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-21T17:24:20.950902] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T17:24:20.961811] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-21T17:24:22.501761] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T17:24:22.513022] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-21T17:24:24.368686] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-21T17:24:24.377532] [INFO ] [REMOTE ] AXTA: Full fetch complete (75441 records). [2025-10-21T17:24:24.377753] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-21T17:24:24.791089] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-21T17:24:24.791188] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-21T17:24:24.792043] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-21T17:24:24.792121] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-21T17:24:24.793540] [DEBUG] [LOCAL ] AXTA: Trimmed 75441 records to 52287 (keeping 200 days of data) [2025-10-21T17:24:25.114858] [DEBUG] [LOCAL ] AXTA: Primary data saved (52287 records). [2025-10-21T17:24:25.115018] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-21T17:24:25.115124] [INFO ] [MAIN ] Update Progress: 200/2366 symbols completed. AXTA took 27.9s. Estimated remaining: 4h 23m 43s. Rate: 8.2 symbols/min [2025-10-21T17:24:25.765051] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:24:25.848248] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:24:25.845028] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:24:25.845124] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-21T17:24:25.857710] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-21T17:24:25.857978] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-21T17:24:25.858045] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-21T17:24:25.858096] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-21T17:24:25.858131] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-21T17:24:25.900970] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:24:25.983310] [DEBUG] [LOCAL ] AZO: Loaded 10945 existing records from primary storage. [2025-10-21T17:24:26.022962] [INFO ] [MAIN ] AZO: Loaded 10945 existing records. [2025-10-21T17:24:26.250340] [DEBUG] [LOCAL ] AYI: Loaded 24589 existing records from primary storage. [2025-10-21T17:24:26.305176] [INFO ] [MAIN ] AYI: Loaded 24589 existing records. [2025-10-21T17:24:26.331978] [DEBUG] [LOCAL ] AZZ: Loaded 22882 existing records from primary storage. [2025-10-21T17:24:26.393110] [INFO ] [MAIN ] AZZ: Loaded 22882 existing records. [2025-10-21T17:24:26.744181] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:24:26.773000] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:24:26.784173] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-21T17:24:26.794403] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-21T17:24:26.835920] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-21T17:24:26.867445] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-21T17:24:26.901479] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:24:26.894681] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-21T17:24:26.902632] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-21T17:24:26.937119] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-21T17:24:27.000291] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-21T17:24:27.072152] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-21T17:24:27.066839] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:24:27.093178] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-21T17:24:27.115618] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-21T17:24:27.190253] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-21T17:24:27.196116] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-21T17:24:27.841175] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:24:27.918420] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-21T17:24:28.130286] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:24:28.130947] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-21T17:24:28.225046] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:24:28.225912] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-21T17:24:28.242352] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-21T17:24:28.248494] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-21T17:24:28.447591] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:24:28.447949] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-21T17:24:28.448049] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:24:28.448116] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-21T17:24:28.448220] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:24:28.448294] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-21T17:24:28.448354] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-21T17:24:28.448389] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-21T17:24:28.448426] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-21T17:24:28.448476] [INFO ] [MAIN ] Update Progress: 201/2366 symbols completed. B took 3.3s. Estimated remaining: 4h 22m 53s. Rate: 8.2 symbols/min [2025-10-21T17:24:28.620088] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:24:28.673723] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-21T17:24:28.674046] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-21T17:24:28.852145] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-21T17:24:28.863844] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-21T17:24:28.883059] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:24:28.884027] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-21T17:24:28.884088] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-21T17:24:28.884379] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-21T17:24:28.884418] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-21T17:24:29.370174] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:24:29.370537] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-21T17:24:29.408475] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T17:24:29.413596] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-21T17:24:29.723969] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T17:24:29.732233] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-21T17:24:29.739311] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T17:24:29.741895] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-21T17:24:30.473519] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-21T17:24:30.478350] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-21T17:24:30.683187] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-21T17:24:30.686882] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-21T17:24:30.924969] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T17:24:30.933567] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-21T17:24:31.440904] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-21T17:24:31.445504] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-21T17:24:31.478145] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-21T17:24:31.489383] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-21T17:24:31.576389] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T17:24:32.127747] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-21T17:24:32.151009] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-21T17:24:32.362343] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T17:24:32.951052] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-21T17:24:33.343409] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-21T17:24:33.751205] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-21T17:24:33.757475] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-21T17:24:33.776109] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-21T17:24:34.551069] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-21T17:24:35.286586] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T17:24:35.350983] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-21T17:24:36.151063] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-21T17:24:36.501184] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T17:24:36.951063] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-21T17:24:37.121766] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-21T17:24:37.158816] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T17:24:37.751062] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-21T17:24:38.280496] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T17:24:38.551004] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-21T17:24:38.690582] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-21T17:24:39.351036] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-21T17:24:40.151039] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-21T17:24:40.635837] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T17:24:40.951058] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-21T17:24:41.080945] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-21T17:24:41.297938] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-10-21T17:24:41.751079] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-21T17:24:42.157067] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-21T17:24:42.551052] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-21T17:24:42.896715] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-21T17:24:43.351097] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-21T17:24:43.966488] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-21T17:24:44.151026] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-21T17:24:44.951023] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-21T17:24:45.219241] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T17:24:45.751025] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-21T17:24:45.907977] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-21T17:24:46.260276] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-21T17:24:46.551072] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-21T17:24:46.881223] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T17:24:47.351003] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-21T17:24:47.582520] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-21T17:24:48.083667] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-21T17:24:48.085551] [INFO ] [REMOTE ] AZO: Full fetch complete (15868 records). [2025-10-21T17:24:48.085619] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-21T17:24:48.086084] [FATAL] [VALIDATOR ] AZO: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:24:48.086170] [FATAL] [MAIN ] AZO: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:24:48.086212] [WARN ] [MAIN ] AZO: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:24:48.086252] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-21T17:24:48.086339] [DEBUG] [LOCAL ] AZO: No primary data file found to delete. [2025-10-21T17:24:48.086401] [INFO ] [LOCAL ] AZO: Starting deletion of derivative data. [2025-10-21T17:24:48.086693] [DEBUG] [LOCAL ] AZO: Deleted derivative data file. [2025-10-21T17:24:48.086800] [INFO ] [MAIN ] Update Progress: 202/2366 symbols completed. AZO took 23.0s. Estimated remaining: 4h 24m 58s. Rate: 8.2 symbols/min [2025-10-21T17:24:48.156201] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-21T17:24:48.257902] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:24:48.309879] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-21T17:24:48.310236] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-10-21T17:24:48.486227] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:24:48.486429] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-21T17:24:48.486497] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-21T17:24:48.487060] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-21T17:24:48.487118] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-21T17:24:48.829518] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:24:48.950993] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-21T17:24:49.573785] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-21T17:24:49.579385] [INFO ] [REMOTE ] AYI: Full fetch complete (36898 records). [2025-10-21T17:24:49.579490] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-21T17:24:49.753225] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-21T17:24:49.959592] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-21T17:24:49.959689] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-21T17:24:49.960167] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-21T17:24:49.960207] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-21T17:24:49.960966] [DEBUG] [LOCAL ] AYI: Trimmed 36898 records to 24331 (keeping 200 days of data) [2025-10-21T17:24:50.108909] [DEBUG] [LOCAL ] AYI: Primary data saved (24331 records). [2025-10-21T17:24:50.109024] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-21T17:24:50.109096] [INFO ] [MAIN ] Update Progress: 203/2366 symbols completed. AYI took 25.0s. Estimated remaining: 4h 23m 54s. Rate: 8.2 symbols/min [2025-10-21T17:24:50.275357] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:24:50.275494] [DEBUG] [LOCAL ] BAC: No existing data file found in primary storage. [2025-10-21T17:24:50.275530] [WARN ] [MAIN ] BAC: No existing data found, performing full refresh instead. [2025-10-21T17:24:50.275634] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-21T17:24:50.275726] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-21T17:24:50.275774] [DEBUG] [LOCAL ] BAC: No primary data file found to delete. [2025-10-21T17:24:50.275806] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-21T17:24:50.556176] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-21T17:24:50.626284] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:24:51.350997] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-21T17:24:51.628574] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-10-21T17:24:51.683263] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T17:24:51.688039] [INFO ] [REMOTE ] AZZ: Full fetch complete (32137 records). [2025-10-21T17:24:51.688115] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-21T17:24:52.055399] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-21T17:24:52.055471] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-21T17:24:52.055875] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-21T17:24:52.055935] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-21T17:24:52.056600] [DEBUG] [LOCAL ] AZZ: Trimmed 32137 records to 22911 (keeping 200 days of data) [2025-10-21T17:24:52.154471] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-21T17:24:52.196197] [DEBUG] [LOCAL ] AZZ: Primary data saved (22911 records). [2025-10-21T17:24:52.196304] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-21T17:24:52.196375] [INFO ] [MAIN ] Update Progress: 204/2366 symbols completed. AZZ took 27.1s. Estimated remaining: 4h 22m 51s. Rate: 8.2 symbols/min [2025-10-21T17:24:52.365400] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:24:52.395694] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-10-21T17:24:52.449720] [DEBUG] [LOCAL ] BAH: Loaded 51683 existing records from primary storage. [2025-10-21T17:24:52.450030] [INFO ] [MAIN ] BAH: Loaded 51683 existing records. [2025-10-21T17:24:52.624067] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:24:52.624233] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-21T17:24:52.624278] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-21T17:24:52.624570] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-21T17:24:52.624607] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-21T17:24:52.955308] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-21T17:24:52.979195] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:24:53.762921] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-21T17:24:53.765528] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-21T17:24:54.550994] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-21T17:24:54.651729] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-21T17:24:55.351071] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-21T17:24:55.543283] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-21T17:24:55.726507] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-21T17:24:56.151047] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-21T17:24:56.489190] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-21T17:24:56.951167] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-21T17:24:57.751342] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-21T17:24:57.752585] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T17:24:57.887999] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-21T17:24:58.551014] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-21T17:24:59.351036] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-21T17:24:59.417181] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-21T17:25:00.117112] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-21T17:25:00.151147] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-21T17:25:00.309295] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T17:25:00.951019] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-21T17:25:01.756745] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-21T17:25:01.762830] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-21T17:25:02.551031] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-21T17:25:02.837342] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-21T17:25:03.074595] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-21T17:25:03.351043] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-21T17:25:04.151021] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-21T17:25:04.292708] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T17:25:04.301683] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-10-21T17:25:04.301821] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-21T17:25:04.720007] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-21T17:25:04.730500] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-21T17:25:04.749460] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-21T17:25:04.749623] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-21T17:25:04.752329] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (3.00 seconds). [2025-10-21T17:25:04.764228] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 53790 (keeping 200 days of data) [2025-10-21T17:25:04.970799] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-21T17:25:05.091065] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-10-21T17:25:05.091316] [INFO ] [MAIN ] BA: Full history saved. [2025-10-21T17:25:05.091421] [INFO ] [MAIN ] Update Progress: 205/2366 symbols completed. BA took 36.6s. Estimated remaining: 4h 23m 43s. Rate: 8.2 symbols/min [2025-10-21T17:25:05.262593] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:25:05.299560] [DEBUG] [LOCAL ] BAK: Loaded 39438 existing records from primary storage. [2025-10-21T17:25:05.300176] [INFO ] [MAIN ] BAK: Loaded 39438 existing records. [2025-10-21T17:25:05.446015] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.89 seconds). [2025-10-21T17:25:05.541668] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:25:05.541844] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-21T17:25:05.541891] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-21T17:25:05.542107] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-21T17:25:05.542175] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-21T17:25:05.757713] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-21T17:25:05.926885] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:25:05.956772] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T17:25:06.551071] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-21T17:25:07.351026] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-21T17:25:07.501235] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-21T17:25:08.151010] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-21T17:25:08.260962] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-21T17:25:08.337806] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T17:25:08.907790] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T17:25:08.950990] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-21T17:25:09.751023] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-21T17:25:10.419717] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-21T17:25:10.551031] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-21T17:25:11.337878] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T17:25:11.350979] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-21T17:25:12.131760] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (3.18 seconds). [2025-10-21T17:25:12.151025] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-21T17:25:12.921582] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T17:25:12.951009] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-21T17:25:13.151020] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-21T17:25:13.751014] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-21T17:25:14.550991] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-21T17:25:14.863734] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-21T17:25:15.138301] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-21T17:25:15.334342] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T17:25:15.351027] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-21T17:25:16.151022] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-21T17:25:16.880906] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-21T17:25:16.951014] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-21T17:25:17.525951] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T17:25:17.751027] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-21T17:25:18.127851] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-10-21T17:25:18.551014] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-21T17:25:18.948498] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T17:25:19.351028] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-21T17:25:19.418425] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T17:25:20.151016] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-21T17:25:20.934686] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T17:25:20.950971] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-21T17:25:21.331801] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.78 seconds). [2025-10-21T17:25:21.340194] [INFO ] [REMOTE ] BABA: Full fetch complete (78000 records). [2025-10-21T17:25:21.340328] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-21T17:25:21.741073] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-21T17:25:21.741163] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-21T17:25:21.741969] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-21T17:25:21.742033] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-21T17:25:21.743818] [DEBUG] [LOCAL ] BABA: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-21T17:25:21.802525] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-21T17:25:22.072575] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-10-21T17:25:22.072724] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-21T17:25:22.073307] [INFO ] [MAIN ] Update Progress: 206/2366 symbols completed. BABA took 34.0s. Estimated remaining: 4h 25m 17s. Rate: 8.1 symbols/min [2025-10-21T17:25:22.241463] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:25:22.289989] [DEBUG] [LOCAL ] BALL: Loaded 51927 existing records from primary storage. [2025-10-21T17:25:22.290411] [INFO ] [MAIN ] BALL: Loaded 51927 existing records. [2025-10-21T17:25:22.469417] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:25:22.469769] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-21T17:25:22.469893] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-21T17:25:22.470808] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-21T17:25:22.470867] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-21T17:25:22.815246] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-21T17:25:22.889802] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:25:22.890316] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-21T17:25:22.914079] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T17:25:22.922452] [INFO ] [REMOTE ] BAH: Full fetch complete (75212 records). [2025-10-21T17:25:22.922578] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-21T17:25:23.310400] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-21T17:25:23.310580] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-21T17:25:23.311410] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-21T17:25:23.311486] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-21T17:25:23.312947] [DEBUG] [LOCAL ] BAH: Trimmed 75212 records to 51653 (keeping 200 days of data) [2025-10-21T17:25:23.366966] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-21T17:25:23.446064] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T17:25:23.657807] [DEBUG] [LOCAL ] BAH: Primary data saved (51653 records). [2025-10-21T17:25:23.657947] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-21T17:25:23.658026] [INFO ] [MAIN ] Update Progress: 207/2366 symbols completed. BAH took 31.5s. Estimated remaining: 4h 24m 9s. Rate: 8.2 symbols/min [2025-10-21T17:25:23.839242] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:25:23.839406] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-21T17:25:23.839443] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-21T17:25:23.839561] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-21T17:25:23.839602] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-21T17:25:23.839699] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-21T17:25:23.839764] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-21T17:25:24.156914] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-21T17:25:24.200811] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:25:24.764677] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T17:25:24.951098] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-21T17:25:25.426996] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T17:25:25.751139] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-21T17:25:25.951302] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.58 seconds). [2025-10-21T17:25:25.960000] [INFO ] [REMOTE ] BAC: Full fetch complete (77988 records). [2025-10-21T17:25:25.960139] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-21T17:25:26.435805] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-21T17:25:26.437057] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T17:25:26.437164] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-21T17:25:26.444075] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-21T17:25:26.444997] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-21T17:25:26.449745] [DEBUG] [LOCAL ] BAC: Trimmed 77988 records to 53808 (keeping 200 days of data) [2025-10-21T17:25:26.572728] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-21T17:25:26.891447] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-10-21T17:25:26.891612] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-21T17:25:26.891761] [INFO ] [MAIN ] Update Progress: 208/2366 symbols completed. BAC took 36.8s. Estimated remaining: 4h 23m 19s. Rate: 8.2 symbols/min [2025-10-21T17:25:27.151957] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:25:27.154298] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T17:25:27.189400] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T17:25:27.241213] [DEBUG] [LOCAL ] BAM: Loaded 52103 existing records from primary storage. [2025-10-21T17:25:27.241580] [INFO ] [MAIN ] BAM: Loaded 52103 existing records. [2025-10-21T17:25:27.351060] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-21T17:25:27.437524] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:25:27.437837] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-21T17:25:27.437888] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-21T17:25:27.438317] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-21T17:25:27.438375] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-21T17:25:27.821144] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:25:28.151051] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-21T17:25:28.951004] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-21T17:25:28.986504] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-21T17:25:28.992878] [INFO ] [REMOTE ] BAK: Full fetch complete (56859 records). [2025-10-21T17:25:28.992982] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-21T17:25:29.381970] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-21T17:25:29.382070] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-21T17:25:29.382803] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-21T17:25:29.382872] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-21T17:25:29.384779] [DEBUG] [LOCAL ] BAK: Trimmed 56859 records to 39479 (keeping 200 days of data) [2025-10-21T17:25:29.596662] [DEBUG] [LOCAL ] BAK: Primary data saved (39479 records). [2025-10-21T17:25:29.596831] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-21T17:25:29.596916] [INFO ] [MAIN ] Update Progress: 209/2366 symbols completed. BAK took 24.5s. Estimated remaining: 4h 22m 25s. Rate: 8.2 symbols/min [2025-10-21T17:25:29.762969] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-21T17:25:29.765400] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:25:29.818317] [DEBUG] [LOCAL ] BANC: Loaded 51387 existing records from primary storage. [2025-10-21T17:25:29.818685] [INFO ] [MAIN ] BANC: Loaded 51387 existing records. [2025-10-21T17:25:30.000958] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:25:30.001332] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-21T17:25:30.001389] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-21T17:25:30.026291] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-21T17:25:30.027721] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T17:25:30.027784] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-21T17:25:30.401778] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:25:30.551068] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-21T17:25:30.559028] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-21T17:25:30.589522] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T17:25:31.351029] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-21T17:25:31.930247] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-21T17:25:32.151032] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-21T17:25:32.202436] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T17:25:32.951062] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-21T17:25:33.652981] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-21T17:25:33.751025] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-21T17:25:34.551084] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-21T17:25:34.789360] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T17:25:35.155441] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T17:25:35.351054] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-21T17:25:36.034831] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T17:25:36.150993] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-21T17:25:36.384844] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T17:25:36.951055] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-21T17:25:37.751012] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-21T17:25:37.999011] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-21T17:25:38.205831] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T17:25:38.240384] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-21T17:25:38.551135] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-21T17:25:39.351052] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-21T17:25:40.151014] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-21T17:25:40.208607] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T17:25:40.917457] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-21T17:25:40.951039] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-21T17:25:41.169726] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T17:25:41.751028] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-21T17:25:42.305292] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T17:25:42.551086] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-21T17:25:43.351055] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-21T17:25:43.552715] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T17:25:44.151053] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-21T17:25:44.269450] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T17:25:44.767312] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-21T17:25:44.950995] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-21T17:25:45.280230] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T17:25:45.751064] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-21T17:25:46.556259] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-21T17:25:46.569807] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T17:25:46.587362] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-21T17:25:47.351053] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-21T17:25:48.151030] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-21T17:25:48.552492] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T17:25:48.555262] [INFO ] [REMOTE ] BALY: Full fetch complete (16135 records). [2025-10-21T17:25:48.555332] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-21T17:25:48.738936] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T17:25:48.739231] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:25:48.739440] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:25:48.739520] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-21T17:25:48.739604] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-21T17:25:48.739756] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-21T17:25:48.739814] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-21T17:25:48.739872] [INFO ] [MAIN ] Update Progress: 210/2366 symbols completed. BALY took 25.1s. Estimated remaining: 4h 24m 19s. Rate: 8.2 symbols/min [2025-10-21T17:25:48.939502] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:25:48.941745] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-21T17:25:48.952378] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-21T17:25:48.977318] [DEBUG] [LOCAL ] BAP: Loaded 25879 existing records from primary storage. [2025-10-21T17:25:48.977564] [INFO ] [MAIN ] BAP: Loaded 25879 existing records. [2025-10-21T17:25:49.154634] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:25:49.154906] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-21T17:25:49.154976] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-21T17:25:49.155161] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-21T17:25:49.155201] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-21T17:25:49.502595] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:25:49.751029] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-21T17:25:50.553197] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-21T17:25:50.566557] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-21T17:25:50.650539] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T17:25:51.072749] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T17:25:51.351046] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-21T17:25:52.150995] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-21T17:25:52.282681] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T17:25:52.535182] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T17:25:52.951016] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-21T17:25:53.750993] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-21T17:25:54.023326] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T17:25:54.463703] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T17:25:54.551015] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-21T17:25:55.051877] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T17:25:55.351030] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-21T17:25:56.151017] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-21T17:25:56.319846] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T17:25:56.863516] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T17:25:56.951055] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-21T17:25:57.751020] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-21T17:25:58.184472] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T17:25:58.192866] [INFO ] [REMOTE ] BALL: Full fetch complete (75631 records). [2025-10-21T17:25:58.193011] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-21T17:25:58.564487] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-21T17:25:58.572593] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-21T17:25:58.671280] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-21T17:25:58.671398] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-21T17:25:58.672326] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-21T17:25:58.672410] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-21T17:25:58.673979] [DEBUG] [LOCAL ] BALL: Trimmed 75631 records to 51939 (keeping 200 days of data) [2025-10-21T17:25:58.996273] [DEBUG] [LOCAL ] BALL: Primary data saved (51939 records). [2025-10-21T17:25:58.996528] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-21T17:25:58.997214] [INFO ] [MAIN ] Update Progress: 211/2366 symbols completed. BALL took 36.9s. Estimated remaining: 4h 24m 41s. Rate: 8.1 symbols/min [2025-10-21T17:25:59.144860] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T17:25:59.222320] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:25:59.263710] [DEBUG] [LOCAL ] BARK: Loaded 38200 existing records from primary storage. [2025-10-21T17:25:59.264003] [INFO ] [MAIN ] BARK: Loaded 38200 existing records. [2025-10-21T17:25:59.356155] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-21T17:25:59.446316] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:25:59.446541] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-21T17:25:59.446589] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-21T17:25:59.446884] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-21T17:25:59.446939] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-21T17:25:59.828462] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:26:00.150996] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-21T17:26:00.488556] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-21T17:26:00.591874] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-21T17:26:00.600262] [INFO ] [REMOTE ] BANC: Full fetch complete (74596 records). [2025-10-21T17:26:00.600412] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-21T17:26:00.951489] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-21T17:26:00.993497] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-21T17:26:00.993625] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-21T17:26:00.994430] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-21T17:26:00.994479] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-21T17:26:00.995850] [DEBUG] [LOCAL ] BANC: Trimmed 74596 records to 51384 (keeping 200 days of data) [2025-10-21T17:26:01.305044] [DEBUG] [LOCAL ] BANC: Primary data saved (51384 records). [2025-10-21T17:26:01.305209] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-21T17:26:01.305298] [INFO ] [MAIN ] Update Progress: 212/2366 symbols completed. BANC took 31.7s. Estimated remaining: 4h 23m 42s. Rate: 8.2 symbols/min [2025-10-21T17:26:01.485785] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:26:01.538104] [DEBUG] [LOCAL ] BAX: Loaded 53537 existing records from primary storage. [2025-10-21T17:26:01.538552] [INFO ] [MAIN ] BAX: Loaded 53537 existing records. [2025-10-21T17:26:01.737028] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:26:01.737354] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-21T17:26:01.737433] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-21T17:26:01.737870] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-21T17:26:01.738008] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-21T17:26:01.759107] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-21T17:26:02.101218] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-21T17:26:02.169711] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:26:02.297439] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T17:26:02.551060] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-21T17:26:03.348922] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T17:26:03.356687] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-21T17:26:04.151083] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-21T17:26:04.395902] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T17:26:04.598582] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T17:26:04.951008] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-21T17:26:05.750983] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-21T17:26:06.052729] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T17:26:06.426210] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T17:26:06.551088] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-21T17:26:07.047325] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T17:26:07.351012] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-21T17:26:08.151057] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-21T17:26:08.545978] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T17:26:08.554102] [INFO ] [REMOTE ] BAM: Full fetch complete (75181 records). [2025-10-21T17:26:08.554212] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-21T17:26:08.691916] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T17:26:08.729223] [INFO ] [REMOTE ] BAP: Full fetch complete (37413 records). [2025-10-21T17:26:08.730423] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-21T17:26:08.958417] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-21T17:26:09.232256] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-21T17:26:09.237512] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-21T17:26:09.245219] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-21T17:26:09.261387] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-21T17:26:09.312111] [DEBUG] [LOCAL ] BAM: Trimmed 75181 records to 52090 (keeping 200 days of data) [2025-10-21T17:26:09.420107] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-21T17:26:09.446378] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-21T17:26:09.446807] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-21T17:26:09.448044] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-21T17:26:09.453587] [DEBUG] [LOCAL ] BAP: Trimmed 37413 records to 25766 (keeping 200 days of data) [2025-10-21T17:26:09.638363] [DEBUG] [LOCAL ] BAP: Primary data saved (25766 records). [2025-10-21T17:26:09.641466] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-21T17:26:09.712003] [INFO ] [MAIN ] Update Progress: 213/2366 symbols completed. BAP took 21.0s. Estimated remaining: 4h 23m 46s. Rate: 8.2 symbols/min [2025-10-21T17:26:09.759093] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T17:26:09.844767] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-21T17:26:10.027106] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:26:10.032933] [DEBUG] [LOCAL ] BB: No existing data file found in primary storage. [2025-10-21T17:26:10.033280] [WARN ] [MAIN ] BB: No existing data found, performing full refresh instead. [2025-10-21T17:26:10.041676] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-21T17:26:10.042764] [DEBUG] [LOCAL ] BAM: Primary data saved (52090 records). [2025-10-21T17:26:10.042853] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-21T17:26:10.043005] [INFO ] [MAIN ] Update Progress: 214/2366 symbols completed. BAM took 43.2s. Estimated remaining: 4h 22m 28s. Rate: 8.2 symbols/min [2025-10-21T17:26:10.042917] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-21T17:26:10.109011] [DEBUG] [LOCAL ] BB: No primary data file found to delete. [2025-10-21T17:26:10.120687] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-21T17:26:10.366195] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:26:10.600034] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:26:10.600482] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-21T17:26:10.622595] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-21T17:26:10.623077] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-21T17:26:10.827342] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:26:10.829160] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-21T17:26:10.829246] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-21T17:26:10.838732] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-21T17:26:10.839608] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-21T17:26:10.839704] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-21T17:26:11.177528] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T17:26:11.238047] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:26:11.351004] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-21T17:26:12.151078] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-21T17:26:12.530380] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T17:26:12.709307] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-21T17:26:12.951036] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-21T17:26:13.696513] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T17:26:13.751031] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-21T17:26:14.551072] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-21T17:26:15.351081] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-21T17:26:15.563068] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-21T17:26:15.778142] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-21T17:26:16.151065] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-21T17:26:16.466026] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T17:26:16.718395] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T17:26:16.951038] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-21T17:26:17.751017] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-21T17:26:18.551062] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-21T17:26:18.631745] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-21T17:26:18.897709] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-21T17:26:19.287481] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T17:26:19.351002] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-21T17:26:20.151034] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-21T17:26:20.568947] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-21T17:26:20.716796] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T17:26:20.951104] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-21T17:26:21.751084] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-21T17:26:22.551005] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-21T17:26:22.795331] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-21T17:26:23.076874] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-21T17:26:23.351009] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-21T17:26:23.448026] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T17:26:24.002812] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T17:26:24.151094] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-21T17:26:24.951057] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-21T17:26:25.751018] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-21T17:26:26.069217] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-21T17:26:26.551082] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-21T17:26:26.861502] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T17:26:27.351001] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-21T17:26:28.197704] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T17:26:28.209165] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-21T17:26:28.983313] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T17:26:28.994083] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-21T17:26:30.556600] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (7.21 seconds). [2025-10-21T17:26:30.568410] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-21T17:26:31.255746] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-21T17:26:31.268400] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-21T17:26:32.169383] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (6.42 seconds). [2025-10-21T17:26:32.176626] [INFO ] [REMOTE ] BARK: Full fetch complete (56323 records). [2025-10-21T17:26:32.176839] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-21T17:26:32.574122] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-21T17:26:32.574206] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-21T17:26:32.574863] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-21T17:26:32.574927] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-21T17:26:32.576103] [DEBUG] [LOCAL ] BARK: Trimmed 56323 records to 38230 (keeping 200 days of data) [2025-10-21T17:26:32.789819] [DEBUG] [LOCAL ] BARK: Primary data saved (38230 records). [2025-10-21T17:26:32.789950] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-21T17:26:32.790025] [INFO ] [MAIN ] Update Progress: 215/2366 symbols completed. BARK took 33.8s. Estimated remaining: 4h 24m 55s. Rate: 8.1 symbols/min [2025-10-21T17:26:32.966628] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:26:33.006774] [DEBUG] [LOCAL ] BBAR: Loaded 42660 existing records from primary storage. [2025-10-21T17:26:33.007146] [INFO ] [MAIN ] BBAR: Loaded 42660 existing records. [2025-10-21T17:26:33.190170] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:26:33.190560] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-21T17:26:33.190676] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-21T17:26:33.190908] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-21T17:26:33.190966] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-21T17:26:33.410487] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-10-21T17:26:33.493714] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-21T17:26:33.596935] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:26:33.597228] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-21T17:26:35.364452] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T17:26:35.373578] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-21T17:26:35.900853] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-21T17:26:35.911614] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-21T17:26:36.210234] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (8.00 seconds). [2025-10-21T17:26:36.221530] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-21T17:26:36.776983] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T17:26:36.785363] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-21T17:26:38.015962] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T17:26:38.024331] [INFO ] [REMOTE ] BAX: Full fetch complete (77618 records). [2025-10-21T17:26:38.024490] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-21T17:26:38.455451] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-21T17:26:38.455601] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-21T17:26:38.456987] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-21T17:26:38.457160] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-21T17:26:38.483497] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T17:26:38.481808] [DEBUG] [LOCAL ] BAX: Trimmed 77618 records to 53537 (keeping 200 days of data) [2025-10-21T17:26:38.492464] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-21T17:26:38.808347] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-21T17:26:38.869802] [DEBUG] [LOCAL ] BAX: Primary data saved (53537 records). [2025-10-21T17:26:38.870456] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-21T17:26:38.870285] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-21T17:26:38.871258] [INFO ] [MAIN ] Update Progress: 216/2366 symbols completed. BAX took 37.6s. Estimated remaining: 4h 24m 34s. Rate: 8.1 symbols/min [2025-10-21T17:26:39.046390] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:26:39.097185] [DEBUG] [LOCAL ] BBD: Loaded 53276 existing records from primary storage. [2025-10-21T17:26:39.097502] [INFO ] [MAIN ] BBD: Loaded 53276 existing records. [2025-10-21T17:26:39.277134] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:26:39.277365] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-21T17:26:39.277412] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-21T17:26:39.277639] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-21T17:26:39.277725] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-21T17:26:39.578613] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (8.31 seconds). [2025-10-21T17:26:39.619879] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-21T17:26:39.702787] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:26:39.703321] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-21T17:26:40.116553] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T17:26:40.125237] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-21T17:26:41.480160] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T17:26:41.490537] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-21T17:26:41.575032] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T17:26:41.583987] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-21T17:26:41.628756] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-21T17:26:41.686801] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-10-21T17:26:41.751035] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-21T17:26:42.551051] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-21T17:26:43.118811] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T17:26:43.247541] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T17:26:43.351014] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-21T17:26:43.837036] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-21T17:26:43.845195] [INFO ] [REMOTE ] BB: Full fetch complete (76979 records). [2025-10-21T17:26:43.845325] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-21T17:26:44.156141] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-21T17:26:44.236162] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-21T17:26:44.236244] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-21T17:26:44.237079] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-21T17:26:44.237147] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-21T17:26:44.238593] [DEBUG] [LOCAL ] BB: Trimmed 76979 records to 52882 (keeping 200 days of data) [2025-10-21T17:26:44.533685] [DEBUG] [LOCAL ] BB: Primary data saved (52882 records). [2025-10-21T17:26:44.533823] [INFO ] [MAIN ] BB: Full history saved. [2025-10-21T17:26:44.533894] [INFO ] [MAIN ] Update Progress: 217/2366 symbols completed. BB took 34.8s. Estimated remaining: 4h 24m 10s. Rate: 8.1 symbols/min [2025-10-21T17:26:44.702624] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:26:44.734541] [DEBUG] [LOCAL ] BBDC: Loaded 33048 existing records from primary storage. [2025-10-21T17:26:44.734908] [INFO ] [MAIN ] BBDC: Loaded 33048 existing records. [2025-10-21T17:26:44.913727] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:26:44.914201] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-21T17:26:44.914317] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-21T17:26:44.914577] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-21T17:26:44.914731] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-21T17:26:45.270638] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-21T17:26:45.378865] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:26:45.383020] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-21T17:26:45.382566] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-21T17:26:45.751040] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-21T17:26:45.883205] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T17:26:46.551004] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-21T17:26:46.714904] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T17:26:47.351059] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-21T17:26:47.569459] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T17:26:48.151051] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-21T17:26:48.655194] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T17:26:48.951076] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-21T17:26:49.751154] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-21T17:26:49.863444] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (3.31 seconds). [2025-10-21T17:26:49.874172] [INFO ] [REMOTE ] BBAI: Full fetch complete (78000 records). [2025-10-21T17:26:49.874459] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-21T17:26:50.282843] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-21T17:26:50.352561] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-21T17:26:50.352714] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-21T17:26:50.353733] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-21T17:26:50.353802] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-21T17:26:50.355544] [DEBUG] [LOCAL ] BBAI: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-21T17:26:50.563054] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-21T17:26:50.681766] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-10-21T17:26:50.681925] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-21T17:26:50.682010] [INFO ] [MAIN ] Update Progress: 218/2366 symbols completed. BBAI took 40.6s. Estimated remaining: 4h 23m 50s. Rate: 8.1 symbols/min [2025-10-21T17:26:50.865294] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:26:50.872484] [DEBUG] [LOCAL ] BBDO: Loaded 5012 existing records from primary storage. [2025-10-21T17:26:50.872681] [INFO ] [MAIN ] BBDO: Loaded 5012 existing records. [2025-10-21T17:26:51.060242] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:26:51.060725] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-21T17:26:51.060868] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-21T17:26:51.061193] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-21T17:26:51.061326] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-21T17:26:51.344471] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-21T17:26:51.404378] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-21T17:26:51.484620] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:26:51.508441] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T17:26:52.151068] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-21T17:26:52.397241] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-21T17:26:52.825253] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-21T17:26:52.951062] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-21T17:26:53.400808] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-21T17:26:53.751073] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-21T17:26:54.035145] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-21T17:26:54.551031] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-21T17:26:55.351068] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-21T17:26:55.504544] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T17:26:55.511953] [INFO ] [REMOTE ] BBAR: Full fetch complete (61317 records). [2025-10-21T17:26:55.512077] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-21T17:26:55.897221] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-21T17:26:55.897298] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-21T17:26:55.897977] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-21T17:26:55.898040] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-21T17:26:55.899304] [DEBUG] [LOCAL ] BBAR: Trimmed 61317 records to 42660 (keeping 200 days of data) [2025-10-21T17:26:56.157930] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-21T17:26:56.157785] [DEBUG] [LOCAL ] BBAR: Primary data saved (42660 records). [2025-10-21T17:26:56.158520] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-21T17:26:56.160136] [INFO ] [MAIN ] Update Progress: 219/2366 symbols completed. BBAR took 23.4s. Estimated remaining: 4h 23m 25s. Rate: 8.2 symbols/min [2025-10-21T17:26:56.334775] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:26:56.377027] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T17:26:56.402724] [DEBUG] [LOCAL ] BBN: Loaded 17924 existing records from primary storage. [2025-10-21T17:26:56.402959] [INFO ] [MAIN ] BBN: Loaded 17924 existing records. [2025-10-21T17:26:56.580709] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:26:56.581152] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-21T17:26:56.581230] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-21T17:26:56.581432] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-21T17:26:56.581492] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-21T17:26:56.928846] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T17:26:56.972351] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-21T17:26:56.941986] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T17:26:57.013440] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:26:57.751045] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-21T17:26:58.551006] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-21T17:26:58.879083] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-21T17:26:59.351040] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-21T17:26:59.944338] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-21T17:27:00.061202] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-21T17:27:00.151003] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-21T17:27:00.951052] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-21T17:27:01.235049] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (4.26 seconds). [2025-10-21T17:27:01.473055] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-21T17:27:01.751023] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-21T17:27:01.902626] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T17:27:02.551045] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-21T17:27:02.987891] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T17:27:03.351044] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-21T17:27:03.507607] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-21T17:27:04.151054] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-21T17:27:04.478910] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T17:27:04.951006] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-21T17:27:04.972841] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-21T17:27:05.751023] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-21T17:27:06.299021] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T17:27:06.305604] [INFO ] [REMOTE ] BBDC: Full fetch complete (48870 records). [2025-10-21T17:27:06.305763] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-21T17:27:06.556615] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-21T17:27:06.706549] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-21T17:27:06.706866] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-21T17:27:06.707495] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-21T17:27:06.707557] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-21T17:27:06.708534] [DEBUG] [LOCAL ] BBDC: Trimmed 48870 records to 32985 (keeping 200 days of data) [2025-10-21T17:27:06.899206] [DEBUG] [LOCAL ] BBDC: Primary data saved (32985 records). [2025-10-21T17:27:06.899352] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-21T17:27:06.899433] [INFO ] [MAIN ] Update Progress: 220/2366 symbols completed. BBDC took 22.4s. Estimated remaining: 4h 23m 50s. Rate: 8.1 symbols/min [2025-10-21T17:27:07.068092] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:27:07.068340] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-21T17:27:07.068381] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-21T17:27:07.068519] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-21T17:27:07.068559] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-21T17:27:07.068597] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-21T17:27:07.068627] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-21T17:27:07.355494] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-21T17:27:07.433495] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:27:07.458715] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-21T17:27:07.634469] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T17:27:08.151042] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-21T17:27:08.411396] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-21T17:27:08.610557] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-21T17:27:08.951045] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-21T17:27:09.402863] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-21T17:27:09.751073] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-21T17:27:10.362785] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-21T17:27:10.551028] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-10-21T17:27:10.750084] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:27:10.750401] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-10-21T17:27:10.750486] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:27:10.750561] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-21T17:27:10.750626] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:27:10.750718] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-21T17:27:10.750779] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-21T17:27:10.750815] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-21T17:27:10.750854] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-21T17:27:10.750898] [INFO ] [MAIN ] Update Progress: 221/2366 symbols completed. BBT took 3.9s. Estimated remaining: 4h 23m 9s. Rate: 8.2 symbols/min [2025-10-21T17:27:10.930933] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:27:10.939002] [DEBUG] [LOCAL ] BBU: Loaded 5727 existing records from primary storage. [2025-10-21T17:27:10.939201] [INFO ] [MAIN ] BBU: Loaded 5727 existing records. [2025-10-21T17:27:11.128025] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:27:11.128294] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-21T17:27:11.128353] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-21T17:27:11.128624] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-21T17:27:11.128855] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-21T17:27:11.356206] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-21T17:27:11.513108] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:27:12.005776] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-21T17:27:12.151004] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-21T17:27:12.726626] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T17:27:12.951051] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-21T17:27:13.751085] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-21T17:27:14.550998] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-21T17:27:14.715093] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T17:27:15.226288] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-21T17:27:15.351037] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-21T17:27:15.667303] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-21T17:27:15.677097] [INFO ] [REMOTE ] BBD: Full fetch complete (77271 records). [2025-10-21T17:27:15.677348] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-21T17:27:15.776379] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-21T17:27:16.147081] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-21T17:27:16.147203] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-21T17:27:16.148410] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-21T17:27:16.148484] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-21T17:27:16.150769] [DEBUG] [LOCAL ] BBD: Trimmed 77271 records to 53271 (keeping 200 days of data) [2025-10-21T17:27:16.151335] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-21T17:27:16.492844] [DEBUG] [LOCAL ] BBD: Primary data saved (53271 records). [2025-10-21T17:27:16.493040] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-21T17:27:16.493818] [INFO ] [MAIN ] Update Progress: 222/2366 symbols completed. BBD took 37.6s. Estimated remaining: 4h 22m 46s. Rate: 8.2 symbols/min [2025-10-21T17:27:16.679889] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:27:16.699685] [DEBUG] [LOCAL ] BBUC: Loaded 13935 existing records from primary storage. [2025-10-21T17:27:16.700064] [INFO ] [MAIN ] BBUC: Loaded 13935 existing records. [2025-10-21T17:27:16.893765] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:27:16.894125] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-21T17:27:16.894179] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-21T17:27:16.894453] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-21T17:27:16.894514] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-21T17:27:16.956403] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-21T17:27:16.994900] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-21T17:27:17.024255] [INFO ] [REMOTE ] BBDO: Full fetch complete (7473 records). [2025-10-21T17:27:17.029546] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-21T17:27:17.541944] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:27:17.757184] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-21T17:27:17.758504] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-21T17:27:17.758619] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-21T17:27:17.758982] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-21T17:27:17.759046] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-21T17:27:17.759755] [DEBUG] [LOCAL ] BBDO: Trimmed 7473 records to 4986 (keeping 200 days of data) [2025-10-21T17:27:17.801599] [DEBUG] [LOCAL ] BBDO: Primary data saved (4986 records). [2025-10-21T17:27:17.801868] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-21T17:27:17.802022] [INFO ] [MAIN ] Update Progress: 223/2366 symbols completed. BBDO took 27.1s. Estimated remaining: 4h 21m 40s. Rate: 8.2 symbols/min [2025-10-21T17:27:17.994015] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:27:18.050263] [DEBUG] [LOCAL ] BBVA: Loaded 49119 existing records from primary storage. [2025-10-21T17:27:18.050753] [INFO ] [MAIN ] BBVA: Loaded 49119 existing records. [2025-10-21T17:27:18.194361] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-21T17:27:18.260006] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:27:18.260387] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-21T17:27:18.260467] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-21T17:27:18.261503] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-21T17:27:18.261577] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-21T17:27:18.466633] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-21T17:27:18.556150] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-21T17:27:18.670773] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:27:19.351015] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-21T17:27:19.635018] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-21T17:27:19.911578] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-21T17:27:20.151031] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-21T17:27:20.951046] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-21T17:27:21.183558] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-21T17:27:21.732833] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T17:27:21.750981] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-21T17:27:22.551036] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-21T17:27:23.067573] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-21T17:27:23.351040] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-21T17:27:23.855481] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-21T17:27:24.151060] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-21T17:27:24.603225] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-21T17:27:24.951063] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-21T17:27:25.751048] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-21T17:27:26.125487] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-21T17:27:26.128530] [INFO ] [REMOTE ] BBN: Full fetch complete (25152 records). [2025-10-21T17:27:26.128629] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-21T17:27:26.502411] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-21T17:27:26.502661] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-21T17:27:26.503126] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-21T17:27:26.503204] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-21T17:27:26.504141] [DEBUG] [LOCAL ] BBN: Trimmed 25152 records to 17941 (keeping 200 days of data) [2025-10-21T17:27:26.557864] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-21T17:27:26.615004] [DEBUG] [LOCAL ] BBN: Primary data saved (17941 records). [2025-10-21T17:27:26.615146] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-21T17:27:26.615223] [INFO ] [MAIN ] Update Progress: 224/2366 symbols completed. BBN took 30.5s. Estimated remaining: 4h 21m 47s. Rate: 8.2 symbols/min [2025-10-21T17:27:26.739422] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T17:27:26.775362] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-21T17:27:26.837970] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:27:26.863468] [DEBUG] [LOCAL ] BBW: Loaded 27378 existing records from primary storage. [2025-10-21T17:27:26.863734] [INFO ] [MAIN ] BBW: Loaded 27378 existing records. [2025-10-21T17:27:27.051069] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:27:27.051263] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-21T17:27:27.051316] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-21T17:27:27.051518] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-21T17:27:27.051573] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-21T17:27:27.155962] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-21T17:27:27.356104] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-21T17:27:27.417726] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:27:27.854392] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-21T17:27:28.151040] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-21T17:27:28.874687] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-21T17:27:28.951015] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-21T17:27:29.482763] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-21T17:27:29.751041] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-21T17:27:30.550991] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-21T17:27:30.693312] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T17:27:31.350987] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-21T17:27:31.365533] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T17:27:32.151028] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-21T17:27:32.834693] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T17:27:32.951055] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-21T17:27:33.682028] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T17:27:33.684391] [INFO ] [REMOTE ] BBU: Full fetch complete (7492 records). [2025-10-21T17:27:33.684457] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-21T17:27:33.756125] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-21T17:27:34.061452] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-21T17:27:34.061573] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-21T17:27:34.062003] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-21T17:27:34.062129] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-21T17:27:34.062854] [DEBUG] [LOCAL ] BBU: Trimmed 7492 records to 5757 (keeping 200 days of data) [2025-10-21T17:27:34.099201] [DEBUG] [LOCAL ] BBU: Primary data saved (5757 records). [2025-10-21T17:27:34.111921] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-21T17:27:34.112619] [INFO ] [MAIN ] Update Progress: 225/2366 symbols completed. BBU took 23.4s. Estimated remaining: 4h 21m 41s. Rate: 8.2 symbols/min [2025-10-21T17:27:34.113162] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-21T17:27:34.291141] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:27:34.340167] [DEBUG] [LOCAL ] BBWI: Loaded 53584 existing records from primary storage. [2025-10-21T17:27:34.340480] [INFO ] [MAIN ] BBWI: Loaded 53584 existing records. [2025-10-21T17:27:34.515912] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:27:34.516242] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-21T17:27:34.516309] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-21T17:27:34.517449] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-21T17:27:34.517540] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-21T17:27:34.561110] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-21T17:27:34.646465] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-21T17:27:34.889589] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:27:35.351044] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-21T17:27:36.017409] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-21T17:27:36.151000] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-21T17:27:36.951012] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-21T17:27:37.081279] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-21T17:27:37.265257] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T17:27:37.751078] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-21T17:27:38.301230] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-21T17:27:38.551038] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-21T17:27:39.351347] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-21T17:27:39.354510] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-21T17:27:40.151080] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-21T17:27:40.313392] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T17:27:40.381700] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T17:27:40.951000] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-21T17:27:41.181177] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T17:27:41.751101] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-21T17:27:42.551014] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-21T17:27:42.632512] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T17:27:43.108327] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T17:27:43.128524] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T17:27:43.351039] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-21T17:27:44.151027] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-21T17:27:44.951004] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-21T17:27:45.131567] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T17:27:45.476844] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T17:27:45.480587] [INFO ] [REMOTE ] BBUC: Full fetch complete (19213 records). [2025-10-21T17:27:45.480705] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-21T17:27:45.758478] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-21T17:27:45.843362] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-21T17:27:45.843443] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-21T17:27:45.843841] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-21T17:27:45.843903] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-21T17:27:45.844494] [DEBUG] [LOCAL ] BBUC: Trimmed 19213 records to 13958 (keeping 200 days of data) [2025-10-21T17:27:45.925261] [DEBUG] [LOCAL ] BBUC: Primary data saved (13958 records). [2025-10-21T17:27:45.925396] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-21T17:27:45.925474] [INFO ] [MAIN ] Update Progress: 226/2366 symbols completed. BBUC took 29.4s. Estimated remaining: 4h 22m 16s. Rate: 8.2 symbols/min [2025-10-21T17:27:46.091898] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:27:46.141823] [DEBUG] [LOCAL ] BBY: Loaded 53436 existing records from primary storage. [2025-10-21T17:27:46.142151] [INFO ] [MAIN ] BBY: Loaded 53436 existing records. [2025-10-21T17:27:46.320201] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:27:46.320394] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-21T17:27:46.320455] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-21T17:27:46.321422] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-21T17:27:46.321493] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-21T17:27:46.559603] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-21T17:27:46.677850] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:27:46.951197] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-21T17:27:47.351032] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-21T17:27:47.445475] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:27:47.737318] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T17:27:48.151058] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-21T17:27:48.951039] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-21T17:27:49.192601] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T17:27:49.435505] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-21T17:27:49.751028] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-21T17:27:50.551023] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-21T17:27:51.073558] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-21T17:27:51.351078] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-21T17:27:52.151075] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-21T17:27:53.381334] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T17:27:53.387517] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-21T17:27:53.419782] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-21T17:27:53.751001] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-21T17:27:53.878857] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (4.13 seconds). [2025-10-21T17:27:54.550991] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-21T17:27:54.851914] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T17:27:55.351042] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-21T17:27:55.433922] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (4.88 seconds). [2025-10-21T17:27:55.496161] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T17:27:56.151046] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-21T17:27:56.891770] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-21T17:27:56.898433] [INFO ] [REMOTE ] BBW: Full fetch complete (39628 records). [2025-10-21T17:27:56.898557] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-21T17:27:56.968632] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-21T17:27:57.055212] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-21T17:27:57.320810] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-21T17:27:57.320887] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-21T17:27:57.321374] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-21T17:27:57.321417] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-21T17:27:57.322248] [DEBUG] [LOCAL ] BBW: Trimmed 39628 records to 27246 (keeping 200 days of data) [2025-10-21T17:27:57.492825] [DEBUG] [LOCAL ] BBW: Primary data saved (27246 records). [2025-10-21T17:27:57.492971] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-21T17:27:57.493052] [INFO ] [MAIN ] Update Progress: 227/2366 symbols completed. BBW took 30.9s. Estimated remaining: 4h 22m 49s. Rate: 8.1 symbols/min [2025-10-21T17:27:57.666636] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:27:57.712770] [DEBUG] [LOCAL ] BC: Loaded 43999 existing records from primary storage. [2025-10-21T17:27:57.713026] [INFO ] [MAIN ] BC: Loaded 43999 existing records. [2025-10-21T17:27:57.755596] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-21T17:27:57.897547] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:27:57.897807] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-21T17:27:57.897866] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-21T17:27:57.898608] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-21T17:27:57.898701] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-21T17:27:58.269787] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:27:58.290799] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-21T17:27:58.551008] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-21T17:27:58.684070] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T17:27:59.351013] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-21T17:27:59.829485] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-21T17:28:00.117476] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T17:28:00.150980] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-21T17:28:00.950986] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-21T17:28:01.040856] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T17:28:01.048509] [INFO ] [REMOTE ] BBVA: Full fetch complete (71884 records). [2025-10-21T17:28:01.048622] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-21T17:28:01.439744] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-21T17:28:01.439848] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-21T17:28:01.440597] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-21T17:28:01.440777] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-21T17:28:01.442113] [DEBUG] [LOCAL ] BBVA: Trimmed 71884 records to 49122 (keeping 200 days of data) [2025-10-21T17:28:01.741507] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T17:28:01.753383] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-21T17:28:01.761992] [DEBUG] [LOCAL ] BBVA: Primary data saved (49122 records). [2025-10-21T17:28:01.762074] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-21T17:28:01.762143] [INFO ] [MAIN ] Update Progress: 228/2366 symbols completed. BBVA took 44.0s. Estimated remaining: 4h 22m 12s. Rate: 8.2 symbols/min [2025-10-21T17:28:01.931946] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:28:01.964889] [DEBUG] [LOCAL ] BCAT: Loaded 34298 existing records from primary storage. [2025-10-21T17:28:01.965148] [INFO ] [MAIN ] BCAT: Loaded 34298 existing records. [2025-10-21T17:28:02.170393] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:28:02.170695] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-21T17:28:02.170774] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-21T17:28:02.171055] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-21T17:28:02.171129] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-21T17:28:02.523189] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:28:02.551041] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-21T17:28:02.905192] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-21T17:28:03.351005] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-21T17:28:03.641059] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T17:28:03.791045] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T17:28:04.151098] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-21T17:28:04.950994] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-21T17:28:05.106720] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-21T17:28:05.439795] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T17:28:05.751033] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-21T17:28:06.551090] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-21T17:28:06.806841] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T17:28:07.351068] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-21T17:28:07.734838] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-21T17:28:07.743508] [INFO ] [REMOTE ] BBWI: Full fetch complete (77631 records). [2025-10-21T17:28:07.743726] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-21T17:28:08.143711] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-21T17:28:08.143810] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-21T17:28:08.144609] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-21T17:28:08.144701] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-21T17:28:08.146183] [DEBUG] [LOCAL ] BBWI: Trimmed 77631 records to 53591 (keeping 200 days of data) [2025-10-21T17:28:08.198592] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-21T17:28:08.280803] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T17:28:08.497069] [DEBUG] [LOCAL ] BBWI: Primary data saved (53591 records). [2025-10-21T17:28:08.497198] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-21T17:28:08.497273] [INFO ] [MAIN ] Update Progress: 229/2366 symbols completed. BBWI took 34.4s. Estimated remaining: 4h 21m 59s. Rate: 8.2 symbols/min [2025-10-21T17:28:08.671087] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:28:08.699122] [DEBUG] [LOCAL ] BCC: Loaded 28671 existing records from primary storage. [2025-10-21T17:28:08.699433] [INFO ] [MAIN ] BCC: Loaded 28671 existing records. [2025-10-21T17:28:08.885072] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:28:08.885236] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-21T17:28:08.885284] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-21T17:28:08.885551] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-21T17:28:08.885613] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-21T17:28:08.955988] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-21T17:28:09.259392] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:28:09.288934] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T17:28:09.751008] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-21T17:28:09.904822] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T17:28:10.044883] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-21T17:28:10.551024] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-21T17:28:11.351030] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-21T17:28:11.371354] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T17:28:12.151022] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-21T17:28:12.364895] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T17:28:12.951024] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-21T17:28:13.022290] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-21T17:28:13.210240] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T17:28:13.751020] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-21T17:28:14.181357] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-21T17:28:14.551053] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-21T17:28:15.351034] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-21T17:28:15.877785] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-21T17:28:15.961393] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T17:28:16.151038] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-21T17:28:16.719342] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T17:28:16.951070] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-21T17:28:17.537215] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T17:28:17.751026] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-21T17:28:18.098731] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T17:28:18.551051] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-21T17:28:19.064343] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T17:28:19.351024] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-21T17:28:20.151014] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-21T17:28:20.377708] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T17:28:20.618487] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-21T17:28:20.951002] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-21T17:28:21.695854] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T17:28:21.751020] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-21T17:28:22.223551] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-21T17:28:22.551045] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-21T17:28:23.174894] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T17:28:23.351088] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-21T17:28:23.930913] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T17:28:24.151077] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-21T17:28:24.951078] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-21T17:28:25.053330] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-21T17:28:25.064971] [INFO ] [REMOTE ] BBY: Full fetch complete (77009 records). [2025-10-21T17:28:25.065194] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-21T17:28:25.066054] [FATAL] [VALIDATOR ] BBY: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:28:25.066188] [FATAL] [MAIN ] BBY: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:28:25.066244] [WARN ] [MAIN ] BBY: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:28:25.066314] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-21T17:28:25.066383] [DEBUG] [LOCAL ] BBY: No primary data file found to delete. [2025-10-21T17:28:25.066423] [INFO ] [LOCAL ] BBY: Starting deletion of derivative data. [2025-10-21T17:28:25.066578] [DEBUG] [LOCAL ] BBY: Deleted derivative data file. [2025-10-21T17:28:25.066707] [INFO ] [MAIN ] Update Progress: 230/2366 symbols completed. BBY took 39.1s. Estimated remaining: 4h 23m 17s. Rate: 8.1 symbols/min [2025-10-21T17:28:25.240252] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:28:25.262521] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T17:28:25.315419] [DEBUG] [LOCAL ] BCE: Loaded 52271 existing records from primary storage. [2025-10-21T17:28:25.315777] [INFO ] [MAIN ] BCE: Loaded 52271 existing records. [2025-10-21T17:28:25.493812] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:28:25.494045] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-21T17:28:25.494093] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-21T17:28:25.494283] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-21T17:28:25.494325] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-21T17:28:25.758897] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-21T17:28:25.849084] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:28:26.203333] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T17:28:26.551051] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-21T17:28:27.351070] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-21T17:28:27.386352] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-21T17:28:27.392881] [INFO ] [REMOTE ] BCAT: Full fetch complete (50067 records). [2025-10-21T17:28:27.393037] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-21T17:28:27.797807] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-21T17:28:27.797944] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-21T17:28:27.805014] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-21T17:28:27.817214] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T17:28:27.816370] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-21T17:28:27.826282] [DEBUG] [LOCAL ] BCAT: Trimmed 50067 records to 34272 (keeping 200 days of data) [2025-10-21T17:28:28.031415] [DEBUG] [LOCAL ] BCAT: Primary data saved (34272 records). [2025-10-21T17:28:28.031540] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-21T17:28:28.031613] [INFO ] [MAIN ] Update Progress: 231/2366 symbols completed. BCAT took 26.3s. Estimated remaining: 4h 22m 29s. Rate: 8.1 symbols/min [2025-10-21T17:28:28.156176] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-21T17:28:28.199955] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:28:28.228686] [DEBUG] [LOCAL ] BCH: Loaded 30410 existing records from primary storage. [2025-10-21T17:28:28.228949] [INFO ] [MAIN ] BCH: Loaded 30410 existing records. [2025-10-21T17:28:28.405943] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:28:28.406268] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-21T17:28:28.406316] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-21T17:28:28.406512] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-21T17:28:28.406567] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-21T17:28:28.756941] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:28:28.807304] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T17:28:28.951003] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-21T17:28:29.343458] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T17:28:29.751043] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-21T17:28:29.781924] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-21T17:28:30.551056] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-21T17:28:31.351011] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-21T17:28:31.663063] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-21T17:28:31.928513] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T17:28:31.934022] [INFO ] [REMOTE ] BCC: Full fetch complete (41595 records). [2025-10-21T17:28:31.934113] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-21T17:28:32.161169] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-21T17:28:32.357843] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-21T17:28:32.357934] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-21T17:28:32.358523] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-21T17:28:32.358586] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-21T17:28:32.359616] [DEBUG] [LOCAL ] BCC: Trimmed 41595 records to 28741 (keeping 200 days of data) [2025-10-21T17:28:32.534467] [DEBUG] [LOCAL ] BCC: Primary data saved (28741 records). [2025-10-21T17:28:32.534599] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-21T17:28:32.534706] [INFO ] [MAIN ] Update Progress: 232/2366 symbols completed. BCC took 24.0s. Estimated remaining: 4h 21m 55s. Rate: 8.1 symbols/min [2025-10-21T17:28:32.703188] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:28:32.725235] [DEBUG] [LOCAL ] BCO: Loaded 25219 existing records from primary storage. [2025-10-21T17:28:32.725492] [INFO ] [MAIN ] BCO: Loaded 25219 existing records. [2025-10-21T17:28:32.904925] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:28:32.905265] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-21T17:28:32.905409] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-21T17:28:32.905832] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-21T17:28:32.905890] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-21T17:28:32.960487] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-21T17:28:33.029618] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T17:28:33.068114] [INFO ] [REMOTE ] BC: Full fetch complete (63684 records). [2025-10-21T17:28:33.090789] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-21T17:28:33.536160] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:28:33.756677] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-21T17:28:33.757410] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-21T17:28:33.757736] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-21T17:28:33.759351] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-21T17:28:33.759685] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-21T17:28:33.760981] [DEBUG] [LOCAL ] BC: Trimmed 63684 records to 43912 (keeping 200 days of data) [2025-10-21T17:28:34.032815] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-21T17:28:34.077990] [DEBUG] [LOCAL ] BC: Primary data saved (43912 records). [2025-10-21T17:28:34.078126] [INFO ] [MAIN ] BC: Full history saved. [2025-10-21T17:28:34.078789] [INFO ] [MAIN ] Update Progress: 233/2366 symbols completed. BC took 36.6s. Estimated remaining: 4h 20m 54s. Rate: 8.2 symbols/min [2025-10-21T17:28:34.226617] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T17:28:34.280086] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:28:34.280253] [DEBUG] [LOCAL ] BCS: No existing data file found in primary storage. [2025-10-21T17:28:34.280289] [WARN ] [MAIN ] BCS: No existing data found, performing full refresh instead. [2025-10-21T17:28:34.280397] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-21T17:28:34.280437] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-21T17:28:34.280475] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-10-21T17:28:34.280508] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-21T17:28:34.560336] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-21T17:28:34.642101] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:28:34.803334] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T17:28:35.351035] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-21T17:28:35.900327] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T17:28:36.138903] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-21T17:28:36.150986] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-21T17:28:36.951022] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-21T17:28:37.445385] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T17:28:37.751049] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-21T17:28:37.976918] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T17:28:38.551020] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-21T17:28:39.158976] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T17:28:39.351019] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-21T17:28:40.079007] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T17:28:40.151007] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-21T17:28:40.599685] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T17:28:40.951073] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-21T17:28:41.751001] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-21T17:28:42.102515] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-21T17:28:42.556087] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-21T17:28:42.565916] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T17:28:42.877874] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-21T17:28:43.351062] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-21T17:28:43.975886] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T17:28:44.151008] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-21T17:28:44.951002] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-21T17:28:45.124740] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-21T17:28:45.746294] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T17:28:45.751047] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-21T17:28:46.551042] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-21T17:28:46.665516] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T17:28:47.351072] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-21T17:28:47.946031] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-21T17:28:47.972768] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T17:28:48.150996] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-21T17:28:48.951030] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-21T17:28:49.272065] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-21T17:28:49.751046] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-21T17:28:50.295233] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T17:28:50.538988] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-21T17:28:50.550976] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-21T17:28:51.350985] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-21T17:28:51.500982] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T17:28:51.836021] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-21T17:28:52.151021] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-21T17:28:52.951006] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-21T17:28:53.170253] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T17:28:53.373507] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T17:28:53.379074] [INFO ] [REMOTE ] BCH: Full fetch complete (41911 records). [2025-10-21T17:28:53.379185] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-21T17:28:53.752023] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-21T17:28:53.752274] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-21T17:28:53.752487] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-21T17:28:53.753609] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-21T17:28:53.753708] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-21T17:28:53.754729] [DEBUG] [LOCAL ] BCH: Trimmed 41911 records to 30256 (keeping 200 days of data) [2025-10-21T17:28:53.925790] [DEBUG] [LOCAL ] BCH: Primary data saved (30256 records). [2025-10-21T17:28:53.925914] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-21T17:28:53.925987] [INFO ] [MAIN ] Update Progress: 234/2366 symbols completed. BCH took 25.9s. Estimated remaining: 4h 22m 41s. Rate: 8.1 symbols/min [2025-10-21T17:28:54.102599] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:28:54.118303] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T17:28:54.148125] [DEBUG] [LOCAL ] BCSF: Loaded 28311 existing records from primary storage. [2025-10-21T17:28:54.148437] [INFO ] [MAIN ] BCSF: Loaded 28311 existing records. [2025-10-21T17:28:54.328256] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:28:54.328497] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-21T17:28:54.328550] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-21T17:28:54.328752] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-21T17:28:54.328808] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-21T17:28:54.556137] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-21T17:28:54.679964] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:28:55.351050] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-21T17:28:55.619804] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-21T17:28:56.151008] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-21T17:28:56.318626] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T17:28:56.548148] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T17:28:56.551226] [INFO ] [REMOTE ] BCO: Full fetch complete (36163 records). [2025-10-21T17:28:56.551297] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-21T17:28:56.920050] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-21T17:28:56.920192] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-21T17:28:56.920693] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-21T17:28:56.920752] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-21T17:28:56.921464] [DEBUG] [LOCAL ] BCO: Trimmed 36163 records to 25135 (keeping 200 days of data) [2025-10-21T17:28:56.972819] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-21T17:28:57.071701] [DEBUG] [LOCAL ] BCO: Primary data saved (25135 records). [2025-10-21T17:28:57.071829] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-21T17:28:57.071904] [INFO ] [MAIN ] Update Progress: 235/2366 symbols completed. BCO took 24.5s. Estimated remaining: 4h 21m 55s. Rate: 8.1 symbols/min [2025-10-21T17:28:57.239104] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:28:57.259419] [DEBUG] [LOCAL ] BCX: Loaded 22104 existing records from primary storage. [2025-10-21T17:28:57.259661] [INFO ] [MAIN ] BCX: Loaded 22104 existing records. [2025-10-21T17:28:57.433706] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:28:57.433912] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-21T17:28:57.433958] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-21T17:28:57.434177] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-21T17:28:57.434232] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-21T17:28:57.767579] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-21T17:28:57.800684] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:28:57.891894] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T17:28:58.551053] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-21T17:28:58.689872] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-21T17:28:58.760308] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T17:28:59.351033] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-21T17:29:00.151008] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-21T17:29:00.204506] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T17:29:00.754920] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T17:29:00.951011] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-21T17:29:01.751088] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-21T17:29:01.809760] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T17:29:01.841505] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T17:29:02.551030] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-21T17:29:03.350995] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-21T17:29:03.560803] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-21T17:29:03.761882] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-21T17:29:04.151006] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-21T17:29:04.473417] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T17:29:04.951022] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-21T17:29:05.751036] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-21T17:29:05.887233] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T17:29:05.896408] [INFO ] [REMOTE ] BCS: Full fetch complete (77522 records). [2025-10-21T17:29:05.896558] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-21T17:29:06.330878] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T17:29:06.329743] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-21T17:29:06.336998] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-21T17:29:06.337969] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-21T17:29:06.338380] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-21T17:29:06.339857] [DEBUG] [LOCAL ] BCS: Trimmed 77522 records to 53441 (keeping 200 days of data) [2025-10-21T17:29:06.552523] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-21T17:29:06.667393] [DEBUG] [LOCAL ] BCS: Primary data saved (53441 records). [2025-10-21T17:29:06.667538] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-21T17:29:06.667613] [INFO ] [MAIN ] Update Progress: 236/2366 symbols completed. BCS took 32.6s. Estimated remaining: 4h 22m 8s. Rate: 8.1 symbols/min [2025-10-21T17:29:06.845384] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:29:06.866626] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T17:29:06.893222] [DEBUG] [LOCAL ] BDC: Loaded 24267 existing records from primary storage. [2025-10-21T17:29:06.893485] [INFO ] [MAIN ] BDC: Loaded 24267 existing records. [2025-10-21T17:29:07.077128] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:29:07.077340] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-21T17:29:07.077388] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-21T17:29:07.077712] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-21T17:29:07.077769] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-21T17:29:07.352332] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-21T17:29:07.434206] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:29:07.514590] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T17:29:08.151015] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-21T17:29:08.451119] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T17:29:08.950990] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-21T17:29:09.047142] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T17:29:09.751029] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-21T17:29:10.551085] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-21T17:29:10.594403] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-21T17:29:10.830112] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T17:29:11.351075] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-21T17:29:11.789690] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T17:29:12.151015] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-21T17:29:12.950999] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-21T17:29:13.193915] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T17:29:13.202015] [INFO ] [REMOTE ] BCE: Full fetch complete (76118 records). [2025-10-21T17:29:13.202170] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-21T17:29:13.510943] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T17:29:13.620208] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-21T17:29:13.620291] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-21T17:29:13.621163] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-21T17:29:13.621228] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-21T17:29:13.622627] [DEBUG] [LOCAL ] BCE: Trimmed 76118 records to 52267 (keeping 200 days of data) [2025-10-21T17:29:13.793714] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-21T17:29:13.938915] [DEBUG] [LOCAL ] BCE: Primary data saved (52267 records). [2025-10-21T17:29:13.939099] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-21T17:29:13.939183] [INFO ] [MAIN ] Update Progress: 237/2366 symbols completed. BCE took 48.9s. Estimated remaining: 4h 21m 59s. Rate: 8.1 symbols/min [2025-10-21T17:29:14.277444] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-21T17:29:14.551099] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-21T17:29:14.901135] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T17:29:15.351009] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-21T17:29:15.649317] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T17:29:16.151018] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-21T17:29:16.510469] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T17:29:16.951050] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-21T17:29:17.283952] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-21T17:29:17.751048] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-21T17:29:18.180307] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-21T17:29:18.551093] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-21T17:29:18.892159] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T17:29:19.351036] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-21T17:29:19.614766] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-21T17:29:20.150973] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-21T17:29:20.521844] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-21T17:29:20.951020] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-21T17:29:21.001080] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-21T17:29:21.751046] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-21T17:29:22.311507] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T17:29:22.551044] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-21T17:29:22.688285] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-21T17:29:23.351029] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-21T17:29:23.639726] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-21T17:29:23.644092] [INFO ] [REMOTE ] BCX: Full fetch complete (33678 records). [2025-10-21T17:29:23.644173] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-21T17:29:24.016522] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-21T17:29:24.016596] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-21T17:29:24.017073] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-21T17:29:24.017133] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-21T17:29:24.017860] [DEBUG] [LOCAL ] BCX: Trimmed 33678 records to 22127 (keeping 200 days of data) [2025-10-21T17:29:24.143705] [DEBUG] [LOCAL ] BCX: Primary data saved (22127 records). [2025-10-21T17:29:24.143827] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-21T17:29:24.143900] [INFO ] [MAIN ] Update Progress: 238/2366 symbols completed. BCX took 27.1s. Estimated remaining: 4h 22m 17s. Rate: 8.1 symbols/min [2025-10-21T17:29:24.151004] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-21T17:29:24.791132] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-21T17:29:24.798566] [INFO ] [REMOTE ] BCSF: Full fetch complete (39760 records). [2025-10-21T17:29:24.798824] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-21T17:29:25.224502] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-21T17:29:25.224616] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-21T17:29:25.225321] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-21T17:29:25.225446] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-21T17:29:25.227320] [DEBUG] [LOCAL ] BCSF: Trimmed 39760 records to 28246 (keeping 200 days of data) [2025-10-21T17:29:25.402186] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T17:29:25.415385] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-21T17:29:25.423363] [DEBUG] [LOCAL ] BCSF: Primary data saved (28246 records). [2025-10-21T17:29:25.423678] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-21T17:29:25.423778] [INFO ] [MAIN ] Update Progress: 239/2366 symbols completed. BCSF took 31.5s. Estimated remaining: 4h 21m 15s. Rate: 8.1 symbols/min [2025-10-21T17:29:26.420483] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-21T17:29:26.425664] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-21T17:29:27.611952] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T17:29:27.615758] [INFO ] [REMOTE ] BDC: Full fetch complete (35799 records). [2025-10-21T17:29:27.615832] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-21T17:29:27.998633] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-21T17:29:27.998736] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-21T17:29:27.999426] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-21T17:29:27.999513] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-21T17:29:28.000739] [DEBUG] [LOCAL ] BDC: Trimmed 35799 records to 24193 (keeping 200 days of data) [2025-10-21T17:29:28.147819] [DEBUG] [LOCAL ] BDC: Primary data saved (24193 records). [2025-10-21T17:29:28.147937] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-21T17:29:28.148015] [INFO ] [MAIN ] Update Progress: 240/2366 symbols completed. BDC took 21.5s. Estimated remaining: 4h 20m 27s. Rate: 8.2 symbols/min [2025-10-21T17:29:28.750612] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:29:28.816256] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:29:28.825697] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:29:28.885972] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:29:28.886491] [DEBUG] [LOCAL ] BE: No existing data file found in primary storage. [2025-10-21T17:29:28.886543] [WARN ] [MAIN ] BE: No existing data found, performing full refresh instead. [2025-10-21T17:29:28.886631] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-21T17:29:28.886704] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-21T17:29:28.886755] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-10-21T17:29:28.886787] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-21T17:29:29.088071] [DEBUG] [LOCAL ] BDJ: Loaded 29444 existing records from primary storage. [2025-10-21T17:29:29.150953] [INFO ] [MAIN ] BDJ: Loaded 29444 existing records. [2025-10-21T17:29:29.259035] [DEBUG] [LOCAL ] BDN: Loaded 47639 existing records from primary storage. [2025-10-21T17:29:29.385128] [INFO ] [MAIN ] BDN: Loaded 47639 existing records. [2025-10-21T17:29:29.418503] [DEBUG] [LOCAL ] BDX: Loaded 52166 existing records from primary storage. [2025-10-21T17:29:29.523078] [INFO ] [MAIN ] BDX: Loaded 52166 existing records. [2025-10-21T17:29:29.644484] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:29:29.695157] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-21T17:29:29.700458] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-21T17:29:29.675673] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:29:29.733796] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-21T17:29:29.733905] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-21T17:29:29.739152] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-21T17:29:29.997774] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:29:30.020467] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-21T17:29:30.047239] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-21T17:29:30.058964] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:29:30.062785] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-21T17:29:30.062728] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-21T17:29:30.063022] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-21T17:29:30.063366] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-21T17:29:30.123069] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-21T17:29:30.216041] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-21T17:29:30.895624] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:29:30.930577] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-21T17:29:31.124813] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:29:31.141410] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-21T17:29:31.145354] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:29:31.145779] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-21T17:29:31.433553] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T17:29:31.443889] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-21T17:29:31.822123] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-21T17:29:31.828556] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-21T17:29:32.683698] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T17:29:32.694680] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-21T17:29:32.717872] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T17:29:32.725238] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-21T17:29:32.801720] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T17:29:32.951000] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-21T17:29:33.336497] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-21T17:29:33.751083] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-21T17:29:33.938936] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T17:29:34.219256] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T17:29:34.391579] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T17:29:34.551079] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-21T17:29:35.153788] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T17:29:35.351036] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-21T17:29:36.151010] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-21T17:29:36.410781] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T17:29:36.955140] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-21T17:29:36.960964] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T17:29:37.750999] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-21T17:29:37.992715] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T17:29:38.551002] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-21T17:29:38.688279] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T17:29:39.154849] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-21T17:29:39.351021] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-21T17:29:39.953695] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-21T17:29:40.151060] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-21T17:29:40.951012] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-21T17:29:41.148620] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T17:29:41.750988] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-21T17:29:42.322406] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-21T17:29:42.367458] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T17:29:42.551028] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-21T17:29:43.351047] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-21T17:29:43.539242] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T17:29:44.151051] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-21T17:29:44.280083] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T17:29:44.427065] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-21T17:29:44.951080] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-21T17:29:45.751072] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-21T17:29:46.108574] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-21T17:29:46.551002] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-21T17:29:46.817750] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T17:29:47.351108] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-21T17:29:47.686478] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T17:29:47.734971] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T17:29:48.151044] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-21T17:29:48.812090] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T17:29:48.951159] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-21T17:29:49.517096] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T17:29:49.751079] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-21T17:29:50.551052] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-21T17:29:51.361186] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-21T17:29:51.363833] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T17:29:51.585030] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-21T17:29:52.151001] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-21T17:29:52.609826] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-21T17:29:52.769893] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-21T17:29:52.951045] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-21T17:29:53.119741] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-21T17:29:53.751036] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-21T17:29:54.551079] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-21T17:29:54.817052] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T17:29:54.824911] [INFO ] [REMOTE ] BDN: Full fetch complete (69435 records). [2025-10-21T17:29:54.825097] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-21T17:29:55.224307] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-21T17:29:55.224424] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-21T17:29:55.225253] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-21T17:29:55.225317] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-21T17:29:55.226667] [DEBUG] [LOCAL ] BDN: Trimmed 69435 records to 47633 (keeping 200 days of data) [2025-10-21T17:29:55.398365] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-21T17:29:55.510804] [DEBUG] [LOCAL ] BDN: Primary data saved (47633 records). [2025-10-21T17:29:55.510947] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-21T17:29:55.511027] [INFO ] [MAIN ] Update Progress: 241/2366 symbols completed. BDN took 27.4s. Estimated remaining: 4h 23m 16s. Rate: 8.1 symbols/min [2025-10-21T17:29:55.693817] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:29:55.694168] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-21T17:29:55.694241] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-21T17:29:55.699614] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-21T17:29:55.708722] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-21T17:29:55.708955] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-21T17:29:55.709821] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T17:29:55.709328] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-21T17:29:56.092458] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:29:56.145471] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-21T17:29:56.152945] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-21T17:29:56.157553] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-21T17:29:56.169066] [INFO ] [REMOTE ] BDX: Full fetch complete (75493 records). [2025-10-21T17:29:56.169931] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-21T17:29:56.567227] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-21T17:29:56.567313] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-21T17:29:56.568138] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-21T17:29:56.568217] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-21T17:29:56.569609] [DEBUG] [LOCAL ] BDX: Trimmed 75493 records to 52157 (keeping 200 days of data) [2025-10-21T17:29:56.670594] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-21T17:29:56.905180] [DEBUG] [LOCAL ] BDX: Primary data saved (52157 records). [2025-10-21T17:29:56.905314] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-21T17:29:56.906791] [INFO ] [MAIN ] Update Progress: 242/2366 symbols completed. BDX took 28.7s. Estimated remaining: 4h 22m 16s. Rate: 8.1 symbols/min [2025-10-21T17:29:56.956240] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-21T17:29:57.089015] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:29:57.142844] [DEBUG] [LOCAL ] BEKE: Loaded 53198 existing records from primary storage. [2025-10-21T17:29:57.143203] [INFO ] [MAIN ] BEKE: Loaded 53198 existing records. [2025-10-21T17:29:57.325734] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:29:57.325958] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-21T17:29:57.326008] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-21T17:29:57.326195] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-21T17:29:57.326233] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-21T17:29:57.672229] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:29:57.750984] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-21T17:29:58.551047] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-21T17:29:59.351081] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-21T17:29:59.621181] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T17:29:59.651225] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-21T17:29:59.676672] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-21T17:29:59.677075] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T17:29:59.683084] [INFO ] [REMOTE ] BDJ: Full fetch complete (42807 records). [2025-10-21T17:29:59.683180] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-21T17:30:00.054840] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-21T17:30:00.054917] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-21T17:30:00.055510] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-21T17:30:00.055549] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-21T17:30:00.056474] [DEBUG] [LOCAL ] BDJ: Trimmed 42807 records to 29386 (keeping 200 days of data) [2025-10-21T17:30:00.154538] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-21T17:30:00.228850] [DEBUG] [LOCAL ] BDJ: Primary data saved (29386 records). [2025-10-21T17:30:00.228973] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-21T17:30:00.229050] [INFO ] [MAIN ] Update Progress: 243/2366 symbols completed. BDJ took 32.1s. Estimated remaining: 4h 21m 33s. Rate: 8.1 symbols/min [2025-10-21T17:30:00.394600] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:30:00.394825] [DEBUG] [LOCAL ] BEN: No existing data file found in primary storage. [2025-10-21T17:30:00.394865] [WARN ] [MAIN ] BEN: No existing data found, performing full refresh instead. [2025-10-21T17:30:00.394932] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-21T17:30:00.394968] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-21T17:30:00.395007] [DEBUG] [LOCAL ] BEN: No primary data file found to delete. [2025-10-21T17:30:00.395038] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-21T17:30:00.746946] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:30:00.950982] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-21T17:30:01.751045] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-21T17:30:02.254866] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-21T17:30:02.551082] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-21T17:30:02.717846] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T17:30:03.351022] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-21T17:30:03.808502] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-21T17:30:04.151016] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-21T17:30:04.363063] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.61 seconds). [2025-10-21T17:30:04.371045] [INFO ] [REMOTE ] BE: Full fetch complete (77426 records). [2025-10-21T17:30:04.371199] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-21T17:30:04.372050] [FATAL] [VALIDATOR ] BE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:30:04.372141] [FATAL] [MAIN ] BE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:30:04.372185] [WARN ] [MAIN ] BE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:30:04.372255] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-21T17:30:04.372321] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-10-21T17:30:04.372357] [INFO ] [LOCAL ] BE: Starting deletion of derivative data. [2025-10-21T17:30:04.372397] [DEBUG] [LOCAL ] BE: No derivative data file found to delete. [2025-10-21T17:30:04.372454] [INFO ] [MAIN ] Update Progress: 244/2366 symbols completed. BE took 36.2s. Estimated remaining: 4h 20m 57s. Rate: 8.1 symbols/min [2025-10-21T17:30:04.550300] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:30:04.588991] [DEBUG] [LOCAL ] BEP: Loaded 39006 existing records from primary storage. [2025-10-21T17:30:04.589304] [INFO ] [MAIN ] BEP: Loaded 39006 existing records. [2025-10-21T17:30:04.787382] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:30:04.787662] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-21T17:30:04.799138] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-21T17:30:04.819217] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-21T17:30:04.819371] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-21T17:30:04.913879] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-21T17:30:04.951415] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-21T17:30:05.206168] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:30:05.443610] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-21T17:30:05.750995] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-21T17:30:06.188295] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-21T17:30:06.551030] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-21T17:30:07.351005] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-21T17:30:07.709868] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-21T17:30:08.151081] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-21T17:30:08.183912] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T17:30:08.951080] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-21T17:30:09.078533] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T17:30:09.400026] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-21T17:30:09.556243] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T17:30:09.751082] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-21T17:30:10.551037] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-21T17:30:11.356132] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-21T17:30:11.368892] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T17:30:12.106493] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T17:30:12.151007] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-21T17:30:12.951048] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-21T17:30:13.247431] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T17:30:13.289938] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-21T17:30:13.751032] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-21T17:30:14.001486] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-21T17:30:14.077677] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-21T17:30:14.551102] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-21T17:30:15.351031] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-21T17:30:15.597484] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-21T17:30:15.981868] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-21T17:30:16.151030] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-21T17:30:16.951075] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-21T17:30:17.751023] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-21T17:30:18.031518] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T17:30:18.540748] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T17:30:18.550977] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-21T17:30:19.255383] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-21T17:30:19.351021] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-21T17:30:19.586550] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T17:30:20.151022] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-21T17:30:20.951055] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-21T17:30:21.054398] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T17:30:21.756182] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-21T17:30:21.790245] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T17:30:22.349262] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T17:30:22.494393] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T17:30:22.551015] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-21T17:30:23.147174] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-21T17:30:23.148043] [INFO ] [REMOTE ] BEDU: Full fetch complete (1319 records). [2025-10-21T17:30:23.148111] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-21T17:30:23.327832] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-21T17:30:23.328042] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:30:23.328130] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:30:23.328242] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-21T17:30:23.328337] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-21T17:30:23.328385] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-21T17:30:23.328428] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-21T17:30:23.328484] [INFO ] [MAIN ] Update Progress: 245/2366 symbols completed. BEDU took 27.8s. Estimated remaining: 4h 22m 30s. Rate: 8.1 symbols/min [2025-10-21T17:30:23.356967] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-21T17:30:23.510081] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:30:23.550526] [DEBUG] [LOCAL ] BEPC: Loaded 46428 existing records from primary storage. [2025-10-21T17:30:23.550902] [INFO ] [MAIN ] BEPC: Loaded 46428 existing records. [2025-10-21T17:30:23.736111] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:30:23.736397] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-21T17:30:23.736454] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-21T17:30:23.736912] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-21T17:30:23.736985] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-21T17:30:24.122415] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:30:24.151041] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-21T17:30:24.951051] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-21T17:30:25.182202] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T17:30:25.750995] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-21T17:30:25.869259] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T17:30:26.551056] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-21T17:30:27.001273] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-21T17:30:27.351034] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-21T17:30:27.501208] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T17:30:28.113140] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T17:30:28.151080] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-21T17:30:28.542153] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-21T17:30:28.951049] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-21T17:30:29.751090] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-21T17:30:29.900606] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T17:30:30.551016] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-21T17:30:30.860795] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T17:30:31.233159] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T17:30:31.242034] [INFO ] [REMOTE ] BEN: Full fetch complete (77070 records). [2025-10-21T17:30:31.242193] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-21T17:30:31.356274] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-21T17:30:31.651963] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-21T17:30:31.652064] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-21T17:30:31.652944] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-21T17:30:31.653007] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-21T17:30:31.654437] [DEBUG] [LOCAL ] BEN: Trimmed 77070 records to 53118 (keeping 200 days of data) [2025-10-21T17:30:31.981811] [DEBUG] [LOCAL ] BEN: Primary data saved (53118 records). [2025-10-21T17:30:31.981950] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-21T17:30:31.982023] [INFO ] [MAIN ] Update Progress: 246/2366 symbols completed. BEN took 31.8s. Estimated remaining: 4h 22m 33s. Rate: 8.1 symbols/min [2025-10-21T17:30:32.163451] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:30:32.160568] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-21T17:30:32.171519] [DEBUG] [LOCAL ] BEPH: Loaded 4950 existing records from primary storage. [2025-10-21T17:30:32.171764] [INFO ] [MAIN ] BEPH: Loaded 4950 existing records. [2025-10-21T17:30:32.382064] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T17:30:32.387202] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:30:32.395844] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-21T17:30:32.396055] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-21T17:30:32.396217] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-21T17:30:32.396256] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-21T17:30:32.429038] [INFO ] [REMOTE ] BEKE: Full fetch complete (77334 records). [2025-10-21T17:30:32.464967] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-21T17:30:33.097952] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:30:33.194769] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-21T17:30:33.141515] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-21T17:30:33.196210] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-21T17:30:33.197793] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-21T17:30:33.198139] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-21T17:30:33.226098] [DEBUG] [LOCAL ] BEKE: Trimmed 77334 records to 53198 (keeping 200 days of data) [2025-10-21T17:30:33.227945] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T17:30:33.459827] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T17:30:33.578037] [DEBUG] [LOCAL ] BEKE: Primary data saved (53198 records). [2025-10-21T17:30:33.578197] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-21T17:30:33.578290] [INFO ] [MAIN ] Update Progress: 247/2366 symbols completed. BEKE took 36.7s. Estimated remaining: 4h 21m 35s. Rate: 8.1 symbols/min [2025-10-21T17:30:33.750206] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:30:33.750996] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-21T17:30:33.755934] [DEBUG] [LOCAL ] BEPI: Loaded 3594 existing records from primary storage. [2025-10-21T17:30:33.756169] [INFO ] [MAIN ] BEPI: Loaded 3594 existing records. [2025-10-21T17:30:33.947870] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-21T17:30:33.951976] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:30:33.954175] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-21T17:30:33.954233] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-21T17:30:33.954420] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-21T17:30:33.954477] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-21T17:30:34.300388] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:30:34.551001] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-21T17:30:35.112732] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-21T17:30:35.351002] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-21T17:30:35.528268] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T17:30:35.537160] [INFO ] [REMOTE ] BEP: Full fetch complete (59312 records). [2025-10-21T17:30:35.537308] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-21T17:30:35.914339] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-21T17:30:36.016950] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-21T17:30:36.017064] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-21T17:30:36.017906] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-21T17:30:36.017993] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-21T17:30:36.019424] [DEBUG] [LOCAL ] BEP: Trimmed 59312 records to 38965 (keeping 200 days of data) [2025-10-21T17:30:36.152682] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-21T17:30:36.268986] [DEBUG] [LOCAL ] BEP: Primary data saved (38965 records). [2025-10-21T17:30:36.269132] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-21T17:30:36.270006] [INFO ] [MAIN ] Update Progress: 248/2366 symbols completed. BEP took 31.9s. Estimated remaining: 4h 20m 48s. Rate: 8.1 symbols/min [2025-10-21T17:30:36.445398] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:30:36.450528] [DEBUG] [LOCAL ] BEPJ: Loaded 3084 existing records from primary storage. [2025-10-21T17:30:36.450785] [INFO ] [MAIN ] BEPJ: Loaded 3084 existing records. [2025-10-21T17:30:36.643003] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:30:36.643219] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-21T17:30:36.643268] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-21T17:30:36.643403] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-21T17:30:36.643441] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-21T17:30:36.806739] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-21T17:30:36.956181] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-21T17:30:37.013775] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:30:37.751015] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-21T17:30:38.414917] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-21T17:30:38.551050] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-21T17:30:38.680449] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T17:30:39.221257] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-21T17:30:39.351037] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-21T17:30:40.151043] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-21T17:30:40.318911] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T17:30:40.951074] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-21T17:30:41.427985] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-21T17:30:41.696243] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T17:30:41.751045] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-21T17:30:42.551052] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-21T17:30:43.016224] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-21T17:30:43.351011] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-21T17:30:43.435661] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T17:30:43.681684] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-21T17:30:44.151039] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-21T17:30:44.593392] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-21T17:30:44.951064] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-21T17:30:45.751073] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-21T17:30:46.328880] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-21T17:30:46.363846] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T17:30:46.551047] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-21T17:30:47.254489] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-21T17:30:47.351121] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-21T17:30:47.779291] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-21T17:30:48.151079] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-21T17:30:48.771260] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-21T17:30:48.951058] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-21T17:30:49.751009] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-21T17:30:50.318905] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-21T17:30:50.550999] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-21T17:30:50.644312] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T17:30:51.351055] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-21T17:30:51.749734] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T17:30:52.151004] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-21T17:30:52.264366] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-21T17:30:52.951043] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-21T17:30:53.420812] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-21T17:30:53.751036] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-21T17:30:54.235925] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-21T17:30:54.453322] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-21T17:30:54.462188] [INFO ] [REMOTE ] BEPC: Full fetch complete (68896 records). [2025-10-21T17:30:54.462446] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-21T17:30:54.556206] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-21T17:30:54.893275] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-21T17:30:54.893370] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-21T17:30:54.894188] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-21T17:30:54.894252] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-21T17:30:54.895631] [DEBUG] [LOCAL ] BEPC: Trimmed 68896 records to 46391 (keeping 200 days of data) [2025-10-21T17:30:55.174783] [DEBUG] [LOCAL ] BEPC: Primary data saved (46391 records). [2025-10-21T17:30:55.174912] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-21T17:30:55.174986] [INFO ] [MAIN ] Update Progress: 249/2366 symbols completed. BEPC took 31.8s. Estimated remaining: 4h 22m 18s. Rate: 8.1 symbols/min [2025-10-21T17:30:55.258970] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-21T17:30:55.356595] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-21T17:30:55.360345] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:30:55.400063] [DEBUG] [LOCAL ] BFAM: Loaded 33897 existing records from primary storage. [2025-10-21T17:30:55.400428] [INFO ] [MAIN ] BFAM: Loaded 33897 existing records. [2025-10-21T17:30:55.600282] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:30:55.600530] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-21T17:30:55.600581] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-21T17:30:55.600846] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-21T17:30:55.600904] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-21T17:30:55.988145] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:30:55.989527] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-21T17:30:56.151040] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-21T17:30:56.857826] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-21T17:30:56.951085] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-21T17:30:57.751032] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-21T17:30:58.298544] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T17:30:58.310717] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-21T17:30:58.551040] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-21T17:30:59.351095] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-21T17:30:59.784220] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-21T17:31:00.118024] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-21T17:31:00.119026] [INFO ] [REMOTE ] BEPI: Full fetch complete (4684 records). [2025-10-21T17:31:00.119091] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-21T17:31:00.156323] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-21T17:31:00.507810] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-21T17:31:00.507898] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-21T17:31:00.508075] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-21T17:31:00.508124] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-21T17:31:00.508580] [DEBUG] [LOCAL ] BEPI: Trimmed 4684 records to 3587 (keeping 200 days of data) [2025-10-21T17:31:00.529980] [DEBUG] [LOCAL ] BEPI: Primary data saved (3587 records). [2025-10-21T17:31:00.530056] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-21T17:31:00.530128] [INFO ] [MAIN ] Update Progress: 250/2366 symbols completed. BEPI took 27.0s. Estimated remaining: 4h 21m 53s. Rate: 8.1 symbols/min [2025-10-21T17:31:00.699473] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:31:00.736852] [DEBUG] [LOCAL ] BFH: Loaded 41581 existing records from primary storage. [2025-10-21T17:31:00.737174] [INFO ] [MAIN ] BFH: Loaded 41581 existing records. [2025-10-21T17:31:00.916535] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:31:00.916786] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-21T17:31:00.916835] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-21T17:31:00.917193] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-21T17:31:00.917230] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-21T17:31:00.960369] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-21T17:31:01.286470] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:31:01.415025] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-21T17:31:01.554820] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T17:31:01.750991] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-21T17:31:02.551283] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-21T17:31:03.021083] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-21T17:31:03.200943] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T17:31:03.351063] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-21T17:31:04.151028] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-21T17:31:04.951046] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-21T17:31:04.995995] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T17:31:05.131126] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T17:31:05.650940] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-21T17:31:05.751059] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-21T17:31:06.551059] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-21T17:31:06.582014] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T17:31:06.583307] [INFO ] [REMOTE ] BEPH: Full fetch complete (7517 records). [2025-10-21T17:31:06.583374] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-21T17:31:06.957659] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-21T17:31:06.957748] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-21T17:31:06.957936] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-21T17:31:06.957974] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-21T17:31:06.961258] [DEBUG] [LOCAL ] BEPH: Trimmed 7517 records to 4924 (keeping 200 days of data) [2025-10-21T17:31:06.990277] [DEBUG] [LOCAL ] BEPH: Primary data saved (4924 records). [2025-10-21T17:31:06.990342] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-21T17:31:06.990452] [INFO ] [MAIN ] Update Progress: 251/2366 symbols completed. BEPH took 35.0s. Estimated remaining: 4h 21m 38s. Rate: 8.1 symbols/min [2025-10-21T17:31:07.157378] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:31:07.157528] [DEBUG] [LOCAL ] BFK: No existing data file found in primary storage. [2025-10-21T17:31:07.157562] [WARN ] [MAIN ] BFK: No existing data found, performing full refresh instead. [2025-10-21T17:31:07.157691] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-21T17:31:07.157745] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-21T17:31:07.157785] [DEBUG] [LOCAL ] BFK: No primary data file found to delete. [2025-10-21T17:31:07.157817] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-21T17:31:07.361804] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-21T17:31:07.510821] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:31:08.151011] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-21T17:31:08.426950] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T17:31:08.811405] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-21T17:31:08.812738] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4359 records). [2025-10-21T17:31:08.812829] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-21T17:31:08.955469] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-21T17:31:09.210618] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-21T17:31:09.218054] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-21T17:31:09.227921] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-21T17:31:09.230376] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-21T17:31:09.232591] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T17:31:09.232889] [DEBUG] [LOCAL ] BEPJ: Trimmed 4359 records to 3070 (keeping 200 days of data) [2025-10-21T17:31:09.260293] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3070 records). [2025-10-21T17:31:09.260423] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-21T17:31:09.260502] [INFO ] [MAIN ] Update Progress: 252/2366 symbols completed. BEPJ took 33.0s. Estimated remaining: 4h 20m 47s. Rate: 8.1 symbols/min [2025-10-21T17:31:09.432913] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:31:09.480112] [DEBUG] [LOCAL ] BFLY: Loaded 51857 existing records from primary storage. [2025-10-21T17:31:09.480458] [INFO ] [MAIN ] BFLY: Loaded 51857 existing records. [2025-10-21T17:31:09.654142] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:31:09.654359] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-21T17:31:09.654405] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-21T17:31:09.654620] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-21T17:31:09.654717] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-21T17:31:09.754728] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-21T17:31:10.013809] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:31:10.551029] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-21T17:31:10.592614] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-21T17:31:10.923551] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-21T17:31:11.351059] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-21T17:31:11.824081] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-21T17:31:12.151035] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-21T17:31:12.951000] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-21T17:31:13.218057] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T17:31:13.696235] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-21T17:31:13.751007] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-21T17:31:13.869251] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T17:31:14.551019] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-21T17:31:15.351029] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-21T17:31:15.538623] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T17:31:15.994046] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T17:31:16.151013] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-21T17:31:16.967411] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-21T17:31:16.984348] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T17:31:17.688869] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T17:31:17.751010] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-21T17:31:17.993474] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T17:31:18.482513] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T17:31:18.551025] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-21T17:31:19.351021] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-21T17:31:20.057865] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T17:31:20.150977] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-21T17:31:20.885672] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T17:31:20.950993] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-21T17:31:21.576758] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T17:31:21.585082] [INFO ] [REMOTE ] BFAM: Full fetch complete (47361 records). [2025-10-21T17:31:21.585230] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-21T17:31:21.752667] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-21T17:31:21.974926] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-21T17:31:21.975002] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-21T17:31:21.975556] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-21T17:31:21.975615] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-21T17:31:21.976590] [DEBUG] [LOCAL ] BFAM: Trimmed 47361 records to 33837 (keeping 200 days of data) [2025-10-21T17:31:22.176466] [DEBUG] [LOCAL ] BFAM: Primary data saved (33837 records). [2025-10-21T17:31:22.176588] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-21T17:31:22.176702] [INFO ] [MAIN ] Update Progress: 253/2366 symbols completed. BFAM took 27.0s. Estimated remaining: 4h 21m 26s. Rate: 8.1 symbols/min [2025-10-21T17:31:22.377349] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:31:22.379563] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T17:31:22.395989] [DEBUG] [LOCAL ] BFS: Loaded 9614 existing records from primary storage. [2025-10-21T17:31:22.396224] [INFO ] [MAIN ] BFS: Loaded 9614 existing records. [2025-10-21T17:31:22.551683] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-21T17:31:22.584286] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:31:22.584547] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-21T17:31:22.584609] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-21T17:31:22.584822] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-21T17:31:22.584879] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-21T17:31:22.955452] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:31:23.351032] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-21T17:31:23.689558] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T17:31:24.001501] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-21T17:31:24.102745] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-21T17:31:24.151035] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-21T17:31:24.903825] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-21T17:31:24.951016] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-21T17:31:25.634768] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-21T17:31:25.750990] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-21T17:31:26.527826] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T17:31:26.551050] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-21T17:31:27.351049] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-21T17:31:27.361092] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-21T17:31:28.151071] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-21T17:31:28.951002] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-21T17:31:29.180509] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T17:31:29.496852] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T17:31:29.751017] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-21T17:31:29.916375] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T17:31:30.551073] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-21T17:31:30.996200] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T17:31:31.002706] [INFO ] [REMOTE ] BFH: Full fetch complete (60113 records). [2025-10-21T17:31:31.002828] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-21T17:31:31.356155] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-21T17:31:31.408837] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-21T17:31:31.408931] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-21T17:31:31.409730] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-21T17:31:31.409795] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-21T17:31:31.411069] [DEBUG] [LOCAL ] BFH: Trimmed 60113 records to 41425 (keeping 200 days of data) [2025-10-21T17:31:31.654861] [DEBUG] [LOCAL ] BFH: Primary data saved (41425 records). [2025-10-21T17:31:31.654981] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-21T17:31:31.655052] [INFO ] [MAIN ] Update Progress: 254/2366 symbols completed. BFH took 31.1s. Estimated remaining: 4h 21m 35s. Rate: 8.1 symbols/min [2025-10-21T17:31:31.829352] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:31:31.843280] [DEBUG] [LOCAL ] BFZ: Loaded 12050 existing records from primary storage. [2025-10-21T17:31:31.843520] [INFO ] [MAIN ] BFZ: Loaded 12050 existing records. [2025-10-21T17:31:32.030453] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:31:32.030776] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-21T17:31:32.030827] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-21T17:31:32.031030] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-21T17:31:32.031087] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-21T17:31:32.155428] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-21T17:31:32.344223] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T17:31:32.472832] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-21T17:31:32.478309] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:31:32.644073] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-21T17:31:32.951062] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-21T17:31:33.751035] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-21T17:31:34.551061] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-21T17:31:34.621391] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-21T17:31:34.864627] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-21T17:31:35.205639] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-21T17:31:35.351006] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-21T17:31:36.151033] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-21T17:31:36.262626] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-21T17:31:36.951061] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-21T17:31:37.751040] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-21T17:31:37.812133] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T17:31:37.997141] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T17:31:38.551008] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-21T17:31:38.690157] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-21T17:31:39.351056] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-21T17:31:40.115537] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T17:31:40.150993] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-21T17:31:40.507834] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-21T17:31:40.765012] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T17:31:40.951038] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-21T17:31:41.751048] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-21T17:31:42.551063] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-21T17:31:42.822139] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-21T17:31:42.826017] [INFO ] [REMOTE ] BFK: Full fetch complete (19103 records). [2025-10-21T17:31:42.826134] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-21T17:31:43.208832] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-21T17:31:43.208943] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-21T17:31:43.209387] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-21T17:31:43.209608] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-21T17:31:43.233063] [DEBUG] [LOCAL ] BFK: Trimmed 19103 records to 13822 (keeping 200 days of data) [2025-10-21T17:31:43.235438] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-21T17:31:43.304435] [INFO ] [REMOTE ] BFLY: Full fetch complete (75514 records). [2025-10-21T17:31:43.305010] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-21T17:31:43.314885] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-21T17:31:43.356095] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-21T17:31:43.499578] [DEBUG] [LOCAL ] BFK: Primary data saved (13822 records). [2025-10-21T17:31:43.510504] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-21T17:31:43.510674] [INFO ] [MAIN ] Update Progress: 255/2366 symbols completed. BFK took 36.5s. Estimated remaining: 4h 22m 5s. Rate: 8.1 symbols/min [2025-10-21T17:31:43.894954] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:31:43.955113] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-21T17:31:43.955248] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-21T17:31:43.956228] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-21T17:31:43.956318] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-21T17:31:43.958115] [DEBUG] [LOCAL ] BFLY: Trimmed 75514 records to 51859 (keeping 200 days of data) [2025-10-21T17:31:44.154670] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-21T17:31:44.158298] [DEBUG] [LOCAL ] BG: Loaded 50585 existing records from primary storage. [2025-10-21T17:31:44.196457] [INFO ] [MAIN ] BG: Loaded 50585 existing records. [2025-10-21T17:31:44.422875] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T17:31:44.489001] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:31:44.502583] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-21T17:31:44.506093] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-21T17:31:44.506694] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-21T17:31:44.505992] [DEBUG] [LOCAL ] BFLY: Primary data saved (51859 records). [2025-10-21T17:31:44.506845] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-21T17:31:44.507888] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-21T17:31:44.539514] [INFO ] [MAIN ] Update Progress: 256/2366 symbols completed. BFLY took 35.3s. Estimated remaining: 4h 21m 4s. Rate: 8.1 symbols/min [2025-10-21T17:31:44.872074] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:31:44.952044] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-21T17:31:45.073625] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:31:45.074111] [DEBUG] [LOCAL ] BGB: Loaded 17876 existing records from primary storage. [2025-10-21T17:31:45.081686] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-21T17:31:45.081872] [INFO ] [MAIN ] BGB: Loaded 17876 existing records. [2025-10-21T17:31:45.258386] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:31:45.258609] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-21T17:31:45.258683] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-21T17:31:45.258861] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-21T17:31:45.258898] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-21T17:31:45.605459] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:31:45.751014] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-21T17:31:46.015783] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-21T17:31:46.018081] [INFO ] [REMOTE ] BFS: Full fetch complete (13096 records). [2025-10-21T17:31:46.018173] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-21T17:31:46.411814] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-21T17:31:46.411941] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-21T17:31:46.412374] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-21T17:31:46.412429] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-21T17:31:46.413267] [DEBUG] [LOCAL ] BFS: Trimmed 13096 records to 9585 (keeping 200 days of data) [2025-10-21T17:31:46.479233] [DEBUG] [LOCAL ] BFS: Primary data saved (9585 records). [2025-10-21T17:31:46.479378] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-21T17:31:46.479475] [INFO ] [MAIN ] Update Progress: 257/2366 symbols completed. BFS took 24.3s. Estimated remaining: 4h 20m 12s. Rate: 8.1 symbols/min [2025-10-21T17:31:46.556123] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-21T17:31:46.650740] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:31:46.668523] [DEBUG] [LOCAL ] BGH: Loaded 17201 existing records from primary storage. [2025-10-21T17:31:46.668783] [INFO ] [MAIN ] BGH: Loaded 17201 existing records. [2025-10-21T17:31:46.843507] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:31:46.843772] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-21T17:31:46.843821] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-21T17:31:46.844011] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-21T17:31:46.844068] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-21T17:31:47.195074] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:31:47.351025] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-21T17:31:47.951138] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-21T17:31:48.151068] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-21T17:31:48.173599] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T17:31:48.211936] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-21T17:31:48.951021] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-21T17:31:49.245122] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-21T17:31:49.751051] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-21T17:31:50.550998] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-21T17:31:50.668464] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-21T17:31:51.002098] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T17:31:51.350997] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-21T17:31:51.471241] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T17:31:52.155923] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-21T17:31:52.154849] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-21T17:31:52.951047] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-21T17:31:53.751052] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-21T17:31:54.318872] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T17:31:54.421522] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-21T17:31:54.550988] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-21T17:31:54.565115] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T17:31:55.351049] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-21T17:31:56.151064] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-21T17:31:56.436095] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T17:31:56.805604] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-21T17:31:56.951084] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-21T17:31:57.016306] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-21T17:31:57.751036] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-21T17:31:57.990834] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T17:31:58.430891] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-21T17:31:58.551014] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-21T17:31:59.351083] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-21T17:32:00.126480] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-21T17:32:00.150992] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-21T17:32:00.343461] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T17:32:00.951050] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-21T17:32:01.287969] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-21T17:32:01.751076] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-21T17:32:02.332249] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T17:32:02.551078] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-21T17:32:03.351048] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-21T17:32:03.460810] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T17:32:03.775770] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T17:32:04.051867] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-21T17:32:04.151100] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-21T17:32:04.951042] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-21T17:32:05.106269] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T17:32:05.751104] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-21T17:32:06.551033] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-21T17:32:06.610459] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-21T17:32:06.612535] [INFO ] [REMOTE ] BFZ: Full fetch complete (17449 records). [2025-10-21T17:32:06.612602] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-21T17:32:06.613059] [FATAL] [VALIDATOR ] BFZ: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:32:06.613140] [FATAL] [MAIN ] BFZ: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:32:06.613214] [WARN ] [MAIN ] BFZ: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:32:06.613284] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-21T17:32:06.613346] [DEBUG] [LOCAL ] BFZ: No primary data file found to delete. [2025-10-21T17:32:06.613380] [INFO ] [LOCAL ] BFZ: Starting deletion of derivative data. [2025-10-21T17:32:06.613535] [DEBUG] [LOCAL ] BFZ: Deleted derivative data file. [2025-10-21T17:32:06.613619] [INFO ] [MAIN ] Update Progress: 258/2366 symbols completed. BFZ took 35.0s. Estimated remaining: 4h 21m 48s. Rate: 8.1 symbols/min [2025-10-21T17:32:06.784802] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:32:06.815441] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-21T17:32:06.835733] [DEBUG] [LOCAL ] BGR: Loaded 13505 existing records from primary storage. [2025-10-21T17:32:06.835948] [INFO ] [MAIN ] BGR: Loaded 13505 existing records. [2025-10-21T17:32:07.015169] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:32:07.015396] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-21T17:32:07.015442] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-21T17:32:07.015674] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-21T17:32:07.015733] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-21T17:32:07.362279] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-21T17:32:07.367968] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:32:07.428547] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-21T17:32:08.150997] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-21T17:32:08.951029] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-21T17:32:09.067829] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T17:32:09.088333] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-21T17:32:09.751393] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-21T17:32:09.753234] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T17:32:10.551061] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-21T17:32:10.745797] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T17:32:11.351036] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-21T17:32:11.457005] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-21T17:32:12.151028] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-21T17:32:12.951071] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-21T17:32:13.089169] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-21T17:32:13.350395] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-21T17:32:13.751062] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-21T17:32:14.238010] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-21T17:32:14.241701] [INFO ] [REMOTE ] BGB: Full fetch complete (26708 records). [2025-10-21T17:32:14.241919] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-21T17:32:14.556184] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-21T17:32:14.618977] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-21T17:32:14.619076] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-21T17:32:14.619552] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-21T17:32:14.619623] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-21T17:32:14.620994] [DEBUG] [LOCAL ] BGB: Trimmed 26708 records to 17799 (keeping 200 days of data) [2025-10-21T17:32:14.709452] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-21T17:32:14.745586] [DEBUG] [LOCAL ] BGB: Primary data saved (17799 records). [2025-10-21T17:32:14.745767] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-21T17:32:14.745856] [INFO ] [MAIN ] Update Progress: 259/2366 symbols completed. BGB took 30.2s. Estimated remaining: 4h 21m 46s. Rate: 8.0 symbols/min [2025-10-21T17:32:14.923143] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:32:14.970077] [DEBUG] [LOCAL ] BGS: Loaded 50571 existing records from primary storage. [2025-10-21T17:32:14.970441] [INFO ] [MAIN ] BGS: Loaded 50571 existing records. [2025-10-21T17:32:15.151696] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:32:15.151969] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-21T17:32:15.152018] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-21T17:32:15.152407] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-21T17:32:15.152463] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-21T17:32:15.360032] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-21T17:32:15.512786] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:32:16.151059] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-21T17:32:16.450957] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T17:32:16.459204] [INFO ] [REMOTE ] BG: Full fetch complete (73104 records). [2025-10-21T17:32:16.459364] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-21T17:32:16.895815] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-21T17:32:16.921817] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-21T17:32:16.918122] [INFO ] [REMOTE ] BGH: Full fetch complete (22985 records). [2025-10-21T17:32:16.921952] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-21T17:32:16.922060] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-21T17:32:16.923342] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-21T17:32:16.923536] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-21T17:32:16.956095] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-21T17:32:17.030447] [DEBUG] [LOCAL ] BG: Trimmed 73104 records to 50586 (keeping 200 days of data) [2025-10-21T17:32:17.545932] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-21T17:32:17.546379] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-21T17:32:17.546851] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-21T17:32:17.546931] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-21T17:32:17.567564] [DEBUG] [LOCAL ] BGH: Trimmed 22985 records to 17232 (keeping 200 days of data) [2025-10-21T17:32:17.721921] [DEBUG] [LOCAL ] BG: Primary data saved (50586 records). [2025-10-21T17:32:17.722568] [INFO ] [MAIN ] BG: Full history saved. [2025-10-21T17:32:17.722976] [INFO ] [MAIN ] Update Progress: 260/2366 symbols completed. BG took 34.2s. Estimated remaining: 4h 21m 3s. Rate: 8.1 symbols/min [2025-10-21T17:32:17.942536] [DEBUG] [LOCAL ] BGH: Primary data saved (17232 records). [2025-10-21T17:32:17.931290] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:32:17.944703] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T17:32:17.943708] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-21T17:32:17.949186] [INFO ] [MAIN ] Update Progress: 261/2366 symbols completed. BGH took 31.5s. Estimated remaining: 4h 19m 57s. Rate: 8.1 symbols/min [2025-10-21T17:32:17.948988] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-21T17:32:18.065156] [DEBUG] [LOCAL ] BGSF: Loaded 8128 existing records from primary storage. [2025-10-21T17:32:18.066011] [INFO ] [MAIN ] BGSF: Loaded 8128 existing records. [2025-10-21T17:32:18.199727] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:32:18.241349] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-21T17:32:18.375988] [DEBUG] [LOCAL ] BGT: Loaded 16314 existing records from primary storage. [2025-10-21T17:32:18.375184] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:32:18.376199] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-21T17:32:18.376338] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-21T17:32:18.376448] [INFO ] [MAIN ] BGT: Loaded 16314 existing records. [2025-10-21T17:32:18.408232] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-21T17:32:18.447704] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-21T17:32:18.554463] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-21T17:32:18.694441] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:32:18.770129] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-21T17:32:18.794391] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-21T17:32:18.829231] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-21T17:32:18.839664] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-21T17:32:19.063598] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-21T17:32:19.079461] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:32:19.327049] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:32:19.351029] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-21T17:32:20.151063] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-21T17:32:20.242834] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T17:32:20.291064] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T17:32:20.951037] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-21T17:32:21.419454] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T17:32:21.751086] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-21T17:32:22.404189] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-21T17:32:22.551015] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-21T17:32:22.655352] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T17:32:23.019269] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-21T17:32:23.351012] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-21T17:32:24.151016] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-21T17:32:24.810704] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-21T17:32:24.951056] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-21T17:32:25.114098] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T17:32:25.632418] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-21T17:32:25.751038] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-21T17:32:26.551077] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-21T17:32:26.753797] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T17:32:26.861716] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-21T17:32:27.351047] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-21T17:32:28.151073] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-21T17:32:28.632514] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-21T17:32:28.951030] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-21T17:32:29.286722] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T17:32:29.751034] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-21T17:32:29.768053] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-21T17:32:30.551073] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-21T17:32:31.294065] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-21T17:32:31.351086] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-21T17:32:31.554474] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T17:32:32.014157] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-21T17:32:32.151098] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-21T17:32:32.951101] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-21T17:32:33.388799] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-21T17:32:33.751049] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-21T17:32:34.233245] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T17:32:34.551069] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-21T17:32:34.725798] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T17:32:35.351031] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-21T17:32:36.156216] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-21T17:32:36.169304] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T17:32:36.444257] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-21T17:32:36.446699] [INFO ] [REMOTE ] BGSF: Full fetch complete (9535 records). [2025-10-21T17:32:36.446771] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-21T17:32:36.447119] [FATAL] [VALIDATOR ] BGSF: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:32:36.447199] [FATAL] [MAIN ] BGSF: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:32:36.447255] [WARN ] [MAIN ] BGSF: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:32:36.447294] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-21T17:32:36.447346] [DEBUG] [LOCAL ] BGSF: No primary data file found to delete. [2025-10-21T17:32:36.447381] [INFO ] [LOCAL ] BGSF: Starting deletion of derivative data. [2025-10-21T17:32:36.447537] [DEBUG] [LOCAL ] BGSF: Deleted derivative data file. [2025-10-21T17:32:36.447618] [INFO ] [MAIN ] Update Progress: 262/2366 symbols completed. BGSF took 18.7s. Estimated remaining: 4h 21m 19s. Rate: 8.1 symbols/min [2025-10-21T17:32:36.613985] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:32:36.614131] [DEBUG] [LOCAL ] BGX: No existing data file found in primary storage. [2025-10-21T17:32:36.614166] [WARN ] [MAIN ] BGX: No existing data found, performing full refresh instead. [2025-10-21T17:32:36.614270] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-21T17:32:36.614310] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-21T17:32:36.614349] [DEBUG] [LOCAL ] BGX: No primary data file found to delete. [2025-10-21T17:32:36.614380] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-21T17:32:36.955594] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-21T17:32:36.969987] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:32:37.094212] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T17:32:37.751081] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-21T17:32:38.551036] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-21T17:32:38.643221] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T17:32:38.782532] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T17:32:39.065497] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-21T17:32:39.351057] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-21T17:32:40.151049] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-21T17:32:40.437754] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T17:32:40.951031] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-21T17:32:41.751022] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-21T17:32:41.874812] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-21T17:32:42.076976] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T17:32:42.368409] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-21T17:32:42.551088] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-21T17:32:43.351066] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-21T17:32:43.979292] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T17:32:44.151043] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-21T17:32:44.207300] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T17:32:44.951053] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-21T17:32:45.174723] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T17:32:45.177431] [INFO ] [REMOTE ] BGR: Full fetch complete (19924 records). [2025-10-21T17:32:45.177513] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-21T17:32:45.567194] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-21T17:32:45.567300] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-21T17:32:45.567837] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-21T17:32:45.567941] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-21T17:32:45.568807] [DEBUG] [LOCAL ] BGR: Trimmed 19924 records to 13494 (keeping 200 days of data) [2025-10-21T17:32:45.651610] [DEBUG] [LOCAL ] BGR: Primary data saved (13494 records). [2025-10-21T17:32:45.651787] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-21T17:32:45.651871] [INFO ] [MAIN ] Update Progress: 263/2366 symbols completed. BGR took 39.0s. Estimated remaining: 4h 21m 25s. Rate: 8.0 symbols/min [2025-10-21T17:32:45.754328] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-21T17:32:45.826392] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:32:45.847454] [DEBUG] [LOCAL ] BGY: Loaded 21632 existing records from primary storage. [2025-10-21T17:32:45.847744] [INFO ] [MAIN ] BGY: Loaded 21632 existing records. [2025-10-21T17:32:46.025221] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:32:46.025458] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-21T17:32:46.025515] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-21T17:32:46.025704] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-21T17:32:46.025760] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-21T17:32:46.375735] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:32:46.551010] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-21T17:32:46.793109] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T17:32:46.800980] [INFO ] [REMOTE ] BGS: Full fetch complete (72644 records). [2025-10-21T17:32:46.801101] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-21T17:32:46.916022] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-21T17:32:47.210690] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-21T17:32:47.210787] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-21T17:32:47.211606] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-21T17:32:47.211670] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-21T17:32:47.213097] [DEBUG] [LOCAL ] BGS: Trimmed 72644 records to 50552 (keeping 200 days of data) [2025-10-21T17:32:47.378530] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-21T17:32:47.514065] [DEBUG] [LOCAL ] BGS: Primary data saved (50552 records). [2025-10-21T17:32:47.514210] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-21T17:32:47.515025] [INFO ] [MAIN ] Update Progress: 264/2366 symbols completed. BGS took 32.8s. Estimated remaining: 4h 20m 33s. Rate: 8.1 symbols/min [2025-10-21T17:32:47.700611] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:32:47.700853] [DEBUG] [LOCAL ] BH: No existing data file found in primary storage. [2025-10-21T17:32:47.700921] [WARN ] [MAIN ] BH: No existing data found, performing full refresh instead. [2025-10-21T17:32:47.701063] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-21T17:32:47.701125] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-21T17:32:47.701243] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-10-21T17:32:47.701288] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-21T17:32:47.886856] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T17:32:48.071180] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:32:48.151005] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-21T17:32:48.452450] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T17:32:48.950989] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-21T17:32:48.962561] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T17:32:49.751082] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-21T17:32:49.876155] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T17:32:49.879002] [INFO ] [REMOTE ] BGT: Full fetch complete (24258 records). [2025-10-21T17:32:49.879111] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-21T17:32:50.274124] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-21T17:32:50.274203] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-21T17:32:50.274635] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-21T17:32:50.274719] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-21T17:32:50.275393] [DEBUG] [LOCAL ] BGT: Trimmed 24258 records to 16274 (keeping 200 days of data) [2025-10-21T17:32:50.382897] [DEBUG] [LOCAL ] BGT: Primary data saved (16274 records). [2025-10-21T17:32:50.383061] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-21T17:32:50.383183] [INFO ] [MAIN ] Update Progress: 265/2366 symbols completed. BGT took 32.4s. Estimated remaining: 4h 19m 50s. Rate: 8.1 symbols/min [2025-10-21T17:32:50.554413] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-21T17:32:50.581223] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:32:50.622968] [DEBUG] [LOCAL ] BHC: Loaded 46695 existing records from primary storage. [2025-10-21T17:32:50.623273] [INFO ] [MAIN ] BHC: Loaded 46695 existing records. [2025-10-21T17:32:50.801889] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T17:32:50.830352] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:32:50.830945] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-21T17:32:50.831007] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-21T17:32:50.831198] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-21T17:32:50.831237] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-21T17:32:51.216004] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:32:51.350984] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-21T17:32:51.617224] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T17:32:52.151026] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-21T17:32:52.951066] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-21T17:32:52.984747] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T17:32:53.476872] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-21T17:32:53.599282] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-21T17:32:53.751091] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-21T17:32:54.343379] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-21T17:32:54.551046] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-21T17:32:55.305219] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-21T17:32:55.351012] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-21T17:32:56.151019] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-21T17:32:56.631982] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-21T17:32:56.951026] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-21T17:32:57.326787] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T17:32:57.751364] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-21T17:32:58.207926] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T17:32:58.509966] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T17:32:58.550978] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-21T17:32:59.336189] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-21T17:32:59.350981] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-21T17:33:00.151051] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-21T17:33:00.330060] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T17:33:00.951004] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-21T17:33:00.960847] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-21T17:33:01.751024] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-21T17:33:02.426360] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T17:33:02.551005] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-21T17:33:02.702629] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-21T17:33:03.351084] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-21T17:33:04.151022] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-21T17:33:04.221895] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T17:33:04.542991] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T17:33:04.951034] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-21T17:33:05.073609] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T17:33:05.751089] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-21T17:33:06.551000] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-21T17:33:06.594592] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T17:33:06.845508] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T17:33:07.297638] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-21T17:33:07.351025] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-21T17:33:08.150989] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-21T17:33:08.384337] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T17:33:08.387151] [INFO ] [REMOTE ] BGX: Full fetch complete (16507 records). [2025-10-21T17:33:08.387219] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-21T17:33:08.744191] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-21T17:33:08.744268] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-21T17:33:08.744602] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-21T17:33:08.744659] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-21T17:33:08.745174] [DEBUG] [LOCAL ] BGX: Trimmed 16507 records to 11249 (keeping 200 days of data) [2025-10-21T17:33:08.811373] [DEBUG] [LOCAL ] BGX: Primary data saved (11249 records). [2025-10-21T17:33:08.811505] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-21T17:33:08.811573] [INFO ] [MAIN ] Update Progress: 266/2366 symbols completed. BGX took 32.4s. Estimated remaining: 4h 21m 9s. Rate: 8.0 symbols/min [2025-10-21T17:33:08.957636] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-21T17:33:08.984239] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:33:09.006728] [DEBUG] [LOCAL ] BHE: Loaded 23853 existing records from primary storage. [2025-10-21T17:33:09.007002] [INFO ] [MAIN ] BHE: Loaded 23853 existing records. [2025-10-21T17:33:09.199452] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:33:09.199798] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-21T17:33:09.199854] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-21T17:33:09.200052] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-21T17:33:09.200108] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-21T17:33:09.596462] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:33:09.599147] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T17:33:09.751004] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-21T17:33:10.075368] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-21T17:33:10.551069] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-21T17:33:11.350996] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-21T17:33:11.439587] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T17:33:11.855221] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T17:33:12.151047] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-21T17:33:12.350119] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-21T17:33:12.951071] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-21T17:33:12.976957] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-21T17:33:13.751068] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-21T17:33:14.551060] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-21T17:33:14.607362] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T17:33:14.857171] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T17:33:14.862887] [INFO ] [REMOTE ] BGY: Full fetch complete (32992 records). [2025-10-21T17:33:14.863086] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-21T17:33:15.305021] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-21T17:33:15.305124] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-21T17:33:15.305626] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-21T17:33:15.305710] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-21T17:33:15.306422] [DEBUG] [LOCAL ] BGY: Trimmed 32992 records to 21500 (keeping 200 days of data) [2025-10-21T17:33:15.351874] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-21T17:33:15.429502] [DEBUG] [LOCAL ] BGY: Primary data saved (21500 records). [2025-10-21T17:33:15.429620] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-21T17:33:15.429724] [INFO ] [MAIN ] Update Progress: 267/2366 symbols completed. BGY took 29.8s. Estimated remaining: 4h 20m 55s. Rate: 8.0 symbols/min [2025-10-21T17:33:15.599515] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:33:15.599788] [DEBUG] [LOCAL ] BHK: No existing data file found in primary storage. [2025-10-21T17:33:15.599970] [WARN ] [MAIN ] BHK: No existing data found, performing full refresh instead. [2025-10-21T17:33:15.600086] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-21T17:33:15.600128] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-21T17:33:15.600189] [DEBUG] [LOCAL ] BHK: No primary data file found to delete. [2025-10-21T17:33:15.600222] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-21T17:33:15.857356] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-21T17:33:15.976087] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:33:16.150999] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-21T17:33:16.592547] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T17:33:16.951023] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-21T17:33:17.215505] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T17:33:17.751031] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-21T17:33:18.204907] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T17:33:18.551053] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-21T17:33:18.662414] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-21T17:33:19.351043] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-21T17:33:19.845849] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-21T17:33:20.151024] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-21T17:33:20.674311] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T17:33:20.951019] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-21T17:33:21.119595] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-21T17:33:21.751036] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-21T17:33:22.273835] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-21T17:33:22.550993] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-21T17:33:22.713763] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-21T17:33:22.716382] [INFO ] [REMOTE ] BH: Full fetch complete (19499 records). [2025-10-21T17:33:22.716456] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-21T17:33:22.716912] [FATAL] [VALIDATOR ] BH: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:33:22.717001] [FATAL] [MAIN ] BH: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:33:22.717043] [WARN ] [MAIN ] BH: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:33:22.717081] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-21T17:33:22.717134] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-10-21T17:33:22.717170] [INFO ] [LOCAL ] BH: Starting deletion of derivative data. [2025-10-21T17:33:22.717208] [DEBUG] [LOCAL ] BH: No derivative data file found to delete. [2025-10-21T17:33:22.717262] [INFO ] [MAIN ] Update Progress: 268/2366 symbols completed. BH took 35.2s. Estimated remaining: 4h 20m 46s. Rate: 8.0 symbols/min [2025-10-21T17:33:22.883291] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:33:22.883472] [DEBUG] [LOCAL ] BHP: No existing data file found in primary storage. [2025-10-21T17:33:22.883509] [WARN ] [MAIN ] BHP: No existing data found, performing full refresh instead. [2025-10-21T17:33:22.883617] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-21T17:33:22.883688] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-21T17:33:22.883747] [DEBUG] [LOCAL ] BHP: No primary data file found to delete. [2025-10-21T17:33:22.883782] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-21T17:33:23.230709] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:33:23.351009] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-21T17:33:24.150997] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-21T17:33:24.216252] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T17:33:24.391140] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T17:33:24.951058] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-21T17:33:25.151518] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-21T17:33:25.751060] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-21T17:33:25.972610] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-21T17:33:26.551024] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-21T17:33:27.351046] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-21T17:33:27.736370] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-21T17:33:27.784202] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T17:33:28.151014] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-21T17:33:28.757449] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-21T17:33:28.950995] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-21T17:33:29.223624] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T17:33:29.751005] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-21T17:33:30.551067] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-21T17:33:30.602379] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T17:33:30.672373] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T17:33:30.675950] [INFO ] [REMOTE ] BHE: Full fetch complete (36397 records). [2025-10-21T17:33:30.676030] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-21T17:33:31.042131] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-21T17:33:31.042204] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-21T17:33:31.042706] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-21T17:33:31.042767] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-21T17:33:31.043514] [DEBUG] [LOCAL ] BHE: Trimmed 36397 records to 23786 (keeping 200 days of data) [2025-10-21T17:33:31.183041] [DEBUG] [LOCAL ] BHE: Primary data saved (23786 records). [2025-10-21T17:33:31.183161] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-21T17:33:31.183234] [INFO ] [MAIN ] Update Progress: 269/2366 symbols completed. BHE took 22.4s. Estimated remaining: 4h 20m 47s. Rate: 8.0 symbols/min [2025-10-21T17:33:31.368820] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-21T17:33:31.371350] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:33:31.394284] [DEBUG] [LOCAL ] BHR: Loaded 22056 existing records from primary storage. [2025-10-21T17:33:31.394596] [INFO ] [MAIN ] BHR: Loaded 22056 existing records. [2025-10-21T17:33:31.571283] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:33:31.571569] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-21T17:33:31.571685] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-21T17:33:31.571877] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-21T17:33:31.571938] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-21T17:33:31.713140] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-21T17:33:31.948394] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:33:32.150998] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-21T17:33:32.951016] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-21T17:33:33.294870] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T17:33:33.484408] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-21T17:33:33.751035] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-21T17:33:34.551049] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-21T17:33:34.734853] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T17:33:34.742077] [INFO ] [REMOTE ] BHC: Full fetch complete (67517 records). [2025-10-21T17:33:34.742194] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-21T17:33:35.161630] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-21T17:33:35.161804] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-21T17:33:35.162729] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-21T17:33:35.162810] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-21T17:33:35.173618] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-21T17:33:35.178750] [DEBUG] [LOCAL ] BHC: Trimmed 67517 records to 46640 (keeping 200 days of data) [2025-10-21T17:33:35.369445] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-21T17:33:35.438234] [DEBUG] [LOCAL ] BHC: Primary data saved (46640 records). [2025-10-21T17:33:35.438373] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-21T17:33:35.438450] [INFO ] [MAIN ] Update Progress: 270/2366 symbols completed. BHC took 45.1s. Estimated remaining: 4h 20m 14s. Rate: 8.1 symbols/min [2025-10-21T17:33:35.610543] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:33:35.610969] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-21T17:33:35.611078] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-21T17:33:35.611245] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-21T17:33:35.611310] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-21T17:33:35.611532] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-21T17:33:35.611605] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-21T17:33:35.995799] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:33:35.998167] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-21T17:33:36.151030] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-21T17:33:36.519496] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T17:33:36.950996] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-21T17:33:37.355338] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T17:33:37.751041] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-21T17:33:38.214326] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-21T17:33:38.551053] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-21T17:33:38.916244] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-21T17:33:39.351069] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-21T17:33:39.695988] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T17:33:39.826063] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-21T17:33:40.151010] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-21T17:33:40.950994] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-21T17:33:41.193440] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T17:33:41.751016] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-21T17:33:42.162178] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-21T17:33:42.551010] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-21T17:33:42.694607] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T17:33:43.351084] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-21T17:33:43.923567] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-21T17:33:44.151086] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-21T17:33:44.475393] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-21T17:33:44.951031] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-21T17:33:45.311993] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-21T17:33:45.751029] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-21T17:33:46.199524] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-21T17:33:46.296398] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-21T17:33:46.551022] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-21T17:33:47.351010] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-21T17:33:48.151047] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-21T17:33:48.569785] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-21T17:33:48.597554] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-21T17:33:48.598698] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T17:33:48.951068] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-21T17:33:49.751034] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-21T17:33:50.241737] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-21T17:33:50.551091] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-21T17:33:50.888332] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-21T17:33:51.351049] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-21T17:33:51.743161] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-21T17:33:51.745910] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-21T17:33:52.151007] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-21T17:33:52.640956] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-21T17:33:52.951030] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-21T17:33:53.751029] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-21T17:33:54.551037] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-21T17:33:54.796726] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-21T17:33:54.805246] [INFO ] [REMOTE ] BHP: Full fetch complete (77437 records). [2025-10-21T17:33:54.805411] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-21T17:33:54.955518] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T17:33:55.002973] [INFO ] [REMOTE ] BHK: Full fetch complete (30498 records). [2025-10-21T17:33:55.028930] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-21T17:33:55.323231] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-21T17:33:55.358548] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-21T17:33:55.407144] [INFO ] [REMOTE ] BHV: Full fetch complete (1403 records). [2025-10-21T17:33:55.421715] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-21T17:33:55.439725] [FATAL] [VALIDATOR ] BHV: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:33:55.424297] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-21T17:33:55.454342] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-21T17:33:55.460681] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-21T17:33:55.460877] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-21T17:33:55.454456] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:33:55.493413] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:33:55.500772] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-21T17:33:55.534615] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-21T17:33:55.545287] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-21T17:33:55.545414] [DEBUG] [LOCAL ] BHP: Trimmed 77437 records to 53368 (keeping 200 days of data) [2025-10-21T17:33:55.552529] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-21T17:33:55.552700] [INFO ] [MAIN ] Update Progress: 271/2366 symbols completed. BHV took 20.1s. Estimated remaining: 4h 21m 45s. Rate: 8.0 symbols/min [2025-10-21T17:33:55.845608] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-21T17:33:55.854480] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-21T17:33:55.861373] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-21T17:33:55.861467] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-21T17:33:55.907157] [DEBUG] [LOCAL ] BHK: Trimmed 30498 records to 23875 (keeping 200 days of data) [2025-10-21T17:33:55.942259] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:33:55.943478] [DEBUG] [LOCAL ] BHVN: No existing data file found in primary storage. [2025-10-21T17:33:55.944169] [WARN ] [MAIN ] BHVN: No existing data found, performing full refresh instead. [2025-10-21T17:33:55.993398] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-21T17:33:55.993549] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-21T17:33:56.002583] [DEBUG] [LOCAL ] BHVN: No primary data file found to delete. [2025-10-21T17:33:56.029625] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-21T17:33:56.217176] [DEBUG] [LOCAL ] BHK: Primary data saved (23875 records). [2025-10-21T17:33:56.229354] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-21T17:33:56.230007] [INFO ] [MAIN ] Update Progress: 272/2366 symbols completed. BHK took 40.8s. Estimated remaining: 4h 20m 45s. Rate: 8.0 symbols/min [2025-10-21T17:33:56.717713] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:33:56.782219] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:33:56.788795] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-21T17:33:56.855272] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T17:33:56.913366] [DEBUG] [LOCAL ] BHP: Primary data saved (53368 records). [2025-10-21T17:33:56.913597] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-21T17:33:56.913712] [INFO ] [MAIN ] Update Progress: 273/2366 symbols completed. BHP took 34.2s. Estimated remaining: 4h 19m 45s. Rate: 8.1 symbols/min [2025-10-21T17:33:56.957066] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-21T17:33:57.101488] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:33:57.116216] [DEBUG] [LOCAL ] BIO: No existing data file found in primary storage. [2025-10-21T17:33:57.116273] [WARN ] [MAIN ] BIO: No existing data found, performing full refresh instead. [2025-10-21T17:33:57.116960] [DEBUG] [LOCAL ] BILL: Loaded 52513 existing records from primary storage. [2025-10-21T17:33:57.117151] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-21T17:33:57.117296] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-21T17:33:57.117424] [INFO ] [MAIN ] BILL: Loaded 52513 existing records. [2025-10-21T17:33:57.117509] [DEBUG] [LOCAL ] BIO: No primary data file found to delete. [2025-10-21T17:33:57.160607] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-21T17:33:57.454633] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:33:57.538606] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-21T17:33:57.549755] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-21T17:33:57.576327] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-21T17:33:57.576495] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-21T17:33:57.759830] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:33:57.775823] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-21T17:33:58.053017] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:33:58.067362] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-21T17:33:58.551137] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-21T17:33:58.643222] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-21T17:33:58.680565] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T17:33:59.351025] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-21T17:33:59.518946] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-21T17:34:00.151019] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-21T17:34:00.951560] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-21T17:34:00.951486] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T17:34:01.387243] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-21T17:34:01.391257] [INFO ] [REMOTE ] BHR: Full fetch complete (31079 records). [2025-10-21T17:34:01.391335] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-21T17:34:01.391802] [FATAL] [VALIDATOR ] BHR: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:34:01.391884] [FATAL] [MAIN ] BHR: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:34:01.391926] [WARN ] [MAIN ] BHR: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:34:01.391988] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-21T17:34:01.392048] [DEBUG] [LOCAL ] BHR: No primary data file found to delete. [2025-10-21T17:34:01.392087] [INFO ] [LOCAL ] BHR: Starting deletion of derivative data. [2025-10-21T17:34:01.392294] [DEBUG] [LOCAL ] BHR: Deleted derivative data file. [2025-10-21T17:34:01.392376] [INFO ] [MAIN ] Update Progress: 274/2366 symbols completed. BHR took 30.2s. Estimated remaining: 4h 19m 15s. Rate: 8.1 symbols/min [2025-10-21T17:34:01.576719] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:34:01.576898] [DEBUG] [LOCAL ] BIP: No existing data file found in primary storage. [2025-10-21T17:34:01.576935] [WARN ] [MAIN ] BIP: No existing data found, performing full refresh instead. [2025-10-21T17:34:01.577040] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-21T17:34:01.577080] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-21T17:34:01.577119] [DEBUG] [LOCAL ] BIP: No primary data file found to delete. [2025-10-21T17:34:01.577149] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-21T17:34:01.766522] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-21T17:34:01.969105] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:34:02.165356] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-21T17:34:02.551045] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-21T17:34:03.351019] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-21T17:34:03.684125] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-21T17:34:03.756704] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T17:34:04.151071] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-21T17:34:04.827759] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T17:34:04.951037] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-21T17:34:05.686331] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T17:34:05.751048] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-21T17:34:06.379188] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-21T17:34:06.551017] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-21T17:34:07.351030] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-21T17:34:07.567506] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T17:34:08.151019] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-21T17:34:08.519534] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-21T17:34:08.950990] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-21T17:34:09.025694] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T17:34:09.751003] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-21T17:34:10.018563] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T17:34:10.551010] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-21T17:34:10.764133] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T17:34:10.905509] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-21T17:34:11.350977] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-21T17:34:12.151002] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-21T17:34:12.541778] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-21T17:34:12.951065] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-21T17:34:13.215877] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T17:34:13.265795] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-21T17:34:13.751078] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-21T17:34:14.306134] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T17:34:14.550995] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-21T17:34:14.895900] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T17:34:15.351075] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-21T17:34:16.151027] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-21T17:34:16.506840] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-21T17:34:16.951036] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-21T17:34:17.318952] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-21T17:34:17.667018] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T17:34:17.751010] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-21T17:34:18.550996] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-21T17:34:18.789272] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T17:34:19.341740] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T17:34:19.356788] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-21T17:34:19.938891] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T17:34:20.151056] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-21T17:34:20.720565] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T17:34:20.951057] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-21T17:34:21.751043] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-21T17:34:21.896021] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T17:34:22.551052] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-21T17:34:22.979100] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-21T17:34:22.987725] [INFO ] [REMOTE ] BHVN: Full fetch complete (70603 records). [2025-10-21T17:34:22.987853] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-21T17:34:23.315839] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T17:34:23.356204] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-21T17:34:23.442229] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-21T17:34:23.442309] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-21T17:34:23.443059] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-21T17:34:23.443123] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-21T17:34:23.444419] [DEBUG] [LOCAL ] BHVN: Trimmed 70603 records to 50631 (keeping 200 days of data) [2025-10-21T17:34:23.738194] [DEBUG] [LOCAL ] BHVN: Primary data saved (50631 records). [2025-10-21T17:34:23.738359] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-21T17:34:23.738442] [INFO ] [MAIN ] Update Progress: 275/2366 symbols completed. BHVN took 28.2s. Estimated remaining: 4h 21m 1s. Rate: 8.0 symbols/min [2025-10-21T17:34:23.908472] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:34:23.944755] [DEBUG] [LOCAL ] BIPC: Loaded 41246 existing records from primary storage. [2025-10-21T17:34:23.945072] [INFO ] [MAIN ] BIPC: Loaded 41246 existing records. [2025-10-21T17:34:24.124972] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:34:24.125240] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-21T17:34:24.125378] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-21T17:34:24.125812] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-21T17:34:24.125869] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-21T17:34:24.156445] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-21T17:34:24.528716] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:34:24.525455] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-21T17:34:24.605557] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T17:34:24.951004] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-21T17:34:25.298249] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T17:34:25.751093] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-21T17:34:26.429566] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T17:34:26.551017] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-21T17:34:27.333900] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T17:34:27.350977] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-21T17:34:27.786365] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T17:34:28.151019] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-21T17:34:28.826978] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T17:34:28.951044] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-21T17:34:29.651633] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-21T17:34:29.751005] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-21T17:34:29.863288] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T17:34:29.871970] [INFO ] [REMOTE ] BILL: Full fetch complete (76136 records). [2025-10-21T17:34:29.872118] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-21T17:34:30.265698] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-21T17:34:30.265795] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-21T17:34:30.266613] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-21T17:34:30.266706] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-21T17:34:30.268220] [DEBUG] [LOCAL ] BILL: Trimmed 76136 records to 52510 (keeping 200 days of data) [2025-10-21T17:34:30.555728] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-21T17:34:30.562957] [DEBUG] [LOCAL ] BILL: Primary data saved (52510 records). [2025-10-21T17:34:30.564349] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-21T17:34:30.564448] [INFO ] [MAIN ] Update Progress: 276/2366 symbols completed. BILL took 34.3s. Estimated remaining: 4h 20m 49s. Rate: 8.0 symbols/min [2025-10-21T17:34:30.730282] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:34:30.735218] [DEBUG] [LOCAL ] BIPH: Loaded 2395 existing records from primary storage. [2025-10-21T17:34:30.735363] [INFO ] [MAIN ] BIPH: Loaded 2395 existing records. [2025-10-21T17:34:30.911042] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:34:30.911283] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-21T17:34:30.911334] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-21T17:34:30.911476] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-21T17:34:30.911531] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-21T17:34:31.258732] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:34:31.351331] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-21T17:34:31.354976] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-21T17:34:32.151060] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-21T17:34:32.200530] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T17:34:32.429936] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T17:34:32.433192] [INFO ] [REMOTE ] BIO: Full fetch complete (34413 records). [2025-10-21T17:34:32.433336] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-21T17:34:32.808230] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-21T17:34:32.808382] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-21T17:34:32.808915] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-21T17:34:32.809323] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-21T17:34:32.810162] [DEBUG] [LOCAL ] BIO: Trimmed 34413 records to 23888 (keeping 200 days of data) [2025-10-21T17:34:32.953105] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-21T17:34:32.955120] [DEBUG] [LOCAL ] BIO: Primary data saved (23888 records). [2025-10-21T17:34:32.956224] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-21T17:34:32.956310] [INFO ] [MAIN ] Update Progress: 277/2366 symbols completed. BIO took 36.0s. Estimated remaining: 4h 20m 3s. Rate: 8.0 symbols/min [2025-10-21T17:34:33.598056] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-21T17:34:33.611804] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-21T17:34:33.751054] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-21T17:34:34.551026] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-21T17:34:35.001465] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-21T17:34:35.081891] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-21T17:34:35.351064] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-21T17:34:36.151084] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-21T17:34:36.779032] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T17:34:36.785600] [INFO ] [REMOTE ] BIP: Full fetch complete (57614 records). [2025-10-21T17:34:36.785785] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-21T17:34:36.963116] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-21T17:34:37.177026] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-21T17:34:37.177105] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-21T17:34:37.177762] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-21T17:34:37.177824] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-21T17:34:37.179005] [DEBUG] [LOCAL ] BIP: Trimmed 57614 records to 39061 (keeping 200 days of data) [2025-10-21T17:34:37.413162] [DEBUG] [LOCAL ] BIP: Primary data saved (39061 records). [2025-10-21T17:34:37.413315] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-21T17:34:37.413397] [INFO ] [MAIN ] Update Progress: 278/2366 symbols completed. BIP took 36.0s. Estimated remaining: 4h 19m 33s. Rate: 8.0 symbols/min [2025-10-21T17:34:37.599952] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T17:34:37.679737] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T17:34:37.751062] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-21T17:34:38.064841] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-21T17:34:38.551079] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-21T17:34:38.998450] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-21T17:34:39.351068] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-21T17:34:40.151078] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-21T17:34:40.615415] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-21T17:34:40.933918] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T17:34:40.950978] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-21T17:34:41.750992] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-21T17:34:42.201285] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-21T17:34:42.268927] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T17:34:42.551032] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-21T17:34:43.351080] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-21T17:34:43.847481] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-21T17:34:44.112557] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T17:34:44.151000] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-21T17:34:44.951029] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-21T17:34:45.409936] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-21T17:34:45.751074] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-21T17:34:45.789834] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-21T17:34:45.796388] [INFO ] [REMOTE ] BIPC: Full fetch complete (60268 records). [2025-10-21T17:34:45.796490] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-21T17:34:46.208614] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-21T17:34:46.208481] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-21T17:34:46.210032] [INFO ] [REMOTE ] BIPH: Full fetch complete (3877 records). [2025-10-21T17:34:46.210140] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-21T17:34:46.208841] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-21T17:34:46.255117] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-21T17:34:46.282234] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-21T17:34:46.343003] [DEBUG] [LOCAL ] BIPC: Trimmed 60268 records to 41184 (keeping 200 days of data) [2025-10-21T17:34:46.697454] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-21T17:34:46.698586] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-21T17:34:46.699107] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-21T17:34:46.699441] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-21T17:34:46.701430] [DEBUG] [LOCAL ] BIPH: Trimmed 3877 records to 2375 (keeping 200 days of data) [2025-10-21T17:34:46.718306] [DEBUG] [LOCAL ] BIPH: Primary data saved (2375 records). [2025-10-21T17:34:46.718968] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-21T17:34:46.719580] [INFO ] [MAIN ] Update Progress: 279/2366 symbols completed. BIPH took 16.2s. Estimated remaining: 4h 19m 39s. Rate: 8.0 symbols/min [2025-10-21T17:34:46.848885] [DEBUG] [LOCAL ] BIPC: Primary data saved (41184 records). [2025-10-21T17:34:46.849007] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-21T17:34:46.849080] [INFO ] [MAIN ] Update Progress: 280/2366 symbols completed. BIPC took 23.1s. Estimated remaining: 4h 18m 37s. Rate: 8.1 symbols/min [2025-10-21T17:34:47.443952] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:34:47.493981] [DEBUG] [LOCAL ] BIPI: No existing data file found in primary storage. [2025-10-21T17:34:47.548514] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:34:47.546208] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:34:47.548637] [WARN ] [MAIN ] BIPI: No existing data found, performing full refresh instead. [2025-10-21T17:34:47.551868] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:34:47.552548] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-21T17:34:47.553205] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-21T17:34:47.553615] [DEBUG] [LOCAL ] BIPI: No primary data file found to delete. [2025-10-21T17:34:47.553976] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-21T17:34:47.621444] [DEBUG] [LOCAL ] BIPJ: Loaded 3133 existing records from primary storage. [2025-10-21T17:34:47.627665] [INFO ] [MAIN ] BIPJ: Loaded 3133 existing records. [2025-10-21T17:34:47.748717] [DEBUG] [LOCAL ] BIT: Loaded 23780 existing records from primary storage. [2025-10-21T17:34:47.775626] [INFO ] [MAIN ] BIT: Loaded 23780 existing records. [2025-10-21T17:34:48.183964] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:34:48.199961] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-21T17:34:48.215224] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-21T17:34:48.206697] [DEBUG] [LOCAL ] BIRK: Loaded 51198 existing records from primary storage. [2025-10-21T17:34:48.249502] [INFO ] [MAIN ] BIRK: Loaded 51198 existing records. [2025-10-21T17:34:48.249373] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-21T17:34:48.263543] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-21T17:34:48.334298] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:34:48.367466] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-21T17:34:48.386221] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-21T17:34:48.421566] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-21T17:34:48.590436] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:34:48.601781] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-21T17:34:48.577892] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-21T17:34:48.810119] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:34:48.831897] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-21T17:34:48.862022] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-21T17:34:48.921989] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-21T17:34:48.959688] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-21T17:34:49.463282] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-21T17:34:49.555308] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-21T17:34:49.569638] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:34:49.565270] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:34:49.595678] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-21T17:34:49.607395] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-21T17:34:49.790513] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:34:49.790876] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-21T17:34:50.073000] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-21T17:34:50.239096] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-21T17:34:50.551063] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-21T17:34:50.835902] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T17:34:50.931792] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-21T17:34:51.351090] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-21T17:34:51.611435] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T17:34:51.733035] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-21T17:34:52.151048] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-21T17:34:52.858008] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-21T17:34:52.951023] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-21T17:34:53.602395] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-21T17:34:53.751024] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-21T17:34:54.239747] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-21T17:34:54.551039] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-21T17:34:55.022288] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-21T17:34:55.351021] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-21T17:34:55.859436] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-21T17:34:56.151021] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-21T17:34:56.758203] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-21T17:34:56.951026] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-21T17:34:57.503986] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-21T17:34:57.751037] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-21T17:34:58.551034] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-21T17:34:59.108344] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T17:34:59.351031] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-21T17:34:59.450907] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T17:35:00.151011] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-21T17:35:00.471758] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T17:35:00.900344] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-21T17:35:00.950985] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-21T17:35:01.751060] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-21T17:35:02.437164] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-21T17:35:02.438138] [INFO ] [REMOTE ] BIPI: Full fetch complete (4627 records). [2025-10-21T17:35:02.438234] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-21T17:35:02.556094] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-21T17:35:02.821183] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-21T17:35:02.821316] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-21T17:35:02.821693] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-21T17:35:02.821816] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-21T17:35:02.822566] [DEBUG] [LOCAL ] BIPI: Trimmed 4627 records to 2845 (keeping 200 days of data) [2025-10-21T17:35:02.849135] [DEBUG] [LOCAL ] BIPI: Primary data saved (2845 records). [2025-10-21T17:35:02.849343] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-21T17:35:02.849506] [INFO ] [MAIN ] Update Progress: 281/2366 symbols completed. BIPI took 16.0s. Estimated remaining: 4h 19m 33s. Rate: 8.0 symbols/min [2025-10-21T17:35:02.976411] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-21T17:35:03.092971] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:35:03.149541] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-21T17:35:03.150531] [DEBUG] [LOCAL ] BJ: Loaded 51581 existing records from primary storage. [2025-10-21T17:35:03.153539] [INFO ] [MAIN ] BJ: Loaded 51581 existing records. [2025-10-21T17:35:03.350952] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:35:03.351297] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-21T17:35:03.351347] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-21T17:35:03.351027] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-21T17:35:03.351738] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-21T17:35:03.352843] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-21T17:35:03.733605] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:35:04.151029] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-21T17:35:04.551130] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T17:35:04.951084] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-21T17:35:05.671177] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-21T17:35:05.756133] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-21T17:35:05.774049] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T17:35:06.551002] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-21T17:35:06.712727] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-21T17:35:07.351044] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-21T17:35:07.786753] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-21T17:35:08.149306] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T17:35:08.158186] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-21T17:35:08.726114] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-21T17:35:08.951008] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-21T17:35:09.751020] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-21T17:35:10.551010] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-21T17:35:10.657098] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-21T17:35:10.741447] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-21T17:35:11.351017] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-21T17:35:12.135385] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T17:35:12.150974] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-21T17:35:12.179861] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-21T17:35:12.769933] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-21T17:35:12.771028] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4195 records). [2025-10-21T17:35:12.771095] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-21T17:35:12.951078] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-21T17:35:13.140567] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-21T17:35:13.140665] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-21T17:35:13.140830] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-21T17:35:13.140872] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-21T17:35:13.141220] [DEBUG] [LOCAL ] BIPJ: Trimmed 4195 records to 3124 (keeping 200 days of data) [2025-10-21T17:35:13.160704] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3124 records). [2025-10-21T17:35:13.160810] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-21T17:35:13.160886] [INFO ] [MAIN ] Update Progress: 282/2366 symbols completed. BIPJ took 26.3s. Estimated remaining: 4h 19m 46s. Rate: 8.0 symbols/min [2025-10-21T17:35:13.334678] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:35:13.383356] [DEBUG] [LOCAL ] BK: Loaded 53546 existing records from primary storage. [2025-10-21T17:35:13.383687] [INFO ] [MAIN ] BK: Loaded 53546 existing records. [2025-10-21T17:35:13.580703] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:35:13.580949] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-21T17:35:13.581009] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-21T17:35:13.581292] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-21T17:35:13.581347] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-21T17:35:13.759803] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-21T17:35:13.944816] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:35:14.551010] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-21T17:35:14.871292] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T17:35:15.351089] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-21T17:35:15.816006] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-21T17:35:15.991751] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T17:35:16.151027] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-21T17:35:16.950097] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T17:35:16.959477] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-21T17:35:17.690086] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T17:35:17.751086] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-21T17:35:18.551050] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-21T17:35:18.852458] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T17:35:19.351010] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-21T17:35:19.563349] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T17:35:19.830666] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T17:35:20.151101] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-21T17:35:20.956183] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-21T17:35:20.971336] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T17:35:21.187270] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T17:35:21.751043] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-21T17:35:22.551062] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-21T17:35:22.589721] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T17:35:23.351033] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-21T17:35:23.445905] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T17:35:23.893293] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T17:35:23.898522] [INFO ] [REMOTE ] BIT: Full fetch complete (32264 records). [2025-10-21T17:35:23.898709] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-21T17:35:24.161254] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-21T17:35:24.290174] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-21T17:35:24.290257] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-21T17:35:24.290780] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-21T17:35:24.290844] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-21T17:35:24.291630] [DEBUG] [LOCAL ] BIT: Trimmed 32264 records to 23895 (keeping 200 days of data) [2025-10-21T17:35:24.433572] [DEBUG] [LOCAL ] BIT: Primary data saved (23895 records). [2025-10-21T17:35:24.433724] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-21T17:35:24.433808] [INFO ] [MAIN ] Update Progress: 283/2366 symbols completed. BIT took 37.6s. Estimated remaining: 4h 20m 7s. Rate: 8.0 symbols/min [2025-10-21T17:35:24.618163] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:35:24.618355] [DEBUG] [LOCAL ] BKD: No existing data file found in primary storage. [2025-10-21T17:35:24.618397] [WARN ] [MAIN ] BKD: No existing data found, performing full refresh instead. [2025-10-21T17:35:24.618506] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-21T17:35:24.618548] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-21T17:35:24.618588] [DEBUG] [LOCAL ] BKD: No primary data file found to delete. [2025-10-21T17:35:24.618622] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-21T17:35:24.969087] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-21T17:35:25.005370] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:35:25.044928] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T17:35:25.751060] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-21T17:35:26.154765] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T17:35:26.551096] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-21T17:35:26.850901] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T17:35:27.351032] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-21T17:35:27.478322] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T17:35:28.139706] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T17:35:28.150969] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-21T17:35:28.951059] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-21T17:35:29.220349] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T17:35:29.228342] [INFO ] [REMOTE ] BIRK: Full fetch complete (73411 records). [2025-10-21T17:35:29.228469] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-21T17:35:29.618842] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-21T17:35:29.618971] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-21T17:35:29.619971] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-21T17:35:29.620052] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-21T17:35:29.621471] [DEBUG] [LOCAL ] BIRK: Trimmed 73411 records to 51192 (keeping 200 days of data) [2025-10-21T17:35:29.757439] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-21T17:35:29.759352] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-21T17:35:29.946134] [DEBUG] [LOCAL ] BIRK: Primary data saved (51192 records). [2025-10-21T17:35:29.946285] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-21T17:35:29.946910] [INFO ] [MAIN ] Update Progress: 284/2366 symbols completed. BIRK took 43.1s. Estimated remaining: 4h 19m 45s. Rate: 8.0 symbols/min [2025-10-21T17:35:30.123898] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:35:30.158438] [DEBUG] [LOCAL ] BKE: Loaded 33953 existing records from primary storage. [2025-10-21T17:35:30.158760] [INFO ] [MAIN ] BKE: Loaded 33953 existing records. [2025-10-21T17:35:30.345550] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:35:30.345774] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-21T17:35:30.345824] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-21T17:35:30.346036] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-21T17:35:30.346094] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-21T17:35:30.568975] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-21T17:35:30.726947] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:35:30.758401] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T17:35:31.094953] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-21T17:35:31.351030] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-21T17:35:32.151003] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-21T17:35:32.324121] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T17:35:32.951003] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-21T17:35:33.129562] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-21T17:35:33.751057] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-21T17:35:33.950820] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T17:35:33.959005] [INFO ] [REMOTE ] BJ: Full fetch complete (74438 records). [2025-10-21T17:35:33.959146] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-21T17:35:34.370518] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-21T17:35:34.399118] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-21T17:35:34.399933] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-21T17:35:34.400828] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-21T17:35:34.400892] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-21T17:35:34.402177] [DEBUG] [LOCAL ] BJ: Trimmed 74438 records to 51545 (keeping 200 days of data) [2025-10-21T17:35:34.571331] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-21T17:35:34.711541] [DEBUG] [LOCAL ] BJ: Primary data saved (51545 records). [2025-10-21T17:35:34.711704] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-21T17:35:34.711791] [INFO ] [MAIN ] Update Progress: 285/2366 symbols completed. BJ took 31.9s. Estimated remaining: 4h 19m 18s. Rate: 8.0 symbols/min [2025-10-21T17:35:34.878889] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:35:34.879049] [DEBUG] [LOCAL ] BKH: No existing data file found in primary storage. [2025-10-21T17:35:34.879085] [WARN ] [MAIN ] BKH: No existing data found, performing full refresh instead. [2025-10-21T17:35:34.879216] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-21T17:35:34.879281] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-21T17:35:34.879327] [DEBUG] [LOCAL ] BKH: No primary data file found to delete. [2025-10-21T17:35:34.879358] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-21T17:35:35.243729] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:35:35.299118] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T17:35:35.351031] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-21T17:35:36.059714] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-21T17:35:36.150994] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-21T17:35:36.540085] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-21T17:35:36.951021] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-21T17:35:37.751010] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-21T17:35:37.821467] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T17:35:38.556146] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-21T17:35:38.577013] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T17:35:39.188184] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T17:35:39.351084] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-21T17:35:40.054537] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T17:35:40.151025] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-21T17:35:40.906739] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T17:35:40.951009] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-21T17:35:41.751101] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-21T17:35:41.811470] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T17:35:42.551158] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-21T17:35:42.591053] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T17:35:43.351054] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-21T17:35:43.681389] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T17:35:43.865403] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-21T17:35:44.151008] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-21T17:35:44.951097] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-21T17:35:45.069354] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T17:35:45.751078] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-21T17:35:46.041147] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-21T17:35:46.113580] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T17:35:46.122487] [INFO ] [REMOTE ] BK: Full fetch complete (77677 records). [2025-10-21T17:35:46.122730] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-21T17:35:46.502760] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-21T17:35:46.502838] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-21T17:35:46.503605] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-21T17:35:46.503672] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-21T17:35:46.505044] [DEBUG] [LOCAL ] BK: Trimmed 77677 records to 53546 (keeping 200 days of data) [2025-10-21T17:35:46.558417] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-21T17:35:46.858624] [DEBUG] [LOCAL ] BK: Primary data saved (53546 records). [2025-10-21T17:35:46.858834] [INFO ] [MAIN ] BK: Full history saved. [2025-10-21T17:35:46.858949] [INFO ] [MAIN ] Update Progress: 286/2366 symbols completed. BK took 33.7s. Estimated remaining: 4h 19m 44s. Rate: 8.0 symbols/min [2025-10-21T17:35:47.042592] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:35:47.077667] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T17:35:47.118921] [DEBUG] [LOCAL ] BKKT: Loaded 37052 existing records from primary storage. [2025-10-21T17:35:47.119213] [INFO ] [MAIN ] BKKT: Loaded 37052 existing records. [2025-10-21T17:35:47.302542] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:35:47.302743] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-21T17:35:47.302796] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-21T17:35:47.302963] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-21T17:35:47.303003] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-21T17:35:47.363030] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-21T17:35:47.675677] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:35:48.150998] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-21T17:35:48.182424] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-21T17:35:48.951005] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-21T17:35:49.201482] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T17:35:49.209272] [INFO ] [REMOTE ] BKD: Full fetch complete (72104 records). [2025-10-21T17:35:49.209412] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-21T17:35:49.605934] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-21T17:35:49.606015] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-21T17:35:49.606852] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-21T17:35:49.606916] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-21T17:35:49.608313] [DEBUG] [LOCAL ] BKD: Trimmed 72104 records to 50448 (keeping 200 days of data) [2025-10-21T17:35:49.759916] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-21T17:35:49.886764] [DEBUG] [LOCAL ] BKD: Primary data saved (50448 records). [2025-10-21T17:35:49.887034] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-21T17:35:49.887163] [INFO ] [MAIN ] Update Progress: 287/2366 symbols completed. BKD took 25.5s. Estimated remaining: 4h 19m 4s. Rate: 8.0 symbols/min [2025-10-21T17:35:50.048301] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T17:35:50.087852] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:35:50.096089] [DEBUG] [LOCAL ] BKN: Loaded 7285 existing records from primary storage. [2025-10-21T17:35:50.096247] [INFO ] [MAIN ] BKN: Loaded 7285 existing records. [2025-10-21T17:35:50.273423] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:35:50.273693] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-21T17:35:50.273786] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-21T17:35:50.273974] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-21T17:35:50.274070] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-21T17:35:50.554182] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-21T17:35:50.630698] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T17:35:50.652193] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:35:51.190245] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T17:35:51.351040] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-21T17:35:52.120320] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T17:35:52.137407] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-21T17:35:52.151039] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-21T17:35:52.951101] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-21T17:35:53.529847] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T17:35:53.751026] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-21T17:35:54.378303] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-21T17:35:54.395855] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-21T17:35:54.551014] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-21T17:35:55.351032] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-21T17:35:55.511324] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-21T17:35:56.151027] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-21T17:35:56.606691] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-21T17:35:56.951044] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-21T17:35:57.575458] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T17:35:57.751006] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-21T17:35:58.258622] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-21T17:35:58.550982] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-21T17:35:59.029971] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-21T17:35:59.351067] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-21T17:35:59.391777] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-21T17:36:00.151065] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-21T17:36:00.900150] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T17:36:00.950996] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-21T17:36:01.663014] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T17:36:01.751071] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-21T17:36:02.551035] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-21T17:36:02.877788] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T17:36:03.350990] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-21T17:36:03.498456] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T17:36:03.882800] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T17:36:04.151028] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-21T17:36:04.165754] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T17:36:04.951027] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-21T17:36:05.444124] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-21T17:36:05.465584] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-21T17:36:05.751071] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-21T17:36:06.551034] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-21T17:36:07.095047] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T17:36:07.100349] [INFO ] [REMOTE ] BKE: Full fetch complete (50297 records). [2025-10-21T17:36:07.100445] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-21T17:36:07.356231] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-21T17:36:07.482692] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-21T17:36:07.482795] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-21T17:36:07.483453] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-21T17:36:07.483497] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-21T17:36:07.484624] [DEBUG] [LOCAL ] BKE: Trimmed 50297 records to 33720 (keeping 200 days of data) [2025-10-21T17:36:07.686721] [DEBUG] [LOCAL ] BKE: Primary data saved (33720 records). [2025-10-21T17:36:07.686877] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-21T17:36:07.687283] [INFO ] [MAIN ] Update Progress: 288/2366 symbols completed. BKE took 37.7s. Estimated remaining: 4h 20m 11s. Rate: 8.0 symbols/min [2025-10-21T17:36:07.860139] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:36:07.905516] [DEBUG] [LOCAL ] BKSY: Loaded 48890 existing records from primary storage. [2025-10-21T17:36:07.905837] [INFO ] [MAIN ] BKSY: Loaded 48890 existing records. [2025-10-21T17:36:08.104619] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:36:08.105907] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-21T17:36:08.111605] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-21T17:36:08.111845] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-21T17:36:08.112409] [INFO ] [REMOTE ] BKH: Full fetch complete (53164 records). [2025-10-21T17:36:08.112444] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-21T17:36:08.112570] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-21T17:36:08.112619] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-21T17:36:08.161134] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-21T17:36:08.273056] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-21T17:36:08.921551] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:36:08.957579] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-21T17:36:08.987273] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-21T17:36:08.987394] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-21T17:36:08.988340] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-21T17:36:08.988525] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-21T17:36:08.990226] [DEBUG] [LOCAL ] BKH: Trimmed 53164 records to 37390 (keeping 200 days of data) [2025-10-21T17:36:09.245314] [DEBUG] [LOCAL ] BKH: Primary data saved (37390 records). [2025-10-21T17:36:09.245453] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-21T17:36:09.245524] [INFO ] [MAIN ] Update Progress: 289/2366 symbols completed. BKH took 34.5s. Estimated remaining: 4h 19m 21s. Rate: 8.0 symbols/min [2025-10-21T17:36:09.413268] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:36:09.427529] [DEBUG] [LOCAL ] BKT: Loaded 12778 existing records from primary storage. [2025-10-21T17:36:09.428284] [INFO ] [MAIN ] BKT: Loaded 12778 existing records. [2025-10-21T17:36:09.604177] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:36:09.604805] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-21T17:36:09.604914] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-21T17:36:09.605171] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-21T17:36:09.605225] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-21T17:36:09.752503] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-21T17:36:09.781821] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T17:36:09.890054] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T17:36:10.027974] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:36:10.551095] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-21T17:36:11.351057] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-21T17:36:11.436731] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-21T17:36:11.796352] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-21T17:36:12.151075] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-21T17:36:12.179302] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-21T17:36:12.951019] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-21T17:36:13.751308] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T17:36:13.751469] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-21T17:36:13.753132] [INFO ] [REMOTE ] BKN: Full fetch complete (11120 records). [2025-10-21T17:36:13.753910] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-21T17:36:14.148811] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-21T17:36:14.149050] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-21T17:36:14.149410] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-21T17:36:14.149490] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-21T17:36:14.150172] [DEBUG] [LOCAL ] BKN: Trimmed 11120 records to 7286 (keeping 200 days of data) [2025-10-21T17:36:14.195117] [DEBUG] [LOCAL ] BKN: Primary data saved (7286 records). [2025-10-21T17:36:14.195235] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-21T17:36:14.195309] [INFO ] [MAIN ] Update Progress: 290/2366 symbols completed. BKN took 24.3s. Estimated remaining: 4h 18m 55s. Rate: 8.0 symbols/min [2025-10-21T17:36:14.376610] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:36:14.402784] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-21T17:36:14.445384] [DEBUG] [LOCAL ] BKU: Loaded 42263 existing records from primary storage. [2025-10-21T17:36:14.445701] [INFO ] [MAIN ] BKU: Loaded 42263 existing records. [2025-10-21T17:36:14.560794] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-21T17:36:14.649224] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:36:14.649459] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-21T17:36:14.649514] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-21T17:36:14.649787] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-21T17:36:14.649843] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-21T17:36:15.004558] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:36:15.351048] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-21T17:36:15.880067] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-21T17:36:16.151045] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-21T17:36:16.524696] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-21T17:36:16.853782] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-21T17:36:16.879547] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T17:36:16.951050] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-21T17:36:17.751044] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-21T17:36:18.373159] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:36:18.551074] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-21T17:36:19.292027] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-21T17:36:19.351013] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-21T17:36:19.761226] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-21T17:36:20.118956] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-21T17:36:20.150996] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-21T17:36:20.951035] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-21T17:36:20.990298] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-21T17:36:21.751089] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-21T17:36:22.551013] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-21T17:36:22.594539] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T17:36:22.609817] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-21T17:36:23.351036] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-21T17:36:24.053244] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-21T17:36:24.151078] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-21T17:36:24.271813] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T17:36:24.951056] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-21T17:36:25.751009] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-21T17:36:25.797896] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T17:36:26.545369] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T17:36:26.550970] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-21T17:36:26.731225] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-21T17:36:27.351076] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-21T17:36:27.369913] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-21T17:36:28.151147] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-21T17:36:28.951054] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-21T17:36:29.055561] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T17:36:29.407992] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T17:36:29.412033] [INFO ] [REMOTE ] BKT: Full fetch complete (16644 records). [2025-10-21T17:36:29.412148] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-21T17:36:29.759480] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-21T17:36:29.788087] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-21T17:36:29.788926] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-21T17:36:29.789330] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-21T17:36:29.789402] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-21T17:36:29.790260] [DEBUG] [LOCAL ] BKT: Trimmed 16644 records to 12824 (keeping 200 days of data) [2025-10-21T17:36:29.869393] [DEBUG] [LOCAL ] BKT: Primary data saved (12824 records). [2025-10-21T17:36:29.869537] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-21T17:36:29.869613] [INFO ] [MAIN ] Update Progress: 291/2366 symbols completed. BKT took 20.6s. Estimated remaining: 4h 19m 46s. Rate: 8.0 symbols/min [2025-10-21T17:36:30.044530] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:36:30.071382] [DEBUG] [LOCAL ] BKV: Loaded 29615 existing records from primary storage. [2025-10-21T17:36:30.071703] [INFO ] [MAIN ] BKV: Loaded 29615 existing records. [2025-10-21T17:36:30.248670] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:36:30.248864] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-21T17:36:30.248910] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-21T17:36:30.249157] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-21T17:36:30.249212] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-21T17:36:30.556122] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-21T17:36:30.618334] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:36:31.245972] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T17:36:31.351004] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-21T17:36:31.594882] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.64 seconds). [2025-10-21T17:36:31.602920] [INFO ] [REMOTE ] BKKT: Full fetch complete (51831 records). [2025-10-21T17:36:31.603042] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-21T17:36:32.019158] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-21T17:36:32.019254] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-21T17:36:32.019932] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-21T17:36:32.020003] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-21T17:36:32.021136] [DEBUG] [LOCAL ] BKKT: Trimmed 51831 records to 37205 (keeping 200 days of data) [2025-10-21T17:36:32.177356] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-21T17:36:32.238377] [DEBUG] [LOCAL ] BKKT: Primary data saved (37205 records). [2025-10-21T17:36:32.238515] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-21T17:36:32.238592] [INFO ] [MAIN ] Update Progress: 292/2366 symbols completed. BKKT took 45.4s. Estimated remaining: 4h 19m 2s. Rate: 8.0 symbols/min [2025-10-21T17:36:32.412578] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:36:32.447983] [DEBUG] [LOCAL ] BLCO: Loaded 35097 existing records from primary storage. [2025-10-21T17:36:32.448316] [INFO ] [MAIN ] BLCO: Loaded 35097 existing records. [2025-10-21T17:36:32.637865] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:36:32.638204] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-21T17:36:32.638404] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-21T17:36:32.638768] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-21T17:36:32.638826] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-21T17:36:32.768022] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-21T17:36:32.954979] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-21T17:36:33.092927] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:36:33.095446] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T17:36:33.393978] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T17:36:33.751063] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-21T17:36:34.551156] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-21T17:36:35.226794] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T17:36:35.317836] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-21T17:36:35.350995] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-21T17:36:35.825019] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T17:36:36.151051] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-21T17:36:36.908846] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T17:36:36.951011] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-21T17:36:37.542235] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T17:36:37.751087] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-21T17:36:38.417332] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T17:36:38.551083] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-21T17:36:38.833237] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-21T17:36:39.351041] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-21T17:36:40.065493] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T17:36:40.151005] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-21T17:36:40.398699] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-21T17:36:40.951043] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-21T17:36:41.751108] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-21T17:36:41.790618] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T17:36:42.551135] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-21T17:36:42.886386] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-21T17:36:43.202776] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T17:36:43.210160] [INFO ] [REMOTE ] BKU: Full fetch complete (60916 records). [2025-10-21T17:36:43.210275] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-21T17:36:43.356390] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-21T17:36:43.604708] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-21T17:36:43.604792] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-21T17:36:43.605457] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-21T17:36:43.605495] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-21T17:36:43.606597] [DEBUG] [LOCAL ] BKU: Trimmed 60916 records to 42187 (keeping 200 days of data) [2025-10-21T17:36:43.860137] [DEBUG] [LOCAL ] BKU: Primary data saved (42187 records). [2025-10-21T17:36:43.860268] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-21T17:36:43.860344] [INFO ] [MAIN ] Update Progress: 293/2366 symbols completed. BKU took 29.7s. Estimated remaining: 4h 19m 24s. Rate: 8.0 symbols/min [2025-10-21T17:36:43.972357] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T17:36:44.059726] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:36:44.086011] [DEBUG] [LOCAL ] BLD: Loaded 27298 existing records from primary storage. [2025-10-21T17:36:44.086259] [INFO ] [MAIN ] BLD: Loaded 27298 existing records. [2025-10-21T17:36:44.161060] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-21T17:36:44.270034] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:36:44.270287] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-21T17:36:44.270347] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-21T17:36:44.270577] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-21T17:36:44.270634] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-21T17:36:44.652161] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:36:44.951044] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-21T17:36:45.103316] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T17:36:45.384344] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-21T17:36:45.751087] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-21T17:36:46.395807] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T17:36:46.551088] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-21T17:36:47.350986] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-21T17:36:47.442046] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:36:47.808059] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T17:36:48.151074] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-21T17:36:48.951100] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-21T17:36:49.533187] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-21T17:36:49.541616] [INFO ] [REMOTE ] BKSY: Full fetch complete (70547 records). [2025-10-21T17:36:49.541821] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-21T17:36:49.756117] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-21T17:36:49.979780] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-21T17:36:49.980395] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-21T17:36:49.981203] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-21T17:36:49.982379] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T17:36:49.990787] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-21T17:36:49.992561] [DEBUG] [LOCAL ] BKSY: Trimmed 70547 records to 48901 (keeping 200 days of data) [2025-10-21T17:36:50.292129] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T17:36:50.306554] [DEBUG] [LOCAL ] BKSY: Primary data saved (48901 records). [2025-10-21T17:36:50.307093] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-21T17:36:50.307541] [INFO ] [MAIN ] Update Progress: 294/2366 symbols completed. BKSY took 42.6s. Estimated remaining: 4h 19m 9s. Rate: 8.0 symbols/min [2025-10-21T17:36:50.479623] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:36:50.531138] [DEBUG] [LOCAL ] BLDR: Loaded 51892 existing records from primary storage. [2025-10-21T17:36:50.531425] [INFO ] [MAIN ] BLDR: Loaded 51892 existing records. [2025-10-21T17:36:50.562284] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-21T17:36:50.714119] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:36:50.714408] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-21T17:36:50.714462] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-21T17:36:50.714674] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-21T17:36:50.714729] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-21T17:36:51.087270] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T17:36:51.091034] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:36:51.351081] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-21T17:36:51.957895] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-21T17:36:52.151074] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-21T17:36:52.951044] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-21T17:36:53.280389] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T17:36:53.366279] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-21T17:36:53.751035] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-21T17:36:53.922297] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-21T17:36:54.551103] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-21T17:36:55.296903] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-21T17:36:55.302747] [INFO ] [REMOTE ] BKV: Full fetch complete (44875 records). [2025-10-21T17:36:55.302918] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-21T17:36:55.363765] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-21T17:36:55.746530] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-21T17:36:55.746683] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-21T17:36:55.747503] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-21T17:36:55.747551] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-21T17:36:55.749053] [DEBUG] [LOCAL ] BKV: Trimmed 44875 records to 29490 (keeping 200 days of data) [2025-10-21T17:36:55.932854] [DEBUG] [LOCAL ] BKV: Primary data saved (29490 records). [2025-10-21T17:36:55.933213] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-21T17:36:55.933344] [INFO ] [MAIN ] Update Progress: 295/2366 symbols completed. BKV took 26.1s. Estimated remaining: 4h 18m 48s. Rate: 8.0 symbols/min [2025-10-21T17:36:56.074452] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T17:36:56.157417] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:36:56.157525] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-21T17:36:56.176621] [DEBUG] [LOCAL ] BLE: Loaded 13804 existing records from primary storage. [2025-10-21T17:36:56.176965] [INFO ] [MAIN ] BLE: Loaded 13804 existing records. [2025-10-21T17:36:56.369405] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:36:56.369772] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-21T17:36:56.369900] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-21T17:36:56.370115] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-21T17:36:56.370187] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-21T17:36:56.777390] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:36:56.951066] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-21T17:36:57.271143] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T17:36:57.664906] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T17:36:57.751005] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-21T17:36:57.866116] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-21T17:36:58.551099] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-21T17:36:59.285577] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-21T17:36:59.350989] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-21T17:36:59.465666] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T17:37:00.151039] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-21T17:37:00.411593] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T17:37:00.951038] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-21T17:37:01.649593] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T17:37:01.751022] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-21T17:37:02.328842] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T17:37:02.551020] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-21T17:37:02.857962] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T17:37:03.351008] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-21T17:37:03.396173] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-21T17:37:04.151005] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-21T17:37:04.951025] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-21T17:37:05.174636] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T17:37:05.588092] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-21T17:37:05.593233] [INFO ] [REMOTE ] BLCO: Full fetch complete (52344 records). [2025-10-21T17:37:05.593328] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-21T17:37:05.751614] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-21T17:37:05.777891] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-21T17:37:05.985286] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-21T17:37:05.985359] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-21T17:37:05.985974] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-21T17:37:05.986036] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-21T17:37:05.987004] [DEBUG] [LOCAL ] BLCO: Trimmed 52344 records to 35044 (keeping 200 days of data) [2025-10-21T17:37:06.178670] [DEBUG] [LOCAL ] BLCO: Primary data saved (35044 records). [2025-10-21T17:37:06.178794] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-21T17:37:06.178886] [INFO ] [MAIN ] Update Progress: 296/2366 symbols completed. BLCO took 33.9s. Estimated remaining: 4h 18m 60s. Rate: 8.0 symbols/min [2025-10-21T17:37:06.346974] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:37:06.347155] [DEBUG] [LOCAL ] BLK: No existing data file found in primary storage. [2025-10-21T17:37:06.347201] [WARN ] [MAIN ] BLK: No existing data found, performing full refresh instead. [2025-10-21T17:37:06.347335] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-21T17:37:06.347390] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-21T17:37:06.347432] [DEBUG] [LOCAL ] BLK: No primary data file found to delete. [2025-10-21T17:37:06.347462] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-21T17:37:06.561052] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-21T17:37:06.695846] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:37:07.076981] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-21T17:37:07.350996] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-21T17:37:07.415552] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-21T17:37:08.151019] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-21T17:37:08.664261] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T17:37:08.950964] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-21T17:37:09.750996] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-21T17:37:09.830974] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-21T17:37:10.350699] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T17:37:10.551006] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-21T17:37:11.347261] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T17:37:11.351213] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-21T17:37:11.598521] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-21T17:37:12.151030] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-21T17:37:12.951129] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-21T17:37:12.974132] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T17:37:13.730994] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T17:37:13.750981] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-21T17:37:14.264491] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-21T17:37:14.551023] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-21T17:37:15.351049] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-21T17:37:15.509938] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T17:37:15.933188] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T17:37:16.151013] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-21T17:37:16.883193] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-21T17:37:16.951080] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-21T17:37:17.180466] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T17:37:17.751092] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-21T17:37:18.357388] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-21T17:37:18.361907] [INFO ] [REMOTE ] BLD: Full fetch complete (39874 records). [2025-10-21T17:37:18.362067] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-21T17:37:18.557817] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-21T17:37:18.751314] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-21T17:37:18.786781] [INFO ] [REMOTE ] BLE: Full fetch complete (19551 records). [2025-10-21T17:37:18.787146] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-21T17:37:18.787415] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-21T17:37:18.788461] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-21T17:37:18.787325] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-21T17:37:18.788845] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-21T17:37:18.887935] [DEBUG] [LOCAL ] BLD: Trimmed 39874 records to 27198 (keeping 200 days of data) [2025-10-21T17:37:19.321209] [DEBUG] [LOCAL ] BLD: Primary data saved (27198 records). [2025-10-21T17:37:19.357437] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-21T17:37:19.375507] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-21T17:37:19.385721] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-21T17:37:19.385943] [INFO ] [MAIN ] Update Progress: 297/2366 symbols completed. BLD took 35.5s. Estimated remaining: 4h 19m 32s. Rate: 8.0 symbols/min [2025-10-21T17:37:19.386061] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-21T17:37:19.386826] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-21T17:37:19.386939] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-21T17:37:19.435601] [DEBUG] [LOCAL ] BLE: Trimmed 19551 records to 13755 (keeping 200 days of data) [2025-10-21T17:37:19.643596] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:37:19.662321] [DEBUG] [LOCAL ] BLE: Primary data saved (13755 records). [2025-10-21T17:37:19.662690] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-21T17:37:19.663277] [INFO ] [MAIN ] Update Progress: 298/2366 symbols completed. BLE took 23.7s. Estimated remaining: 4h 18m 34s. Rate: 8.0 symbols/min [2025-10-21T17:37:19.849792] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:37:19.850000] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-21T17:37:19.850044] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-21T17:37:19.850181] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-21T17:37:19.850255] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-21T17:37:19.850315] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-21T17:37:19.850348] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-21T17:37:20.010191] [DEBUG] [LOCAL ] BLND: Loaded 49271 existing records from primary storage. [2025-10-21T17:37:20.024309] [INFO ] [MAIN ] BLND: Loaded 49271 existing records. [2025-10-21T17:37:20.406407] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:37:20.435173] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:37:20.435564] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-10-21T17:37:20.435616] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-21T17:37:20.436406] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-21T17:37:20.436636] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-21T17:37:20.436725] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-21T17:37:20.812192] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:37:20.835321] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-21T17:37:20.950981] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-21T17:37:21.229876] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:37:21.246858] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-10-21T17:37:21.247532] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:37:21.248560] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T17:37:21.248673] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-21T17:37:21.259094] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:37:21.259709] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-21T17:37:21.259796] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-21T17:37:21.259835] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-21T17:37:21.259874] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-21T17:37:21.259947] [INFO ] [MAIN ] Update Progress: 299/2366 symbols completed. BLSH took 1.6s. Estimated remaining: 4h 17m 46s. Rate: 8.0 symbols/min [2025-10-21T17:37:21.432235] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:37:21.445370] [DEBUG] [LOCAL ] BLW: Loaded 13124 existing records from primary storage. [2025-10-21T17:37:21.445592] [INFO ] [MAIN ] BLW: Loaded 13124 existing records. [2025-10-21T17:37:21.623582] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:37:21.623800] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-21T17:37:21.623848] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-21T17:37:21.624062] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-21T17:37:21.624117] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-21T17:37:21.762049] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-21T17:37:21.979271] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:37:22.550998] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-21T17:37:22.651090] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T17:37:23.351051] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-21T17:37:23.522977] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T17:37:24.150991] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-21T17:37:24.271680] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T17:37:24.951883] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T17:37:24.951189] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-21T17:37:25.258062] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-21T17:37:25.751080] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-21T17:37:26.462307] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T17:37:26.550980] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-21T17:37:27.351069] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-21T17:37:27.791361] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-21T17:37:27.800105] [INFO ] [REMOTE ] BLDR: Full fetch complete (74710 records). [2025-10-21T17:37:27.800267] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-21T17:37:28.151252] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-21T17:37:28.151454] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-21T17:37:28.266333] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-21T17:37:28.269327] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-21T17:37:28.270464] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-21T17:37:28.271026] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-21T17:37:28.272594] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T17:37:28.285019] [DEBUG] [LOCAL ] BLDR: Trimmed 74710 records to 51874 (keeping 200 days of data) [2025-10-21T17:37:28.591136] [DEBUG] [LOCAL ] BLDR: Primary data saved (51874 records). [2025-10-21T17:37:28.591272] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-21T17:37:28.591731] [INFO ] [MAIN ] Update Progress: 300/2366 symbols completed. BLDR took 38.3s. Estimated remaining: 4h 17m 37s. Rate: 8.0 symbols/min [2025-10-21T17:37:28.757536] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:37:28.773732] [DEBUG] [LOCAL ] BLX: Loaded 15575 existing records from primary storage. [2025-10-21T17:37:28.773963] [INFO ] [MAIN ] BLX: Loaded 15575 existing records. [2025-10-21T17:37:28.946714] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:37:28.946950] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-21T17:37:28.946999] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-21T17:37:28.947169] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-21T17:37:28.947208] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-21T17:37:28.958727] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-21T17:37:29.341772] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:37:29.751027] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-21T17:37:29.970155] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-21T17:37:30.086038] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T17:37:30.551071] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-21T17:37:31.351015] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-21T17:37:31.353683] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-21T17:37:32.148700] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T17:37:32.154417] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-21T17:37:32.166803] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-21T17:37:32.951071] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-21T17:37:33.751047] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-21T17:37:34.023296] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T17:37:34.527280] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T17:37:34.550993] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-21T17:37:34.582133] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T17:37:35.351045] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-21T17:37:36.151000] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-21T17:37:36.298583] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-21T17:37:36.522690] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-21T17:37:36.529101] [INFO ] [REMOTE ] BLK: Full fetch complete (53050 records). [2025-10-21T17:37:36.529224] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-21T17:37:36.902080] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-21T17:37:36.902185] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-21T17:37:36.902826] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-21T17:37:36.902888] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-21T17:37:36.904078] [DEBUG] [LOCAL ] BLK: Trimmed 53050 records to 34328 (keeping 200 days of data) [2025-10-21T17:37:36.959903] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-21T17:37:37.125075] [DEBUG] [LOCAL ] BLK: Primary data saved (34328 records). [2025-10-21T17:37:37.125214] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-21T17:37:37.125284] [INFO ] [MAIN ] Update Progress: 301/2366 symbols completed. BLK took 30.9s. Estimated remaining: 4h 17m 37s. Rate: 8.0 symbols/min [2025-10-21T17:37:37.292892] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:37:37.327249] [DEBUG] [LOCAL ] BMA: Loaded 36470 existing records from primary storage. [2025-10-21T17:37:37.327530] [INFO ] [MAIN ] BMA: Loaded 36470 existing records. [2025-10-21T17:37:37.510453] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:37:37.510768] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-21T17:37:37.510823] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-21T17:37:37.511016] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-21T17:37:37.511073] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-21T17:37:37.619349] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-21T17:37:37.759200] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-21T17:37:37.929411] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:37:37.945539] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T17:37:38.550993] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-21T17:37:38.845859] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-21T17:37:39.351031] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-21T17:37:40.151028] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-21T17:37:40.263695] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T17:37:40.264520] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-21T17:37:40.951484] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-21T17:37:40.952397] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T17:37:41.751036] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-21T17:37:42.533560] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T17:37:42.554197] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-21T17:37:42.559326] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T17:37:43.350995] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-21T17:37:43.583147] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-21T17:37:44.151040] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-21T17:37:44.770744] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:37:44.951049] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-21T17:37:45.751058] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-21T17:37:45.993223] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-21T17:37:46.018420] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T17:37:46.551058] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-21T17:37:47.054594] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T17:37:47.057314] [INFO ] [REMOTE ] BLW: Full fetch complete (19258 records). [2025-10-21T17:37:47.057390] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-21T17:37:47.351225] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-21T17:37:47.440904] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-21T17:37:47.440986] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-21T17:37:47.441613] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-21T17:37:47.441692] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-21T17:37:47.442576] [DEBUG] [LOCAL ] BLW: Trimmed 19258 records to 13120 (keeping 200 days of data) [2025-10-21T17:37:47.525262] [DEBUG] [LOCAL ] BLW: Primary data saved (13120 records). [2025-10-21T17:37:47.525403] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-21T17:37:47.525484] [INFO ] [MAIN ] Update Progress: 302/2366 symbols completed. BLW took 26.3s. Estimated remaining: 4h 17m 50s. Rate: 8.0 symbols/min [2025-10-21T17:37:47.735932] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:37:47.749337] [DEBUG] [LOCAL ] BME: Loaded 11258 existing records from primary storage. [2025-10-21T17:37:47.749596] [INFO ] [MAIN ] BME: Loaded 11258 existing records. [2025-10-21T17:37:47.982878] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:37:47.983482] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-21T17:37:47.983589] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-21T17:37:47.983872] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-21T17:37:47.983944] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-21T17:37:48.155376] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-21T17:37:48.609032] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T17:37:48.607666] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:37:48.621932] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-21T17:37:48.951058] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-21T17:37:49.554909] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T17:37:49.751023] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-21T17:37:50.551072] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-21T17:37:50.741688] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T17:37:50.749585] [INFO ] [REMOTE ] BLND: Full fetch complete (72234 records). [2025-10-21T17:37:50.749764] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-21T17:37:51.153576] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-21T17:37:51.153753] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-21T17:37:51.154852] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-21T17:37:51.154952] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-21T17:37:51.156446] [DEBUG] [LOCAL ] BLND: Trimmed 72234 records to 49223 (keeping 200 days of data) [2025-10-21T17:37:51.269172] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T17:37:51.355092] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-21T17:37:51.469577] [DEBUG] [LOCAL ] BLND: Primary data saved (49223 records). [2025-10-21T17:37:51.469876] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-21T17:37:51.478312] [INFO ] [MAIN ] Update Progress: 303/2366 symbols completed. BLND took 32.1s. Estimated remaining: 4h 17m 18s. Rate: 8.0 symbols/min [2025-10-21T17:37:51.478672] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-21T17:37:51.665104] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:37:51.692142] [DEBUG] [LOCAL ] BMEZ: Loaded 25392 existing records from primary storage. [2025-10-21T17:37:51.692413] [INFO ] [MAIN ] BMEZ: Loaded 25392 existing records. [2025-10-21T17:37:51.870638] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:37:51.870887] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-21T17:37:51.870934] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-21T17:37:51.871103] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-21T17:37:51.871140] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-21T17:37:52.156134] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-21T17:37:52.223410] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:37:52.517551] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-21T17:37:52.950997] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-21T17:37:53.014724] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-21T17:37:53.751024] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-21T17:37:54.265464] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T17:37:54.551025] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-21T17:37:55.160143] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T17:37:55.351019] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-21T17:37:55.780718] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-21T17:37:56.151025] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-21T17:37:56.763234] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-21T17:37:56.951025] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-21T17:37:57.391866] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-21T17:37:57.751030] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-21T17:37:58.296870] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T17:37:58.551013] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-21T17:37:59.110207] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T17:37:59.350998] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-21T17:37:59.483551] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-21T17:38:00.151025] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-21T17:38:00.733979] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T17:38:00.779997] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-21T17:38:00.951027] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-21T17:38:01.751028] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-21T17:38:01.890884] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-21T17:38:02.551031] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-21T17:38:02.641883] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-21T17:38:03.351043] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-21T17:38:04.151015] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-21T17:38:04.527850] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-21T17:38:04.534827] [INFO ] [REMOTE ] BMA: Full fetch complete (52320 records). [2025-10-21T17:38:04.534948] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-21T17:38:04.828503] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-21T17:38:04.950246] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-21T17:38:04.950323] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-21T17:38:04.951049] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-21T17:38:04.950986] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-21T17:38:04.951242] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-21T17:38:04.953159] [DEBUG] [LOCAL ] BMA: Trimmed 52320 records to 36526 (keeping 200 days of data) [2025-10-21T17:38:05.052824] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-21T17:38:05.189761] [DEBUG] [LOCAL ] BMA: Primary data saved (36526 records). [2025-10-21T17:38:05.189895] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-21T17:38:05.189973] [INFO ] [MAIN ] Update Progress: 304/2366 symbols completed. BMA took 28.1s. Estimated remaining: 4h 17m 53s. Rate: 8.0 symbols/min [2025-10-21T17:38:05.366708] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:38:05.391033] [DEBUG] [LOCAL ] BMI: Loaded 24793 existing records from primary storage. [2025-10-21T17:38:05.391282] [INFO ] [MAIN ] BMI: Loaded 24793 existing records. [2025-10-21T17:38:05.563773] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:38:05.563943] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-21T17:38:05.563991] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-21T17:38:05.564154] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-21T17:38:05.564190] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-21T17:38:05.756427] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-21T17:38:05.920028] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:38:06.115566] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T17:38:06.118448] [INFO ] [REMOTE ] BLX: Full fetch complete (22539 records). [2025-10-21T17:38:06.118540] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-21T17:38:06.506632] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-21T17:38:06.506823] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-21T17:38:06.507782] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-21T17:38:06.507853] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-21T17:38:06.509173] [DEBUG] [LOCAL ] BLX: Trimmed 22539 records to 15521 (keeping 200 days of data) [2025-10-21T17:38:06.558323] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-21T17:38:06.616782] [DEBUG] [LOCAL ] BLX: Primary data saved (15521 records). [2025-10-21T17:38:06.617079] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-21T17:38:06.617224] [INFO ] [MAIN ] Update Progress: 305/2366 symbols completed. BLX took 38.0s. Estimated remaining: 4h 17m 4s. Rate: 8.0 symbols/min [2025-10-21T17:38:06.773369] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-21T17:38:06.809067] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:38:06.814072] [DEBUG] [LOCAL ] BMN: Loaded 2592 existing records from primary storage. [2025-10-21T17:38:06.814222] [INFO ] [MAIN ] BMN: Loaded 2592 existing records. [2025-10-21T17:38:06.987862] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:38:06.988107] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-21T17:38:06.988182] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-21T17:38:06.988391] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-21T17:38:06.988447] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-21T17:38:07.338273] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:38:07.350982] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-21T17:38:07.820070] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-21T17:38:07.989812] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-21T17:38:08.151025] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-21T17:38:08.703336] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-21T17:38:08.951036] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-21T17:38:09.751007] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-21T17:38:10.041705] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-21T17:38:10.110103] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-21T17:38:10.551085] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-21T17:38:11.351037] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-21T17:38:11.751209] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T17:38:11.857241] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-21T17:38:12.151067] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-21T17:38:12.951003] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-21T17:38:13.103398] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-21T17:38:13.751076] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-21T17:38:14.112301] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-21T17:38:14.317028] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-21T17:38:14.551072] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-21T17:38:15.351029] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-21T17:38:15.800229] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-21T17:38:15.840172] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-21T17:38:16.151058] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-21T17:38:16.590709] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-21T17:38:16.951110] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-21T17:38:17.751054] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-21T17:38:18.079524] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-21T17:38:18.551044] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-21T17:38:18.657761] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-21T17:38:19.351004] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-21T17:38:19.759991] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-21T17:38:20.151051] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-21T17:38:20.205793] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-21T17:38:20.600747] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-21T17:38:20.951021] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-21T17:38:21.751067] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-21T17:38:21.946363] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-21T17:38:21.948768] [INFO ] [REMOTE ] BME: Full fetch complete (15732 records). [2025-10-21T17:38:21.948835] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-21T17:38:22.308127] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-21T17:38:22.308231] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-21T17:38:22.308592] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-21T17:38:22.308629] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-21T17:38:22.309142] [DEBUG] [LOCAL ] BME: Trimmed 15732 records to 11279 (keeping 200 days of data) [2025-10-21T17:38:22.376322] [DEBUG] [LOCAL ] BME: Primary data saved (11279 records). [2025-10-21T17:38:22.376426] [INFO ] [MAIN ] BME: Full history saved. [2025-10-21T17:38:22.376497] [INFO ] [MAIN ] Update Progress: 306/2366 symbols completed. BME took 34.9s. Estimated remaining: 4h 17m 52s. Rate: 8.0 symbols/min [2025-10-21T17:38:22.551732] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-21T17:38:22.551622] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:38:22.591481] [DEBUG] [LOCAL ] BMO: Loaded 41223 existing records from primary storage. [2025-10-21T17:38:22.591793] [INFO ] [MAIN ] BMO: Loaded 41223 existing records. [2025-10-21T17:38:22.773170] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:38:22.773521] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-21T17:38:22.773598] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-21T17:38:22.774089] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-21T17:38:22.774264] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-21T17:38:22.892582] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T17:38:23.149673] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:38:23.351067] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-21T17:38:23.588698] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-21T17:38:24.151038] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-21T17:38:24.937693] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T17:38:24.950982] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-21T17:38:25.331111] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-21T17:38:25.751079] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-21T17:38:26.216804] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T17:38:26.551051] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-21T17:38:26.890716] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-21T17:38:27.351014] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-21T17:38:28.151063] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-21T17:38:28.168714] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-21T17:38:28.496789] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-21T17:38:28.720702] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T17:38:28.951007] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-21T17:38:29.751113] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-21T17:38:30.321443] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T17:38:30.551053] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-21T17:38:30.703150] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-21T17:38:30.707329] [INFO ] [REMOTE ] BMEZ: Full fetch complete (39755 records). [2025-10-21T17:38:30.707442] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-21T17:38:31.110698] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-21T17:38:31.110780] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-21T17:38:31.111329] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-21T17:38:31.111368] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-21T17:38:31.112137] [DEBUG] [LOCAL ] BMEZ: Trimmed 39755 records to 25212 (keeping 200 days of data) [2025-10-21T17:38:31.263380] [DEBUG] [LOCAL ] BMEZ: Primary data saved (25212 records). [2025-10-21T17:38:31.263496] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-21T17:38:31.263605] [INFO ] [MAIN ] Update Progress: 307/2366 symbols completed. BMEZ took 39.8s. Estimated remaining: 4h 17m 54s. Rate: 8.0 symbols/min [2025-10-21T17:38:31.361195] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-21T17:38:31.435749] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:38:31.483050] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-21T17:38:31.483373] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-10-21T17:38:31.667302] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:38:31.667470] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-21T17:38:31.667518] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-21T17:38:31.668101] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-21T17:38:31.668184] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-21T17:38:32.074863] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:38:32.156176] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-21T17:38:32.173519] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T17:38:32.332113] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-21T17:38:32.337504] [INFO ] [REMOTE ] BMI: Full fetch complete (33983 records). [2025-10-21T17:38:32.337825] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-21T17:38:32.739938] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-21T17:38:32.740094] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-21T17:38:32.740903] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-21T17:38:32.740983] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-21T17:38:32.742174] [DEBUG] [LOCAL ] BMI: Trimmed 33983 records to 24889 (keeping 200 days of data) [2025-10-21T17:38:32.839857] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-21T17:38:32.901114] [DEBUG] [LOCAL ] BMI: Primary data saved (24889 records). [2025-10-21T17:38:32.901250] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-21T17:38:32.901352] [INFO ] [MAIN ] Update Progress: 308/2366 symbols completed. BMI took 27.7s. Estimated remaining: 4h 17m 7s. Rate: 8.0 symbols/min [2025-10-21T17:38:32.956317] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-21T17:38:33.070053] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:38:33.118075] [DEBUG] [LOCAL ] BN: Loaded 52986 existing records from primary storage. [2025-10-21T17:38:33.118468] [INFO ] [MAIN ] BN: Loaded 52986 existing records. [2025-10-21T17:38:33.291216] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:38:33.291389] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-21T17:38:33.291435] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-21T17:38:33.292327] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-21T17:38:33.292384] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-21T17:38:33.670992] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:38:33.751056] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-21T17:38:34.313010] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-21T17:38:34.313943] [INFO ] [REMOTE ] BMN: Full fetch complete (3655 records). [2025-10-21T17:38:34.314009] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-21T17:38:34.561509] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-21T17:38:34.680584] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-21T17:38:34.680775] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-21T17:38:34.681045] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-21T17:38:34.681145] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-21T17:38:34.681876] [DEBUG] [LOCAL ] BMN: Trimmed 3655 records to 2581 (keeping 200 days of data) [2025-10-21T17:38:34.698447] [DEBUG] [LOCAL ] BMN: Primary data saved (2581 records). [2025-10-21T17:38:34.698538] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-21T17:38:34.698615] [INFO ] [MAIN ] Update Progress: 309/2366 symbols completed. BMN took 28.1s. Estimated remaining: 4h 16m 22s. Rate: 8.0 symbols/min [2025-10-21T17:38:34.871474] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:38:34.903029] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-21T17:38:34.935331] [DEBUG] [LOCAL ] BNED: Loaded 28483 existing records from primary storage. [2025-10-21T17:38:34.935611] [INFO ] [MAIN ] BNED: Loaded 28483 existing records. [2025-10-21T17:38:35.109825] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:38:35.110051] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-21T17:38:35.110110] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-21T17:38:35.110305] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-21T17:38:35.110344] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-21T17:38:35.356140] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-21T17:38:35.455743] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:38:36.151971] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-21T17:38:36.154885] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T17:38:36.951045] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-21T17:38:37.270218] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T17:38:37.751041] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-21T17:38:37.940099] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T17:38:38.551112] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-21T17:38:38.760575] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T17:38:39.351066] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-21T17:38:39.527124] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T17:38:40.008476] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T17:38:40.151045] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-21T17:38:40.957302] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-21T17:38:41.061185] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T17:38:41.751084] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-21T17:38:42.255198] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-21T17:38:42.424112] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T17:38:42.551080] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-21T17:38:43.281939] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T17:38:43.351060] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-21T17:38:44.151016] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-21T17:38:44.702891] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-21T17:38:44.943208] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T17:38:44.952006] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-21T17:38:45.751003] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-21T17:38:46.025730] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T17:38:46.550999] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-21T17:38:46.984543] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T17:38:47.191725] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-21T17:38:47.351029] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-21T17:38:47.916882] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T17:38:48.151026] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-21T17:38:48.951073] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-21T17:38:49.012965] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-21T17:38:49.259968] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T17:38:49.751014] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-21T17:38:50.551116] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-21T17:38:50.695384] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T17:38:51.084285] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-21T17:38:51.351079] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-21T17:38:52.129298] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T17:38:52.135776] [INFO ] [REMOTE ] BMO: Full fetch complete (59770 records). [2025-10-21T17:38:52.135922] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-21T17:38:52.136540] [FATAL] [VALIDATOR ] BMO: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:38:52.136672] [FATAL] [MAIN ] BMO: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:38:52.136734] [WARN ] [MAIN ] BMO: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:38:52.136801] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-21T17:38:52.136865] [DEBUG] [LOCAL ] BMO: No primary data file found to delete. [2025-10-21T17:38:52.136901] [INFO ] [LOCAL ] BMO: Starting deletion of derivative data. [2025-10-21T17:38:52.137053] [DEBUG] [LOCAL ] BMO: Deleted derivative data file. [2025-10-21T17:38:52.137901] [INFO ] [MAIN ] Update Progress: 310/2366 symbols completed. BMO took 29.8s. Estimated remaining: 4h 17m 20s. Rate: 8.0 symbols/min [2025-10-21T17:38:52.160923] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-21T17:38:52.318702] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:38:52.327066] [DEBUG] [LOCAL ] BNH: Loaded 4731 existing records from primary storage. [2025-10-21T17:38:52.327298] [INFO ] [MAIN ] BNH: Loaded 4731 existing records. [2025-10-21T17:38:52.510401] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:38:52.510592] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-21T17:38:52.510664] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-21T17:38:52.510856] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-21T17:38:52.510912] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-21T17:38:52.767507] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T17:38:52.940155] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:38:52.950991] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-21T17:38:53.604315] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-21T17:38:53.751042] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-21T17:38:54.223333] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-21T17:38:54.341376] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-21T17:38:54.551008] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-21T17:38:55.225083] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-21T17:38:55.351018] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-21T17:38:56.151021] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-21T17:38:56.951006] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-21T17:38:57.098097] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T17:38:57.227894] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T17:38:57.751025] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-21T17:38:58.297548] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T17:38:58.551019] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-21T17:38:59.351040] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-21T17:38:59.810819] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-21T17:38:59.819134] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-21T17:38:59.926335] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T17:39:00.151062] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-21T17:39:00.728303] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-21T17:39:00.951032] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-21T17:39:01.528967] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-21T17:39:01.751026] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-21T17:39:02.353105] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-21T17:39:02.551035] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-21T17:39:03.351071] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-21T17:39:04.151044] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-21T17:39:04.518829] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-21T17:39:04.550262] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-21T17:39:04.734876] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T17:39:04.950998] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-21T17:39:05.650917] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-21T17:39:05.652247] [INFO ] [REMOTE ] BNH: Full fetch complete (6854 records). [2025-10-21T17:39:05.652314] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-21T17:39:05.757519] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-21T17:39:06.022584] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-21T17:39:06.022689] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-21T17:39:06.022898] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-21T17:39:06.022938] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-21T17:39:06.023305] [DEBUG] [LOCAL ] BNH: Trimmed 6854 records to 4741 (keeping 200 days of data) [2025-10-21T17:39:06.051903] [DEBUG] [LOCAL ] BNH: Primary data saved (4741 records). [2025-10-21T17:39:06.052005] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-21T17:39:06.052080] [INFO ] [MAIN ] Update Progress: 311/2366 symbols completed. BNH took 13.9s. Estimated remaining: 4h 17m 55s. Rate: 8.0 symbols/min [2025-10-21T17:39:06.227933] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:39:06.232625] [DEBUG] [LOCAL ] BNJ: Loaded 2531 existing records from primary storage. [2025-10-21T17:39:06.232924] [INFO ] [MAIN ] BNJ: Loaded 2531 existing records. [2025-10-21T17:39:06.416114] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:39:06.416309] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-21T17:39:06.416371] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-21T17:39:06.416528] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-21T17:39:06.416567] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-21T17:39:06.564860] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-21T17:39:06.790082] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:39:07.351001] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-21T17:39:07.626446] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T17:39:08.013776] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T17:39:08.151004] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-21T17:39:08.950986] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-21T17:39:09.461155] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-21T17:39:09.513021] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T17:39:09.751076] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-21T17:39:10.551002] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-21T17:39:10.650414] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T17:39:10.659085] [INFO ] [REMOTE ] BMY: Full fetch complete (77937 records). [2025-10-21T17:39:10.659233] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-21T17:39:10.994806] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-21T17:39:11.100025] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-21T17:39:11.100190] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-21T17:39:11.101098] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-21T17:39:11.101241] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-21T17:39:11.133738] [DEBUG] [LOCAL ] BMY: Trimmed 77937 records to 53757 (keeping 200 days of data) [2025-10-21T17:39:11.136018] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-21T17:39:11.145922] [INFO ] [REMOTE ] BN: Full fetch complete (76954 records). [2025-10-21T17:39:11.146094] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-21T17:39:11.354842] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-21T17:39:11.772126] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-21T17:39:11.775681] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-21T17:39:11.777551] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-21T17:39:11.778154] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-21T17:39:11.798373] [DEBUG] [LOCAL ] BN: Trimmed 76954 records to 52984 (keeping 200 days of data) [2025-10-21T17:39:11.999690] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-10-21T17:39:12.000769] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-21T17:39:12.001159] [INFO ] [MAIN ] Update Progress: 312/2366 symbols completed. BMY took 40.7s. Estimated remaining: 4h 17m 37s. Rate: 8.0 symbols/min [2025-10-21T17:39:12.180885] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-21T17:39:12.285091] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:39:12.427008] [DEBUG] [LOCAL ] BN: Primary data saved (52984 records). [2025-10-21T17:39:12.427671] [DEBUG] [LOCAL ] BNL: Loaded 47210 existing records from primary storage. [2025-10-21T17:39:12.428005] [INFO ] [MAIN ] BN: Full history saved. [2025-10-21T17:39:12.428301] [INFO ] [MAIN ] BNL: Loaded 47210 existing records. [2025-10-21T17:39:12.428174] [INFO ] [MAIN ] Update Progress: 313/2366 symbols completed. BN took 39.5s. Estimated remaining: 4h 16m 43s. Rate: 8.0 symbols/min [2025-10-21T17:39:12.797847] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:39:12.831218] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-21T17:39:12.830044] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-21T17:39:12.830947] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T17:39:12.829830] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:39:12.831949] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-21T17:39:12.837402] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-21T17:39:12.837484] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-21T17:39:12.837346] [INFO ] [REMOTE ] BNED: Full fetch complete (42099 records). [2025-10-21T17:39:12.868887] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-21T17:39:12.967334] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-21T17:39:13.456954] [DEBUG] [LOCAL ] BNS: Loaded 51449 existing records from primary storage. [2025-10-21T17:39:13.559789] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:39:13.556049] [INFO ] [MAIN ] BNS: Loaded 51449 existing records. [2025-10-21T17:39:13.727981] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-21T17:39:13.720160] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-21T17:39:13.749044] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-21T17:39:13.751353] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-21T17:39:13.752194] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-21T17:39:13.753455] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-21T17:39:13.833986] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:39:13.829513] [DEBUG] [LOCAL ] BNED: Trimmed 42099 records to 28324 (keeping 200 days of data) [2025-10-21T17:39:13.834223] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-21T17:39:13.834522] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-21T17:39:13.834756] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-21T17:39:13.834817] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-21T17:39:14.277213] [DEBUG] [LOCAL ] BNED: Primary data saved (28324 records). [2025-10-21T17:39:14.283068] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-21T17:39:14.288387] [INFO ] [MAIN ] Update Progress: 314/2366 symbols completed. BNED took 39.6s. Estimated remaining: 4h 15m 59s. Rate: 8.0 symbols/min [2025-10-21T17:39:14.388684] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:39:14.455784] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-21T17:39:14.537436] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:39:14.542273] [DEBUG] [LOCAL ] BNT: Loaded 3553 existing records from primary storage. [2025-10-21T17:39:14.542410] [INFO ] [MAIN ] BNT: Loaded 3553 existing records. [2025-10-21T17:39:14.556241] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-21T17:39:14.734399] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:39:14.734616] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-21T17:39:14.734695] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-21T17:39:14.734870] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-21T17:39:14.734924] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-21T17:39:15.097783] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:39:15.351025] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-21T17:39:16.000189] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-21T17:39:16.150996] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-21T17:39:16.451574] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T17:39:16.579466] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-21T17:39:16.951018] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-21T17:39:17.751087] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-21T17:39:18.551054] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-21T17:39:18.816557] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-21T17:39:18.977575] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-21T17:39:19.117272] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T17:39:19.351036] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-21T17:39:20.151016] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-21T17:39:20.905427] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T17:39:20.950990] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-21T17:39:21.500442] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T17:39:21.751072] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-21T17:39:22.451701] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-21T17:39:22.451571] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T17:39:22.551020] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-21T17:39:23.351083] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-21T17:39:24.151030] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-21T17:39:24.194384] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T17:39:24.721857] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T17:39:24.951039] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-21T17:39:25.175104] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T17:39:25.386133] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-21T17:39:25.751057] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-21T17:39:26.307420] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-21T17:39:26.551026] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-21T17:39:27.184127] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-21T17:39:27.351020] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-21T17:39:27.845751] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-21T17:39:28.151052] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-21T17:39:28.951093] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-21T17:39:29.513006] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-21T17:39:29.751082] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-21T17:39:29.846448] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T17:39:30.063343] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-21T17:39:30.551049] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-21T17:39:31.151999] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-21T17:39:31.152968] [INFO ] [REMOTE ] BNJ: Full fetch complete (3888 records). [2025-10-21T17:39:31.153034] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-21T17:39:31.356263] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-21T17:39:31.503971] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-21T17:39:31.504042] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-21T17:39:31.504167] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-21T17:39:31.504204] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-21T17:39:31.504525] [DEBUG] [LOCAL ] BNJ: Trimmed 3888 records to 2517 (keeping 200 days of data) [2025-10-21T17:39:31.520973] [DEBUG] [LOCAL ] BNJ: Primary data saved (2517 records). [2025-10-21T17:39:31.521089] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-21T17:39:31.521171] [INFO ] [MAIN ] Update Progress: 315/2366 symbols completed. BNJ took 25.5s. Estimated remaining: 4h 16m 55s. Rate: 8.0 symbols/min [2025-10-21T17:39:31.686245] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:39:31.695086] [DEBUG] [LOCAL ] BNY: Loaded 7267 existing records from primary storage. [2025-10-21T17:39:31.695246] [INFO ] [MAIN ] BNY: Loaded 7267 existing records. [2025-10-21T17:39:31.875079] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:39:31.875272] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-21T17:39:31.875330] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-21T17:39:31.875466] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-21T17:39:31.875505] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-21T17:39:31.980505] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-21T17:39:32.156131] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-21T17:39:32.242510] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:39:32.647526] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-21T17:39:32.951018] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-21T17:39:33.538275] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T17:39:33.751041] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-21T17:39:34.551054] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-21T17:39:35.219760] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-21T17:39:35.221080] [INFO ] [REMOTE ] BNT: Full fetch complete (4815 records). [2025-10-21T17:39:35.221148] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-21T17:39:35.372555] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-21T17:39:35.583441] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-21T17:39:35.583669] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-21T17:39:35.583848] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-21T17:39:35.592778] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-21T17:39:35.608145] [DEBUG] [LOCAL ] BNT: Trimmed 4815 records to 3550 (keeping 200 days of data) [2025-10-21T17:39:35.609987] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T17:39:35.640022] [DEBUG] [LOCAL ] BNT: Primary data saved (3550 records). [2025-10-21T17:39:35.640136] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-21T17:39:35.640211] [INFO ] [MAIN ] Update Progress: 316/2366 symbols completed. BNT took 21.3s. Estimated remaining: 4h 16m 25s. Rate: 8.0 symbols/min [2025-10-21T17:39:35.826726] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:39:35.843425] [DEBUG] [LOCAL ] BOC: Loaded 18418 existing records from primary storage. [2025-10-21T17:39:35.843625] [INFO ] [MAIN ] BOC: Loaded 18418 existing records. [2025-10-21T17:39:36.017453] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:39:36.017621] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-21T17:39:36.017695] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-21T17:39:36.017953] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-21T17:39:36.018008] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-21T17:39:36.156258] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-21T17:39:36.304175] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-21T17:39:36.382830] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:39:36.951074] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-21T17:39:37.699404] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-21T17:39:37.760390] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-21T17:39:37.765588] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T17:39:38.521100] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-21T17:39:38.550974] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-21T17:39:39.147204] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-21T17:39:39.351055] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-21T17:39:40.048297] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-21T17:39:40.151059] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-21T17:39:40.951017] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-21T17:39:41.226620] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-21T17:39:41.751084] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-21T17:39:42.551062] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-21T17:39:42.726979] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T17:39:43.350997] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-21T17:39:43.419966] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T17:39:43.439185] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T17:39:43.737940] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-21T17:39:44.151042] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-21T17:39:44.951035] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-21T17:39:45.751010] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-21T17:39:45.915988] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T17:39:46.084694] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-21T17:39:46.551077] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-21T17:39:47.351046] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-21T17:39:47.494076] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T17:39:48.155889] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-21T17:39:48.159199] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T17:39:48.472408] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-21T17:39:48.951105] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-21T17:39:49.758291] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-21T17:39:49.764259] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T17:39:49.969145] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-21T17:39:50.551021] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-21T17:39:51.301406] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-21T17:39:51.351025] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-21T17:39:51.509509] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T17:39:51.517979] [INFO ] [REMOTE ] BNL: Full fetch complete (67225 records). [2025-10-21T17:39:51.518199] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-21T17:39:51.934581] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-21T17:39:51.934696] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-21T17:39:51.935509] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-21T17:39:51.935553] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-21T17:39:51.936960] [DEBUG] [LOCAL ] BNL: Trimmed 67225 records to 47118 (keeping 200 days of data) [2025-10-21T17:39:52.153954] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-21T17:39:52.219292] [DEBUG] [LOCAL ] BNL: Primary data saved (47118 records). [2025-10-21T17:39:52.219444] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-21T17:39:52.219531] [INFO ] [MAIN ] Update Progress: 317/2366 symbols completed. BNL took 40.2s. Estimated remaining: 4h 17m 16s. Rate: 8.0 symbols/min [2025-10-21T17:39:52.951053] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-21T17:39:53.043382] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T17:39:53.207923] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-21T17:39:53.416135] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-21T17:39:53.751085] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-21T17:39:54.551076] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-21T17:39:54.674682] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-21T17:39:55.351001] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-21T17:39:55.424906] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T17:39:55.426801] [INFO ] [REMOTE ] BNY: Full fetch complete (10389 records). [2025-10-21T17:39:55.426868] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-21T17:39:55.782742] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-21T17:39:55.782816] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-21T17:39:55.783049] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-21T17:39:55.783086] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-21T17:39:55.783534] [DEBUG] [LOCAL ] BNY: Trimmed 10389 records to 7268 (keeping 200 days of data) [2025-10-21T17:39:55.825216] [DEBUG] [LOCAL ] BNY: Primary data saved (7268 records). [2025-10-21T17:39:55.825316] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-21T17:39:55.825387] [INFO ] [MAIN ] Update Progress: 318/2366 symbols completed. BNY took 24.3s. Estimated remaining: 4h 16m 44s. Rate: 8.0 symbols/min [2025-10-21T17:39:56.150997] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-21T17:39:56.489200] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-21T17:39:56.951096] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-21T17:39:57.970704] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-21T17:39:57.979159] [INFO ] [REMOTE ] BNS: Full fetch complete (74653 records). [2025-10-21T17:39:57.979305] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-21T17:39:58.156779] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T17:39:58.244932] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-21T17:39:58.402807] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-21T17:39:58.402894] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-21T17:39:58.403696] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-21T17:39:58.403758] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-21T17:39:58.405188] [DEBUG] [LOCAL ] BNS: Trimmed 74653 records to 51426 (keeping 200 days of data) [2025-10-21T17:39:58.712574] [DEBUG] [LOCAL ] BNS: Primary data saved (51426 records). [2025-10-21T17:39:58.712751] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-21T17:39:58.712839] [INFO ] [MAIN ] Update Progress: 319/2366 symbols completed. BNS took 46.3s. Estimated remaining: 4h 16m 6s. Rate: 8.0 symbols/min [2025-10-21T17:39:59.379471] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T17:39:59.383609] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-21T17:40:01.729325] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-21T17:40:01.734413] [INFO ] [REMOTE ] BOC: Full fetch complete (25774 records). [2025-10-21T17:40:01.734594] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-21T17:40:02.131938] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-21T17:40:02.132023] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-21T17:40:02.132452] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-21T17:40:02.132493] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-21T17:40:02.133336] [DEBUG] [LOCAL ] BOC: Trimmed 25774 records to 18280 (keeping 200 days of data) [2025-10-21T17:40:02.238689] [DEBUG] [LOCAL ] BOC: Primary data saved (18280 records). [2025-10-21T17:40:02.238847] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-21T17:40:02.238932] [INFO ] [MAIN ] Update Progress: 320/2366 symbols completed. BOC took 26.6s. Estimated remaining: 4h 15m 33s. Rate: 8.0 symbols/min [2025-10-21T17:40:02.830212] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:40:02.954081] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:40:03.001900] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:40:03.042416] [DEBUG] [LOCAL ] BOE: Loaded 18109 existing records from primary storage. [2025-10-21T17:40:03.041715] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:40:03.042722] [DEBUG] [LOCAL ] BOH: No existing data file found in primary storage. [2025-10-21T17:40:03.043096] [INFO ] [MAIN ] BOE: Loaded 18109 existing records. [2025-10-21T17:40:03.042969] [WARN ] [MAIN ] BOH: No existing data found, performing full refresh instead. [2025-10-21T17:40:03.043371] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-21T17:40:03.043426] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-21T17:40:03.043470] [DEBUG] [LOCAL ] BOH: No primary data file found to delete. [2025-10-21T17:40:03.043503] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-21T17:40:03.427689] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:40:03.440308] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-21T17:40:03.440485] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-21T17:40:03.456771] [DEBUG] [LOCAL ] BOND: Loaded 32481 existing records from primary storage. [2025-10-21T17:40:03.484383] [INFO ] [MAIN ] BOND: Loaded 32481 existing records. [2025-10-21T17:40:03.476711] [DEBUG] [LOCAL ] BOOT: Loaded 39698 existing records from primary storage. [2025-10-21T17:40:03.563676] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-21T17:40:03.541937] [INFO ] [MAIN ] BOOT: Loaded 39698 existing records. [2025-10-21T17:40:03.635435] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-21T17:40:04.005624] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:40:04.142999] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-21T17:40:04.195130] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:40:04.191582] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:40:04.229269] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-21T17:40:04.254568] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-21T17:40:04.271260] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-21T17:40:04.291005] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-21T17:40:04.296729] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-21T17:40:04.303693] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-21T17:40:04.318918] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-21T17:40:04.349138] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-21T17:40:04.678344] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:40:04.695191] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-21T17:40:05.098451] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:40:05.125211] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-21T17:40:05.202875] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:40:05.203172] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-21T17:40:06.204124] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-21T17:40:06.211547] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-21T17:40:06.254441] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T17:40:06.258984] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-21T17:40:06.284483] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-21T17:40:06.291214] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-21T17:40:07.029143] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-21T17:40:07.038068] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-21T17:40:07.081517] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T17:40:07.085715] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-21T17:40:07.112956] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-21T17:40:07.121213] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-21T17:40:07.541680] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T17:40:07.549469] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-21T17:40:08.015482] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-21T17:40:08.150992] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-21T17:40:08.215843] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-21T17:40:08.299183] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T17:40:08.835142] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T17:40:08.950987] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-21T17:40:08.951589] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T17:40:09.751004] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-21T17:40:10.362489] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T17:40:10.551057] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-21T17:40:11.328584] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T17:40:11.351030] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-21T17:40:11.788809] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T17:40:12.151002] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-21T17:40:12.554224] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T17:40:12.951010] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-21T17:40:13.339225] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-21T17:40:13.751064] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-21T17:40:14.063215] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-21T17:40:14.551091] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-21T17:40:15.262355] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T17:40:15.350984] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-21T17:40:15.552236] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-21T17:40:16.151052] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-21T17:40:16.951027] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-21T17:40:17.082756] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T17:40:17.751139] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-21T17:40:18.551100] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-21T17:40:19.076919] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T17:40:19.351110] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-21T17:40:19.602160] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (3.45 seconds). [2025-10-21T17:40:20.151072] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-21T17:40:20.650969] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (3.70 seconds). [2025-10-21T17:40:20.690519] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-21T17:40:20.951082] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-21T17:40:21.507117] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T17:40:21.751074] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-21T17:40:22.549533] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (3.20 seconds). [2025-10-21T17:40:22.555027] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-21T17:40:22.556044] [INFO ] [REMOTE ] BOND: Full fetch complete (46608 records). [2025-10-21T17:40:22.556115] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-21T17:40:22.993290] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-21T17:40:22.991622] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-21T17:40:23.004303] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-21T17:40:23.005391] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-21T17:40:23.005521] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-21T17:40:23.023895] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-21T17:40:23.023069] [DEBUG] [LOCAL ] BOND: Trimmed 46608 records to 32458 (keeping 200 days of data) [2025-10-21T17:40:23.225389] [DEBUG] [LOCAL ] BOND: Primary data saved (32458 records). [2025-10-21T17:40:23.225501] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-21T17:40:23.225574] [INFO ] [MAIN ] Update Progress: 321/2366 symbols completed. BOND took 21.0s. Estimated remaining: 4h 16m 52s. Rate: 8.0 symbols/min [2025-10-21T17:40:23.355739] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-21T17:40:23.411395] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:40:23.428260] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-21T17:40:23.469922] [DEBUG] [LOCAL ] BORR: Loaded 51118 existing records from primary storage. [2025-10-21T17:40:23.470247] [INFO ] [MAIN ] BORR: Loaded 51118 existing records. [2025-10-21T17:40:23.645476] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:40:23.645746] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-21T17:40:23.645803] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-21T17:40:23.646120] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-21T17:40:23.646176] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-21T17:40:23.995483] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:40:24.151034] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-21T17:40:24.951007] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-21T17:40:25.172995] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T17:40:25.514528] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T17:40:25.751032] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-21T17:40:26.400458] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-21T17:40:26.551039] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-21T17:40:26.794448] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T17:40:27.351057] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-21T17:40:28.151022] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-21T17:40:28.950996] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-21T17:40:29.057713] [DEBUG] [REMOTE ] BOE: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-21T17:40:29.058059] [WARN ] [REMOTE ] BOE: No data returned for month 2025-09 [2025-10-21T17:40:29.058187] [FATAL] [REMOTE ] BOE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:40:29.058305] [FATAL] [MAIN ] BOE: Failed to fetch primary data. [2025-10-21T17:40:29.058390] [WARN ] [MAIN ] BOE: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:40:29.058482] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-21T17:40:29.058562] [DEBUG] [LOCAL ] BOE: No primary data file found to delete. [2025-10-21T17:40:29.058601] [INFO ] [LOCAL ] BOE: Starting deletion of derivative data. [2025-10-21T17:40:29.058777] [DEBUG] [LOCAL ] BOE: Deleted derivative data file. [2025-10-21T17:40:29.058863] [INFO ] [MAIN ] Update Progress: 322/2366 symbols completed. BOE took 26.8s. Estimated remaining: 4h 16m 34s. Rate: 8.0 symbols/min [2025-10-21T17:40:29.267354] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:40:29.269387] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-21T17:40:29.296670] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-21T17:40:29.302818] [INFO ] [REMOTE ] BOH: Full fetch complete (45383 records). [2025-10-21T17:40:29.303033] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-21T17:40:29.446398] [DEBUG] [LOCAL ] BOW: Loaded 22961 existing records from primary storage. [2025-10-21T17:40:29.467291] [INFO ] [MAIN ] BOW: Loaded 22961 existing records. [2025-10-21T17:40:29.779462] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-21T17:40:29.833542] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:40:29.833958] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-21T17:40:29.849984] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-21T17:40:29.860447] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-21T17:40:29.860932] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-21T17:40:29.966513] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-21T17:40:29.992323] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-21T17:40:30.009720] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-21T17:40:30.009826] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-21T17:40:30.065738] [DEBUG] [LOCAL ] BOH: Trimmed 45383 records to 30727 (keeping 200 days of data) [2025-10-21T17:40:30.249452] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-21T17:40:30.451852] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:40:30.528759] [DEBUG] [LOCAL ] BOH: Primary data saved (30727 records). [2025-10-21T17:40:30.528888] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-21T17:40:30.528956] [INFO ] [MAIN ] Update Progress: 323/2366 symbols completed. BOH took 28.3s. Estimated remaining: 4h 15m 48s. Rate: 8.0 symbols/min [2025-10-21T17:40:30.558236] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-21T17:40:30.700732] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:40:30.746133] [DEBUG] [LOCAL ] BOX: Loaded 50187 existing records from primary storage. [2025-10-21T17:40:30.746418] [INFO ] [MAIN ] BOX: Loaded 50187 existing records. [2025-10-21T17:40:30.930096] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:40:30.930280] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-21T17:40:30.930326] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-21T17:40:30.930705] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-21T17:40:30.930762] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-21T17:40:31.298597] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:40:31.350983] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-21T17:40:31.733890] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T17:40:32.151072] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-21T17:40:32.582904] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-21T17:40:32.951059] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-21T17:40:33.406140] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-21T17:40:33.739249] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T17:40:33.750981] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-21T17:40:34.278176] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T17:40:34.551072] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-21T17:40:35.351088] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-21T17:40:35.569376] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T17:40:36.154733] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-21T17:40:36.158165] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-21T17:40:36.193339] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T17:40:36.951041] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-21T17:40:37.575086] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-21T17:40:37.751031] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-21T17:40:38.551018] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-21T17:40:38.972084] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-21T17:40:39.351024] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-21T17:40:39.820915] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-21T17:40:39.826851] [INFO ] [REMOTE ] BOOT: Full fetch complete (60010 records). [2025-10-21T17:40:39.827023] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-21T17:40:40.153425] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-21T17:40:40.234014] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-21T17:40:40.234606] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-21T17:40:40.235343] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-21T17:40:40.235480] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-21T17:40:40.236942] [DEBUG] [LOCAL ] BOOT: Trimmed 60010 records to 39541 (keeping 200 days of data) [2025-10-21T17:40:40.271548] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T17:40:40.516053] [DEBUG] [LOCAL ] BOOT: Primary data saved (39541 records). [2025-10-21T17:40:40.516202] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-21T17:40:40.516323] [INFO ] [MAIN ] Update Progress: 324/2366 symbols completed. BOOT took 38.3s. Estimated remaining: 4h 15m 56s. Rate: 8.0 symbols/min [2025-10-21T17:40:40.691147] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:40:40.739250] [DEBUG] [LOCAL ] BP: Loaded 53708 existing records from primary storage. [2025-10-21T17:40:40.739747] [INFO ] [MAIN ] BP: Loaded 53708 existing records. [2025-10-21T17:40:40.919711] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:40:40.920091] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-21T17:40:40.920166] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-21T17:40:40.931591] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-21T17:40:40.952438] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-21T17:40:40.952722] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-21T17:40:40.967999] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T17:40:41.337070] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:40:41.519903] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T17:40:41.751059] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-21T17:40:42.550997] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-21T17:40:42.656815] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T17:40:42.826571] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-21T17:40:43.351101] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-21T17:40:44.151070] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-21T17:40:44.863553] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-21T17:40:44.951084] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-21T17:40:45.242341] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T17:40:45.305611] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T17:40:45.751103] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-21T17:40:46.551069] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-21T17:40:47.015324] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-21T17:40:47.274216] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T17:40:47.350993] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-21T17:40:47.556105] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-21T17:40:48.151040] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-21T17:40:48.951025] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-21T17:40:49.026509] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T17:40:49.751048] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-21T17:40:50.245487] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-21T17:40:50.551013] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-21T17:40:50.947986] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-21T17:40:51.187912] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-21T17:40:51.351067] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-21T17:40:51.845887] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-21T17:40:52.151048] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-21T17:40:52.951002] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-21T17:40:53.074148] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T17:40:53.751079] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-21T17:40:54.024831] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T17:40:54.032702] [INFO ] [REMOTE ] BORR: Full fetch complete (74534 records). [2025-10-21T17:40:54.032831] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-21T17:40:54.439409] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-21T17:40:54.439493] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-21T17:40:54.440299] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-21T17:40:54.440361] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-21T17:40:54.441751] [DEBUG] [LOCAL ] BORR: Trimmed 74534 records to 51097 (keeping 200 days of data) [2025-10-21T17:40:54.553718] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-21T17:40:54.736795] [DEBUG] [LOCAL ] BORR: Primary data saved (51097 records). [2025-10-21T17:40:54.736932] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-21T17:40:54.737010] [INFO ] [MAIN ] Update Progress: 325/2366 symbols completed. BORR took 31.5s. Estimated remaining: 4h 16m 30s. Rate: 8.0 symbols/min [2025-10-21T17:40:54.918992] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:40:54.954026] [DEBUG] [LOCAL ] BR: Loaded 34741 existing records from primary storage. [2025-10-21T17:40:54.954299] [INFO ] [MAIN ] BR: Loaded 34741 existing records. [2025-10-21T17:40:55.145287] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:40:55.145533] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-21T17:40:55.145602] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-21T17:40:55.146386] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-21T17:40:55.146443] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-21T17:40:55.562829] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:40:55.563204] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-21T17:40:55.593843] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-21T17:40:55.781076] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-21T17:40:55.938866] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-21T17:40:55.950722] [INFO ] [REMOTE ] BOX: Full fetch complete (72314 records). [2025-10-21T17:40:55.950941] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-21T17:40:56.161486] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-21T17:40:56.355573] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-21T17:40:56.355673] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-21T17:40:56.356454] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-21T17:40:56.356503] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-21T17:40:56.357859] [DEBUG] [LOCAL ] BOX: Trimmed 72314 records to 50139 (keeping 200 days of data) [2025-10-21T17:40:56.654380] [DEBUG] [LOCAL ] BOX: Primary data saved (50139 records). [2025-10-21T17:40:56.654551] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-21T17:40:56.655404] [INFO ] [MAIN ] Update Progress: 326/2366 symbols completed. BOX took 26.1s. Estimated remaining: 4h 15m 48s. Rate: 8.0 symbols/min [2025-10-21T17:40:56.833847] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:40:56.883014] [DEBUG] [LOCAL ] BRBR: Loaded 51831 existing records from primary storage. [2025-10-21T17:40:56.883348] [INFO ] [MAIN ] BRBR: Loaded 51831 existing records. [2025-10-21T17:40:56.951974] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-21T17:40:57.078810] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:40:57.079083] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-21T17:40:57.079133] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-21T17:40:57.079556] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-21T17:40:57.079612] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-21T17:40:57.400799] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T17:40:57.483725] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:40:57.751009] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-21T17:40:58.088891] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T17:40:58.537569] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-21T17:40:58.550985] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-21T17:40:59.351035] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-21T17:40:59.403665] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T17:41:00.151028] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-21T17:41:00.719058] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T17:41:00.756863] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-21T17:41:00.950993] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-21T17:41:01.185197] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-21T17:41:01.751023] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-21T17:41:02.551070] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-21T17:41:03.351003] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-21T17:41:03.688500] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-21T17:41:03.964540] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-21T17:41:04.150992] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-21T17:41:04.551319] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-21T17:41:04.556627] [INFO ] [REMOTE ] BOW: Full fetch complete (32131 records). [2025-10-21T17:41:04.556776] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-21T17:41:04.680045] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-21T17:41:04.966771] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-21T17:41:05.030295] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-21T17:41:05.030450] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-21T17:41:05.031265] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-21T17:41:05.031347] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-21T17:41:05.032753] [DEBUG] [LOCAL ] BOW: Trimmed 32131 records to 22908 (keeping 200 days of data) [2025-10-21T17:41:05.165635] [DEBUG] [LOCAL ] BOW: Primary data saved (22908 records). [2025-10-21T17:41:05.165808] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-21T17:41:05.165921] [INFO ] [MAIN ] Update Progress: 327/2366 symbols completed. BOW took 36.1s. Estimated remaining: 4h 15m 46s. Rate: 8.0 symbols/min [2025-10-21T17:41:05.337824] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:41:05.355101] [DEBUG] [LOCAL ] BRC: Loaded 18533 existing records from primary storage. [2025-10-21T17:41:05.355345] [INFO ] [MAIN ] BRC: Loaded 18533 existing records. [2025-10-21T17:41:05.550372] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:41:05.550636] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-21T17:41:05.550725] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-21T17:41:05.551233] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-21T17:41:05.551293] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-21T17:41:05.771355] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-21T17:41:05.926066] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:41:06.508198] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-21T17:41:06.551006] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-21T17:41:06.831350] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T17:41:07.350999] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-21T17:41:07.760631] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-21T17:41:08.151039] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-21T17:41:08.762593] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T17:41:08.951011] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-21T17:41:09.003140] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-21T17:41:09.679761] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T17:41:09.751063] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-21T17:41:10.249218] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T17:41:10.551105] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-21T17:41:11.003493] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T17:41:11.351055] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-21T17:41:11.550744] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-21T17:41:12.151091] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-21T17:41:12.865636] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T17:41:12.951082] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-21T17:41:13.751048] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-21T17:41:14.013952] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T17:41:14.171556] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-21T17:41:14.551094] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-21T17:41:14.746066] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T17:41:15.351085] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-21T17:41:16.085034] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-21T17:41:16.151043] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-21T17:41:16.951071] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-21T17:41:17.640566] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-21T17:41:17.650191] [INFO ] [REMOTE ] BP: Full fetch complete (77880 records). [2025-10-21T17:41:17.650350] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-21T17:41:17.753448] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-21T17:41:18.069361] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-21T17:41:18.117429] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-21T17:41:18.117538] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-21T17:41:18.118780] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-21T17:41:18.118845] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-21T17:41:18.120218] [DEBUG] [LOCAL ] BP: Trimmed 77880 records to 53706 (keeping 200 days of data) [2025-10-21T17:41:18.419370] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T17:41:18.476204] [DEBUG] [LOCAL ] BP: Primary data saved (53706 records). [2025-10-21T17:41:18.476491] [INFO ] [MAIN ] BP: Full history saved. [2025-10-21T17:41:18.476911] [INFO ] [MAIN ] Update Progress: 328/2366 symbols completed. BP took 38.0s. Estimated remaining: 4h 16m 15s. Rate: 8.0 symbols/min [2025-10-21T17:41:18.477060] [INFO ] [REMOTE ] BR: Full fetch complete (50006 records). [2025-10-21T17:41:18.520901] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-21T17:41:18.553738] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-21T17:41:18.787822] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:41:19.122070] [DEBUG] [LOCAL ] BRCC: Loaded 40137 existing records from primary storage. [2025-10-21T17:41:19.119422] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-21T17:41:19.122618] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-21T17:41:19.122812] [INFO ] [MAIN ] BRCC: Loaded 40137 existing records. [2025-10-21T17:41:19.129008] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-21T17:41:19.129277] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-21T17:41:19.248277] [DEBUG] [LOCAL ] BR: Trimmed 50006 records to 34606 (keeping 200 days of data) [2025-10-21T17:41:19.250271] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-21T17:41:19.363944] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-21T17:41:19.437605] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:41:19.449068] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-21T17:41:19.467696] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-21T17:41:19.473908] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-21T17:41:19.475859] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-21T17:41:19.755365] [DEBUG] [LOCAL ] BR: Primary data saved (34606 records). [2025-10-21T17:41:19.791016] [INFO ] [MAIN ] BR: Full history saved. [2025-10-21T17:41:19.834538] [INFO ] [MAIN ] Update Progress: 329/2366 symbols completed. BR took 25.1s. Estimated remaining: 4h 15m 29s. Rate: 8.0 symbols/min [2025-10-21T17:41:20.058110] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:41:20.129880] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:41:20.157911] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-21T17:41:20.182245] [DEBUG] [LOCAL ] BRO: Loaded 52094 existing records from primary storage. [2025-10-21T17:41:20.182596] [INFO ] [MAIN ] BRO: Loaded 52094 existing records. [2025-10-21T17:41:20.369312] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:41:20.369928] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-21T17:41:20.369987] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-21T17:41:20.370961] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-21T17:41:20.371028] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-21T17:41:20.566496] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-21T17:41:20.802673] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-21T17:41:20.826528] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:41:20.951021] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-21T17:41:21.540214] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T17:41:21.750986] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-21T17:41:22.001989] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T17:41:22.551050] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-21T17:41:22.871451] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T17:41:23.351041] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-21T17:41:23.937338] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T17:41:24.151007] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-21T17:41:24.385155] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-21T17:41:24.951094] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-21T17:41:25.751066] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-21T17:41:25.815227] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T17:41:26.484026] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T17:41:26.551004] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-21T17:41:26.734852] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-21T17:41:27.351064] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-21T17:41:27.971528] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T17:41:28.151055] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-21T17:41:28.951031] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-21T17:41:29.500165] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T17:41:29.626849] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-21T17:41:29.751004] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-21T17:41:30.551061] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-21T17:41:30.995289] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-21T17:41:31.351069] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-21T17:41:31.505718] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T17:41:32.131847] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-21T17:41:32.150983] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-21T17:41:32.950979] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-21T17:41:33.283804] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T17:41:33.635490] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T17:41:33.750979] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-21T17:41:33.865012] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-21T17:41:33.868240] [INFO ] [REMOTE ] BRC: Full fetch complete (28434 records). [2025-10-21T17:41:33.868338] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-21T17:41:34.248659] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-21T17:41:34.248780] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-21T17:41:34.249246] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-21T17:41:34.249288] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-21T17:41:34.250091] [DEBUG] [LOCAL ] BRC: Trimmed 28434 records to 18420 (keeping 200 days of data) [2025-10-21T17:41:34.360284] [DEBUG] [LOCAL ] BRC: Primary data saved (18420 records). [2025-10-21T17:41:34.360422] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-21T17:41:34.360501] [INFO ] [MAIN ] Update Progress: 330/2366 symbols completed. BRC took 29.2s. Estimated remaining: 4h 16m 4s. Rate: 8.0 symbols/min [2025-10-21T17:41:34.530602] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:41:34.556394] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-21T17:41:34.578895] [DEBUG] [LOCAL ] BROS: Loaded 53300 existing records from primary storage. [2025-10-21T17:41:34.579191] [INFO ] [MAIN ] BROS: Loaded 53300 existing records. [2025-10-21T17:41:34.761260] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:41:34.761458] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-21T17:41:34.761508] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-21T17:41:34.762397] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-21T17:41:34.762455] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-21T17:41:35.143987] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:41:35.160451] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-21T17:41:35.351013] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-21T17:41:36.151090] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-21T17:41:36.276150] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T17:41:36.284499] [INFO ] [REMOTE ] BRBR: Full fetch complete (73162 records). [2025-10-21T17:41:36.284710] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-21T17:41:36.683756] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-21T17:41:36.683906] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-21T17:41:36.684732] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-21T17:41:36.684804] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-21T17:41:36.686130] [DEBUG] [LOCAL ] BRBR: Trimmed 73162 records to 51828 (keeping 200 days of data) [2025-10-21T17:41:36.965320] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-21T17:41:37.004848] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T17:41:37.028076] [DEBUG] [LOCAL ] BRBR: Primary data saved (51828 records). [2025-10-21T17:41:37.028453] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-21T17:41:37.029260] [INFO ] [MAIN ] Update Progress: 331/2366 symbols completed. BRBR took 40.4s. Estimated remaining: 4h 15m 27s. Rate: 8.0 symbols/min [2025-10-21T17:41:37.207737] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:41:37.207962] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-21T17:41:37.208004] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-21T17:41:37.208111] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-21T17:41:37.208178] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-21T17:41:37.208232] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-21T17:41:37.208264] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-21T17:41:37.562165] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:41:37.751049] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-10-21T17:41:37.935153] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T17:41:37.949056] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:41:37.949398] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-10-21T17:41:37.949509] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:41:37.949553] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-21T17:41:37.949588] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:41:37.949677] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-21T17:41:37.949756] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-21T17:41:37.949792] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-21T17:41:37.949831] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-21T17:41:37.949876] [INFO ] [MAIN ] Update Progress: 332/2366 symbols completed. BRSL took 0.9s. Estimated remaining: 4h 14m 39s. Rate: 8.0 symbols/min [2025-10-21T17:41:38.127002] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:41:38.162760] [DEBUG] [LOCAL ] BRSP: Loaded 36685 existing records from primary storage. [2025-10-21T17:41:38.163084] [INFO ] [MAIN ] BRSP: Loaded 36685 existing records. [2025-10-21T17:41:38.347885] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:41:38.348091] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-21T17:41:38.348355] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-21T17:41:38.349328] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-21T17:41:38.349388] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-21T17:41:38.561689] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-21T17:41:38.752147] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:41:38.788778] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T17:41:39.351128] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-21T17:41:39.935215] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T17:41:40.151023] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-21T17:41:40.951038] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-21T17:41:41.458839] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-21T17:41:41.751002] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-21T17:41:42.181077] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-21T17:41:42.431530] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T17:41:42.551005] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-21T17:41:43.351024] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-21T17:41:43.685022] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T17:41:43.718256] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-21T17:41:44.151051] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-21T17:41:44.951003] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-21T17:41:45.382282] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-21T17:41:45.751066] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-21T17:41:45.862505] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T17:41:45.868639] [INFO ] [REMOTE ] BRCC: Full fetch complete (57324 records). [2025-10-21T17:41:45.868841] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-21T17:41:46.247871] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-21T17:41:46.247946] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-21T17:41:46.248616] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-21T17:41:46.248702] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-21T17:41:46.249768] [DEBUG] [LOCAL ] BRCC: Trimmed 57324 records to 40061 (keeping 200 days of data) [2025-10-21T17:41:46.463101] [DEBUG] [LOCAL ] BRCC: Primary data saved (40061 records). [2025-10-21T17:41:46.463215] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-21T17:41:46.463286] [INFO ] [MAIN ] Update Progress: 333/2366 symbols completed. BRCC took 28.0s. Estimated remaining: 4h 14m 37s. Rate: 8.0 symbols/min [2025-10-21T17:41:46.552971] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-21T17:41:46.634880] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:41:46.641828] [DEBUG] [LOCAL ] BRT: Loaded 5249 existing records from primary storage. [2025-10-21T17:41:46.642027] [INFO ] [MAIN ] BRT: Loaded 5249 existing records. [2025-10-21T17:41:46.822130] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:41:46.822695] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-21T17:41:46.833219] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-21T17:41:46.852074] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-21T17:41:46.853584] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T17:41:46.853669] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-21T17:41:47.223214] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:41:47.245178] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T17:41:47.351015] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-21T17:41:48.151043] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-21T17:41:48.652942] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-21T17:41:48.806741] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-21T17:41:48.951043] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-21T17:41:49.519791] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T17:41:49.675286] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-21T17:41:49.751044] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-21T17:41:50.223565] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-21T17:41:50.551049] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-21T17:41:51.351025] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-21T17:41:52.151007] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-21T17:41:52.192224] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T17:41:52.951001] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-21T17:41:53.286800] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-21T17:41:53.295104] [INFO ] [REMOTE ] BRO: Full fetch complete (75076 records). [2025-10-21T17:41:53.295256] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-21T17:41:53.536447] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-21T17:41:53.622896] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-21T17:41:53.724666] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-21T17:41:53.724762] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-21T17:41:53.725555] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-21T17:41:53.725595] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-21T17:41:53.727000] [DEBUG] [LOCAL ] BRO: Trimmed 75076 records to 52096 (keeping 200 days of data) [2025-10-21T17:41:53.782839] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-21T17:41:54.051405] [DEBUG] [LOCAL ] BRO: Primary data saved (52096 records). [2025-10-21T17:41:54.051542] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-21T17:41:54.052417] [INFO ] [MAIN ] Update Progress: 334/2366 symbols completed. BRO took 34.2s. Estimated remaining: 4h 14m 30s. Rate: 8.0 symbols/min [2025-10-21T17:41:54.221371] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:41:54.243281] [DEBUG] [LOCAL ] BRW: Loaded 20943 existing records from primary storage. [2025-10-21T17:41:54.243520] [INFO ] [MAIN ] BRW: Loaded 20943 existing records. [2025-10-21T17:41:54.394239] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-21T17:41:54.429254] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:41:54.429439] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-21T17:41:54.429485] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-21T17:41:54.429665] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-21T17:41:54.429722] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-21T17:41:54.556173] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-21T17:41:54.789170] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:41:55.351044] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-21T17:41:55.913755] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T17:41:56.027114] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-21T17:41:56.151030] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-21T17:41:56.951052] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-21T17:41:57.525000] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-21T17:41:57.751027] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-21T17:41:58.551083] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-21T17:41:58.781996] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T17:41:59.226748] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T17:41:59.350989] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-21T17:41:59.827570] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-21T17:42:00.008538] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-21T17:42:00.151035] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-21T17:42:00.865511] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-21T17:42:00.951033] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-21T17:42:01.751016] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-21T17:42:02.551009] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-21T17:42:02.704566] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T17:42:03.104289] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-21T17:42:03.351017] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-21T17:42:03.918302] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T17:42:04.151037] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-21T17:42:04.951014] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-21T17:42:05.442701] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-21T17:42:05.686990] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-21T17:42:05.756343] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-21T17:42:05.765637] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T17:42:05.772167] [INFO ] [REMOTE ] BRSP: Full fetch complete (54050 records). [2025-10-21T17:42:05.772364] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-21T17:42:06.160773] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-21T17:42:06.160850] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-21T17:42:06.161507] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-21T17:42:06.161547] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-21T17:42:06.162574] [DEBUG] [LOCAL ] BRSP: Trimmed 54050 records to 36602 (keeping 200 days of data) [2025-10-21T17:42:06.366097] [DEBUG] [LOCAL ] BRSP: Primary data saved (36602 records). [2025-10-21T17:42:06.366224] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-21T17:42:06.366802] [INFO ] [MAIN ] Update Progress: 335/2366 symbols completed. BRSP took 28.4s. Estimated remaining: 4h 14m 52s. Rate: 8.0 symbols/min [2025-10-21T17:42:06.548756] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:42:06.551028] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-21T17:42:06.610963] [DEBUG] [LOCAL ] BRX: Loaded 51836 existing records from primary storage. [2025-10-21T17:42:06.611388] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-21T17:42:06.616417] [INFO ] [MAIN ] BRX: Loaded 51836 existing records. [2025-10-21T17:42:06.798051] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:42:06.798299] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-21T17:42:06.798349] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-21T17:42:06.798534] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-21T17:42:06.798574] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-21T17:42:07.152564] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:42:07.351038] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-21T17:42:07.792047] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-21T17:42:08.151018] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-21T17:42:08.629030] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-21T17:42:08.951041] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-21T17:42:09.074282] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T17:42:09.751021] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-21T17:42:10.551037] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-21T17:42:11.059183] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-21T17:42:11.067742] [INFO ] [REMOTE ] BROS: Full fetch complete (77271 records). [2025-10-21T17:42:11.067899] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-21T17:42:11.361553] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-21T17:42:11.474495] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-21T17:42:11.474854] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-21T17:42:11.476082] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-21T17:42:11.476183] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-21T17:42:11.477943] [DEBUG] [LOCAL ] BROS: Trimmed 77271 records to 53301 (keeping 200 days of data) [2025-10-21T17:42:11.596798] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T17:42:11.641787] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-21T17:42:11.845251] [DEBUG] [LOCAL ] BROS: Primary data saved (53301 records). [2025-10-21T17:42:11.845386] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-21T17:42:11.845486] [INFO ] [MAIN ] Update Progress: 336/2366 symbols completed. BROS took 37.5s. Estimated remaining: 4h 14m 32s. Rate: 8.0 symbols/min [2025-10-21T17:42:12.013712] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:42:12.043377] [DEBUG] [LOCAL ] BSAC: Loaded 32970 existing records from primary storage. [2025-10-21T17:42:12.043683] [INFO ] [MAIN ] BSAC: Loaded 32970 existing records. [2025-10-21T17:42:12.156092] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-21T17:42:12.229504] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:42:12.233488] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-21T17:42:12.234023] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-21T17:42:12.234201] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-21T17:42:12.235578] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-21T17:42:12.236233] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-21T17:42:12.590215] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:42:12.951125] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-21T17:42:13.317569] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T17:42:13.751083] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-21T17:42:14.469534] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T17:42:14.550992] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-21T17:42:14.878189] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-21T17:42:15.351064] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-21T17:42:16.083237] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T17:42:16.150993] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-21T17:42:16.178851] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T17:42:16.180569] [INFO ] [REMOTE ] BRT: Full fetch complete (7106 records). [2025-10-21T17:42:16.180636] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-21T17:42:16.539176] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-21T17:42:16.539272] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-21T17:42:16.539529] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-21T17:42:16.539572] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-21T17:42:16.540025] [DEBUG] [LOCAL ] BRT: Trimmed 7106 records to 5264 (keeping 200 days of data) [2025-10-21T17:42:16.571892] [DEBUG] [LOCAL ] BRT: Primary data saved (5264 records). [2025-10-21T17:42:16.572008] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-21T17:42:16.572087] [INFO ] [MAIN ] Update Progress: 337/2366 symbols completed. BRT took 30.1s. Estimated remaining: 4h 14m 8s. Rate: 8.0 symbols/min [2025-10-21T17:42:16.741782] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:42:16.775578] [DEBUG] [LOCAL ] BSBR: Loaded 35912 existing records from primary storage. [2025-10-21T17:42:16.775867] [INFO ] [MAIN ] BSBR: Loaded 35912 existing records. [2025-10-21T17:42:16.957625] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:42:16.954383] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-21T17:42:16.959032] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-21T17:42:16.959100] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-21T17:42:16.959346] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-21T17:42:16.959405] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-21T17:42:17.320045] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:42:17.751057] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-21T17:42:17.840461] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T17:42:18.025922] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T17:42:18.551089] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-21T17:42:18.575135] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T17:42:19.351078] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-21T17:42:19.832129] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T17:42:20.151038] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-21T17:42:20.951089] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-21T17:42:20.986249] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T17:42:21.605313] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-21T17:42:21.751032] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-21T17:42:22.411971] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-21T17:42:22.416490] [INFO ] [REMOTE ] BRW: Full fetch complete (30168 records). [2025-10-21T17:42:22.416578] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-21T17:42:22.560797] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-21T17:42:22.793340] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-21T17:42:22.793410] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-21T17:42:22.793894] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-21T17:42:22.793955] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-21T17:42:22.794686] [DEBUG] [LOCAL ] BRW: Trimmed 30168 records to 21018 (keeping 200 days of data) [2025-10-21T17:42:22.915073] [DEBUG] [LOCAL ] BRW: Primary data saved (21018 records). [2025-10-21T17:42:22.915188] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-21T17:42:22.915261] [INFO ] [MAIN ] Update Progress: 338/2366 symbols completed. BRW took 28.9s. Estimated remaining: 4h 13m 53s. Rate: 8.0 symbols/min [2025-10-21T17:42:23.088123] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:42:23.098610] [DEBUG] [LOCAL ] BSL: Loaded 8235 existing records from primary storage. [2025-10-21T17:42:23.098864] [INFO ] [MAIN ] BSL: Loaded 8235 existing records. [2025-10-21T17:42:23.306693] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:42:23.308070] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T17:42:23.316370] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-21T17:42:23.316756] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-21T17:42:23.317169] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-21T17:42:23.317226] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-21T17:42:23.358883] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-21T17:42:23.671109] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:42:23.979991] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:42:24.151094] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-21T17:42:24.885666] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T17:42:24.951001] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-21T17:42:25.030507] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-21T17:42:25.751056] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-21T17:42:26.475741] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T17:42:26.551029] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-21T17:42:27.072449] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T17:42:27.351020] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-21T17:42:27.926308] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T17:42:28.151003] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-21T17:42:28.951003] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-21T17:42:29.066775] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-21T17:42:29.138006] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T17:42:29.454129] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-21T17:42:29.751034] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-21T17:42:30.539156] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-21T17:42:30.550978] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-21T17:42:31.351439] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-21T17:42:31.351350] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T17:42:32.151102] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-21T17:42:32.605101] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T17:42:32.951083] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-21T17:42:33.588002] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-21T17:42:33.681349] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T17:42:33.751032] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-21T17:42:34.551046] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-21T17:42:35.355418] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-21T17:42:35.386595] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T17:42:35.387548] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T17:42:36.151055] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-21T17:42:36.813792] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T17:42:36.951038] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-21T17:42:37.640943] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-21T17:42:37.751000] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-21T17:42:38.551000] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-21T17:42:38.628581] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T17:42:38.766931] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T17:42:38.773013] [INFO ] [REMOTE ] BSAC: Full fetch complete (45113 records). [2025-10-21T17:42:38.773189] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-21T17:42:39.141990] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-21T17:42:39.142138] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-21T17:42:39.142802] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-21T17:42:39.142924] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-21T17:42:39.144148] [DEBUG] [LOCAL ] BSAC: Trimmed 45113 records to 32912 (keeping 200 days of data) [2025-10-21T17:42:39.306237] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-21T17:42:39.348452] [DEBUG] [LOCAL ] BSAC: Primary data saved (32912 records). [2025-10-21T17:42:39.348585] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-21T17:42:39.348684] [INFO ] [MAIN ] Update Progress: 339/2366 symbols completed. BSAC took 27.5s. Estimated remaining: 4h 14m 39s. Rate: 8.0 symbols/min [2025-10-21T17:42:39.359807] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-21T17:42:39.533838] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:42:39.564970] [DEBUG] [LOCAL ] BSM: Loaded 32482 existing records from primary storage. [2025-10-21T17:42:39.565229] [INFO ] [MAIN ] BSM: Loaded 32482 existing records. [2025-10-21T17:42:39.741767] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:42:39.741979] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-21T17:42:39.742025] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-21T17:42:39.742220] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-21T17:42:39.742274] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-21T17:42:40.100890] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:42:40.150992] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-21T17:42:40.729566] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T17:42:40.951080] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-21T17:42:41.751001] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-21T17:42:41.970177] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-21T17:42:41.978613] [INFO ] [REMOTE ] BRX: Full fetch complete (75133 records). [2025-10-21T17:42:41.978780] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-21T17:42:42.376126] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-21T17:42:42.376295] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-21T17:42:42.377186] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-21T17:42:42.377268] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-21T17:42:42.394603] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T17:42:42.401736] [DEBUG] [LOCAL ] BRX: Trimmed 75133 records to 51823 (keeping 200 days of data) [2025-10-21T17:42:42.586737] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-21T17:42:42.727521] [DEBUG] [LOCAL ] BRX: Primary data saved (51823 records). [2025-10-21T17:42:42.727684] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-21T17:42:42.728441] [INFO ] [MAIN ] Update Progress: 340/2366 symbols completed. BRX took 36.4s. Estimated remaining: 4h 14m 7s. Rate: 8.0 symbols/min [2025-10-21T17:42:42.897198] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:42:42.918421] [DEBUG] [LOCAL ] BST: Loaded 18723 existing records from primary storage. [2025-10-21T17:42:42.918675] [INFO ] [MAIN ] BST: Loaded 18723 existing records. [2025-10-21T17:42:43.055220] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T17:42:43.124439] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:42:43.125062] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-21T17:42:43.125112] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-21T17:42:43.125547] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-21T17:42:43.125604] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-21T17:42:43.230919] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-21T17:42:43.356212] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-21T17:42:43.501020] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:42:43.957303] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-21T17:42:44.151024] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-21T17:42:44.839290] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-21T17:42:44.841904] [INFO ] [REMOTE ] BSL: Full fetch complete (13023 records). [2025-10-21T17:42:44.842062] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-21T17:42:44.956233] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-21T17:42:45.245171] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-21T17:42:45.245248] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-21T17:42:45.245573] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-21T17:42:45.245612] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-21T17:42:45.246171] [DEBUG] [LOCAL ] BSL: Trimmed 13023 records to 8084 (keeping 200 days of data) [2025-10-21T17:42:45.297528] [DEBUG] [LOCAL ] BSL: Primary data saved (8084 records). [2025-10-21T17:42:45.297670] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-21T17:42:45.297767] [INFO ] [MAIN ] Update Progress: 341/2366 symbols completed. BSL took 22.4s. Estimated remaining: 4h 13m 30s. Rate: 8.0 symbols/min [2025-10-21T17:42:45.489496] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:42:45.514439] [DEBUG] [LOCAL ] BSTZ: Loaded 24687 existing records from primary storage. [2025-10-21T17:42:45.514706] [INFO ] [MAIN ] BSTZ: Loaded 24687 existing records. [2025-10-21T17:42:45.688757] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:42:45.688975] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-21T17:42:45.689022] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-21T17:42:45.689472] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-21T17:42:45.689528] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-21T17:42:45.756787] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-21T17:42:46.076951] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:42:46.097940] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-21T17:42:46.551025] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-21T17:42:46.957736] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T17:42:47.351044] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-21T17:42:47.826780] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-21T17:42:48.151031] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-21T17:42:48.951007] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-21T17:42:49.101712] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-21T17:42:49.257723] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T17:42:49.751024] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-21T17:42:49.942605] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-21T17:42:50.551038] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-21T17:42:50.984146] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T17:42:51.351030] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-21T17:42:51.883795] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-21T17:42:52.151070] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-21T17:42:52.763819] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T17:42:52.951017] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-21T17:42:53.274243] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T17:42:53.751042] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-21T17:42:54.307397] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T17:42:54.550991] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-21T17:42:54.951435] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T17:42:55.350996] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-21T17:42:55.389547] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-21T17:42:56.151020] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-21T17:42:56.852425] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-21T17:42:56.950996] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-21T17:42:57.238773] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-21T17:42:57.244543] [INFO ] [REMOTE ] BSBR: Full fetch complete (51150 records). [2025-10-21T17:42:57.244669] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-21T17:42:57.627888] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-21T17:42:57.627969] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-21T17:42:57.628760] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-21T17:42:57.628824] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-21T17:42:57.629887] [DEBUG] [LOCAL ] BSBR: Trimmed 51150 records to 35863 (keeping 200 days of data) [2025-10-21T17:42:57.777223] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-21T17:42:57.830735] [DEBUG] [LOCAL ] BSBR: Primary data saved (35863 records). [2025-10-21T17:42:57.830847] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-21T17:42:57.831204] [INFO ] [MAIN ] Update Progress: 342/2366 symbols completed. BSBR took 41.3s. Estimated remaining: 4h 13m 52s. Rate: 8.0 symbols/min [2025-10-21T17:42:58.001134] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:42:58.051843] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-21T17:42:58.052172] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-10-21T17:42:58.242719] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:42:58.249202] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-21T17:42:58.249308] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-21T17:42:58.254711] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-21T17:42:58.255503] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-21T17:42:58.255572] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-21T17:42:58.556139] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-21T17:42:58.626790] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:42:59.164596] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T17:42:59.351066] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-21T17:42:59.424138] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-21T17:43:00.151024] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-21T17:43:00.951058] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-21T17:43:01.425162] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-21T17:43:01.453974] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T17:43:01.751042] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-21T17:43:02.267622] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T17:43:02.551059] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-21T17:43:03.045448] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-21T17:43:03.351049] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-21T17:43:04.151060] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-21T17:43:04.215445] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T17:43:04.362856] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-21T17:43:04.951046] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-21T17:43:04.977959] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T17:43:05.751061] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-21T17:43:06.551015] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-21T17:43:06.833559] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T17:43:07.197895] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T17:43:07.351067] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-21T17:43:07.816180] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-21T17:43:08.151009] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-21T17:43:08.683672] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T17:43:08.951036] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-21T17:43:09.237007] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-21T17:43:09.751028] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-21T17:43:10.004861] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-21T17:43:10.008910] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36470 records). [2025-10-21T17:43:10.008993] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-21T17:43:10.376248] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-21T17:43:10.376328] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-21T17:43:10.376862] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-21T17:43:10.376925] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-21T17:43:10.377766] [DEBUG] [LOCAL ] BSTZ: Trimmed 36470 records to 24579 (keeping 200 days of data) [2025-10-21T17:43:10.526793] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24579 records). [2025-10-21T17:43:10.526954] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-21T17:43:10.527056] [INFO ] [MAIN ] Update Progress: 343/2366 symbols completed. BSTZ took 25.2s. Estimated remaining: 4h 14m 15s. Rate: 8.0 symbols/min [2025-10-21T17:43:10.556281] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-21T17:43:10.697856] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:43:10.705886] [DEBUG] [LOCAL ] BTA: Loaded 5756 existing records from primary storage. [2025-10-21T17:43:10.706095] [INFO ] [MAIN ] BTA: Loaded 5756 existing records. [2025-10-21T17:43:10.834112] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-21T17:43:10.900078] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:43:10.900284] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-21T17:43:10.900331] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-21T17:43:10.900465] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-21T17:43:10.900502] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-21T17:43:11.247179] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:43:11.351060] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-21T17:43:12.151091] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-21T17:43:12.448974] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-21T17:43:12.637173] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-21T17:43:12.951073] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-21T17:43:13.701905] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-21T17:43:13.750979] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-21T17:43:14.551024] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-21T17:43:14.694138] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T17:43:15.126471] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T17:43:15.131305] [INFO ] [REMOTE ] BSM: Full fetch complete (46929 records). [2025-10-21T17:43:15.131406] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-21T17:43:15.357784] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-21T17:43:15.341340] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-21T17:43:15.617769] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-21T17:43:15.617855] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-21T17:43:15.618577] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-21T17:43:15.618667] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-21T17:43:15.619672] [DEBUG] [LOCAL ] BSM: Trimmed 46929 records to 32421 (keeping 200 days of data) [2025-10-21T17:43:15.818743] [DEBUG] [LOCAL ] BSM: Primary data saved (32421 records). [2025-10-21T17:43:15.818888] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-21T17:43:15.818969] [INFO ] [MAIN ] Update Progress: 344/2366 symbols completed. BSM took 36.5s. Estimated remaining: 4h 13m 54s. Rate: 8.0 symbols/min [2025-10-21T17:43:15.983526] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:43:16.029039] [DEBUG] [LOCAL ] BTE: Loaded 52728 existing records from primary storage. [2025-10-21T17:43:16.029332] [INFO ] [MAIN ] BTE: Loaded 52728 existing records. [2025-10-21T17:43:16.166499] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-21T17:43:16.205583] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:43:16.205761] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-21T17:43:16.205812] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-21T17:43:16.206291] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-21T17:43:16.206366] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-21T17:43:16.556371] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:43:16.951005] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-21T17:43:16.994514] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-21T17:43:17.262322] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T17:43:17.265449] [INFO ] [REMOTE ] BST: Full fetch complete (28343 records). [2025-10-21T17:43:17.265526] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-21T17:43:17.641841] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-21T17:43:17.641926] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-21T17:43:17.642391] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-21T17:43:17.642432] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-21T17:43:17.643078] [DEBUG] [LOCAL ] BST: Trimmed 28343 records to 18592 (keeping 200 days of data) [2025-10-21T17:43:17.752846] [DEBUG] [LOCAL ] BST: Primary data saved (18592 records). [2025-10-21T17:43:17.752945] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-21T17:43:17.753122] [INFO ] [MAIN ] BST: Full history saved. [2025-10-21T17:43:17.753233] [INFO ] [MAIN ] Update Progress: 345/2366 symbols completed. BST took 35.0s. Estimated remaining: 4h 13m 14s. Rate: 8.0 symbols/min [2025-10-21T17:43:17.935660] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:43:17.983871] [DEBUG] [LOCAL ] BTI: Loaded 53594 existing records from primary storage. [2025-10-21T17:43:17.984159] [INFO ] [MAIN ] BTI: Loaded 53594 existing records. [2025-10-21T17:43:18.185561] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:43:18.185867] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-21T17:43:18.185920] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-21T17:43:18.186619] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-21T17:43:18.186713] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-21T17:43:18.553972] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-21T17:43:18.612434] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:43:18.859325] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T17:43:19.180705] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-21T17:43:19.351054] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-21T17:43:19.454020] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T17:43:20.033910] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-21T17:43:20.150990] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-21T17:43:20.654071] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-21T17:43:20.951034] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-21T17:43:21.393124] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-21T17:43:21.751003] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-21T17:43:22.358818] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-21T17:43:22.551077] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-21T17:43:23.238522] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-21T17:43:23.351076] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-21T17:43:24.151052] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-21T17:43:24.951106] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-21T17:43:25.571091] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-21T17:43:25.751042] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-21T17:43:25.845805] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T17:43:26.380614] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-21T17:43:26.551027] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-21T17:43:26.749984] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T17:43:27.351029] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-21T17:43:28.151057] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-21T17:43:28.222462] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T17:43:28.905738] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-21T17:43:28.907358] [INFO ] [REMOTE ] BTA: Full fetch complete (9400 records). [2025-10-21T17:43:28.907424] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-21T17:43:28.961337] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-21T17:43:29.277057] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-21T17:43:29.277169] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-21T17:43:29.277422] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-21T17:43:29.277553] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-21T17:43:29.278238] [DEBUG] [LOCAL ] BTA: Trimmed 9400 records to 5770 (keeping 200 days of data) [2025-10-21T17:43:29.312214] [DEBUG] [LOCAL ] BTA: Primary data saved (5770 records). [2025-10-21T17:43:29.312415] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-21T17:43:29.312527] [INFO ] [MAIN ] Update Progress: 346/2366 symbols completed. BTA took 18.8s. Estimated remaining: 4h 13m 30s. Rate: 8.0 symbols/min [2025-10-21T17:43:29.456969] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-21T17:43:29.522053] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:43:29.532188] [DEBUG] [LOCAL ] BTO: Loaded 8905 existing records from primary storage. [2025-10-21T17:43:29.532394] [INFO ] [MAIN ] BTO: Loaded 8905 existing records. [2025-10-21T17:43:29.709292] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:43:29.709535] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-21T17:43:29.709589] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-21T17:43:29.709875] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-21T17:43:29.709932] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-21T17:43:29.762980] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-21T17:43:30.056807] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:43:30.551010] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-21T17:43:31.350997] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-21T17:43:31.458722] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T17:43:31.458449] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-21T17:43:31.461736] [DEBUG] [REMOTE ] BTI: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-21T17:43:31.473031] [WARN ] [REMOTE ] BTI: No data returned for month 2025-03 [2025-10-21T17:43:31.473875] [FATAL] [REMOTE ] BTI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:43:31.474202] [FATAL] [MAIN ] BTI: Failed to fetch primary data. [2025-10-21T17:43:31.474307] [WARN ] [MAIN ] BTI: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:43:31.474728] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-21T17:43:31.474834] [DEBUG] [LOCAL ] BTI: No primary data file found to delete. [2025-10-21T17:43:31.474894] [INFO ] [LOCAL ] BTI: Starting deletion of derivative data. [2025-10-21T17:43:31.475091] [DEBUG] [LOCAL ] BTI: Deleted derivative data file. [2025-10-21T17:43:31.475894] [INFO ] [MAIN ] Update Progress: 347/2366 symbols completed. BTI took 13.7s. Estimated remaining: 4h 12m 51s. Rate: 8.0 symbols/min [2025-10-21T17:43:31.652455] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:43:31.669624] [DEBUG] [LOCAL ] BTT: Loaded 15488 existing records from primary storage. [2025-10-21T17:43:31.670087] [INFO ] [MAIN ] BTT: Loaded 15488 existing records. [2025-10-21T17:43:31.794385] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-21T17:43:31.919970] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:43:31.920195] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-21T17:43:31.920254] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-21T17:43:31.920626] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-21T17:43:31.920722] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-21T17:43:32.159290] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-21T17:43:32.280160] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:43:32.951037] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-21T17:43:33.534990] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T17:43:33.751041] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-21T17:43:33.982073] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T17:43:34.551027] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-21T17:43:35.339387] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-21T17:43:35.350973] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-21T17:43:35.552906] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T17:43:36.070040] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-21T17:43:36.150989] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-21T17:43:36.951017] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-21T17:43:37.143817] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T17:43:37.751069] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-21T17:43:37.848119] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T17:43:37.856390] [INFO ] [REMOTE ] BSX: Full fetch complete (77861 records). [2025-10-21T17:43:37.856513] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-21T17:43:38.240775] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-21T17:43:38.240877] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-21T17:43:38.241701] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-21T17:43:38.241763] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-21T17:43:38.243134] [DEBUG] [LOCAL ] BSX: Trimmed 77861 records to 53688 (keeping 200 days of data) [2025-10-21T17:43:38.553750] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-21T17:43:38.558236] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-10-21T17:43:38.558347] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-21T17:43:38.559519] [INFO ] [MAIN ] Update Progress: 348/2366 symbols completed. BSX took 40.7s. Estimated remaining: 4h 12m 41s. Rate: 8.0 symbols/min [2025-10-21T17:43:38.738103] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:43:38.748524] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-21T17:43:38.798874] [DEBUG] [LOCAL ] BTU: Loaded 53336 existing records from primary storage. [2025-10-21T17:43:38.799169] [INFO ] [MAIN ] BTU: Loaded 53336 existing records. [2025-10-21T17:43:38.976212] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:43:38.976419] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-21T17:43:38.976467] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-21T17:43:38.977316] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-21T17:43:38.977373] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-21T17:43:39.346739] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:43:39.350981] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-21T17:43:40.151031] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-21T17:43:40.234426] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T17:43:40.915950] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T17:43:40.950996] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-21T17:43:41.037775] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T17:43:41.751040] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-21T17:43:41.799336] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T17:43:42.551019] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-21T17:43:43.351049] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-21T17:43:43.433797] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-21T17:43:43.554095] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T17:43:44.138633] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-21T17:43:44.150970] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-21T17:43:44.951014] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-21T17:43:44.972154] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T17:43:45.751105] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-21T17:43:46.532966] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T17:43:46.550985] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-21T17:43:46.860138] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-21T17:43:47.351029] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-21T17:43:48.045045] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-21T17:43:48.061095] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-21T17:43:48.151004] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-21T17:43:48.951004] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-21T17:43:49.751058] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-21T17:43:49.855604] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T17:43:49.857703] [INFO ] [REMOTE ] BTO: Full fetch complete (13276 records). [2025-10-21T17:43:49.857772] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-21T17:43:49.994182] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T17:43:50.044493] [INFO ] [REMOTE ] BTE: Full fetch complete (75982 records). [2025-10-21T17:43:50.060430] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-21T17:43:50.109430] [FATAL] [VALIDATOR ] BTE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:43:50.147275] [FATAL] [MAIN ] BTE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:43:50.168628] [WARN ] [MAIN ] BTE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:43:50.168837] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-21T17:43:50.168963] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-10-21T17:43:50.174609] [INFO ] [LOCAL ] BTE: Starting deletion of derivative data. [2025-10-21T17:43:50.210959] [DEBUG] [LOCAL ] BTE: Deleted derivative data file. [2025-10-21T17:43:50.226467] [INFO ] [MAIN ] Update Progress: 349/2366 symbols completed. BTE took 34.4s. Estimated remaining: 4h 12m 58s. Rate: 8.0 symbols/min [2025-10-21T17:43:50.289122] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-21T17:43:50.302199] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-21T17:43:50.316568] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-21T17:43:50.325672] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-21T17:43:50.362089] [DEBUG] [LOCAL ] BTO: Trimmed 13276 records to 8841 (keeping 200 days of data) [2025-10-21T17:43:50.475066] [DEBUG] [LOCAL ] BTO: Primary data saved (8841 records). [2025-10-21T17:43:50.475204] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-21T17:43:50.476060] [INFO ] [MAIN ] Update Progress: 350/2366 symbols completed. BTO took 21.2s. Estimated remaining: 4h 12m 8s. Rate: 8.0 symbols/min [2025-10-21T17:43:50.539365] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:43:50.559882] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-21T17:43:50.560129] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-21T17:43:50.559971] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-21T17:43:50.577753] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-21T17:43:50.600521] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-21T17:43:50.600690] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-21T17:43:50.601053] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-21T17:43:50.751578] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:43:50.968438] [DEBUG] [LOCAL ] BTZ: Loaded 22556 existing records from primary storage. [2025-10-21T17:43:50.979189] [INFO ] [MAIN ] BTZ: Loaded 22556 existing records. [2025-10-21T17:43:51.184502] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:43:51.245996] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:43:51.246224] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-21T17:43:51.246298] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-21T17:43:51.246833] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-21T17:43:51.246894] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-21T17:43:51.356120] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-10-21T17:43:51.604531] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:43:51.634789] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:43:51.635028] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-10-21T17:43:51.635115] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:43:51.635182] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-21T17:43:51.635246] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:43:51.635315] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-21T17:43:51.635375] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-21T17:43:51.635411] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-21T17:43:51.635450] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-21T17:43:51.635495] [INFO ] [MAIN ] Update Progress: 351/2366 symbols completed. BTX took 1.4s. Estimated remaining: 4h 11m 24s. Rate: 8.0 symbols/min [2025-10-21T17:43:51.787151] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-21T17:43:51.836432] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:43:51.850098] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-21T17:43:51.912113] [DEBUG] [LOCAL ] BUD: Loaded 52605 existing records from primary storage. [2025-10-21T17:43:51.912389] [INFO ] [MAIN ] BUD: Loaded 52605 existing records. [2025-10-21T17:43:52.090175] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:43:52.090361] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-21T17:43:52.090408] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-21T17:43:52.091271] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-21T17:43:52.091328] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-21T17:43:52.156215] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-21T17:43:52.448210] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:43:52.951071] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-21T17:43:53.334507] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T17:43:53.751050] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-21T17:43:54.551103] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-21T17:43:54.735163] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T17:43:54.772188] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T17:43:55.351071] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-21T17:43:56.151060] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-21T17:43:56.300477] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-21T17:43:56.479480] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T17:43:56.951048] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-21T17:43:57.751063] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-21T17:43:58.053638] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-21T17:43:58.463936] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-21T17:43:58.550988] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-21T17:43:59.351049] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-21T17:43:59.501746] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T17:43:59.945237] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T17:44:00.069475] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T17:44:00.151010] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-21T17:44:00.951027] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-21T17:44:01.751047] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-21T17:44:02.176269] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-21T17:44:02.199868] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T17:44:02.551040] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-21T17:44:03.035578] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T17:44:03.037893] [INFO ] [REMOTE ] BTT: Full fetch complete (22501 records). [2025-10-21T17:44:03.037963] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-21T17:44:03.356157] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-21T17:44:03.421553] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-21T17:44:03.421633] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-21T17:44:03.422119] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-21T17:44:03.422167] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-21T17:44:03.422823] [DEBUG] [LOCAL ] BTT: Trimmed 22501 records to 15421 (keeping 200 days of data) [2025-10-21T17:44:03.514390] [DEBUG] [LOCAL ] BTT: Primary data saved (15421 records). [2025-10-21T17:44:03.514523] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-21T17:44:03.514597] [INFO ] [MAIN ] Update Progress: 352/2366 symbols completed. BTT took 32.0s. Estimated remaining: 4h 11m 42s. Rate: 8.0 symbols/min [2025-10-21T17:44:03.683401] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:44:03.695782] [DEBUG] [LOCAL ] BUI: Loaded 11949 existing records from primary storage. [2025-10-21T17:44:03.696020] [INFO ] [MAIN ] BUI: Loaded 11949 existing records. [2025-10-21T17:44:03.875390] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:44:03.876340] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-21T17:44:03.876627] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-21T17:44:03.892921] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-21T17:44:03.893567] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T17:44:03.893687] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-21T17:44:04.156236] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-21T17:44:04.324039] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:44:04.951036] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-21T17:44:05.605947] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-21T17:44:05.750993] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-21T17:44:06.011671] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T17:44:06.550990] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-21T17:44:07.043676] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (2.89 seconds). [2025-10-21T17:44:07.095613] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-21T17:44:07.350995] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-21T17:44:07.634639] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T17:44:08.079631] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T17:44:08.150999] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-21T17:44:08.951008] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-21T17:44:09.010267] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-21T17:44:09.751038] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-21T17:44:10.550991] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-21T17:44:10.995244] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-21T17:44:11.083416] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T17:44:11.351003] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-21T17:44:11.553869] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-21T17:44:12.151025] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-21T17:44:12.939320] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-21T17:44:12.950970] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-21T17:44:13.219888] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T17:44:13.751055] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-21T17:44:13.843792] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-21T17:44:14.551000] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-21T17:44:14.953877] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T17:44:15.351034] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-21T17:44:16.151005] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-21T17:44:16.319447] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T17:44:16.923108] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-21T17:44:16.931541] [INFO ] [REMOTE ] BTU: Full fetch complete (77296 records). [2025-10-21T17:44:16.931740] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-21T17:44:16.963065] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-21T17:44:17.344076] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-21T17:44:17.344164] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-21T17:44:17.345093] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-21T17:44:17.345160] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-21T17:44:17.346671] [DEBUG] [LOCAL ] BTU: Trimmed 77296 records to 53337 (keeping 200 days of data) [2025-10-21T17:44:17.452799] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-21T17:44:17.678182] [DEBUG] [LOCAL ] BTU: Primary data saved (53337 records). [2025-10-21T17:44:17.678319] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-21T17:44:17.678916] [INFO ] [MAIN ] Update Progress: 353/2366 symbols completed. BTU took 39.1s. Estimated remaining: 4h 12m 12s. Rate: 8.0 symbols/min [2025-10-21T17:44:17.757141] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-21T17:44:17.861029] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:44:17.876354] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-21T17:44:17.920514] [DEBUG] [LOCAL ] BUR: Loaded 45494 existing records from primary storage. [2025-10-21T17:44:17.920864] [INFO ] [MAIN ] BUR: Loaded 45494 existing records. [2025-10-21T17:44:18.094210] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:44:18.094398] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-21T17:44:18.094443] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-21T17:44:18.095268] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-21T17:44:18.095326] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-21T17:44:18.449325] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:44:18.550990] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-21T17:44:18.651007] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-21T17:44:19.351077] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-21T17:44:19.407483] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T17:44:20.151050] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-21T17:44:20.950996] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-21T17:44:21.318610] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-21T17:44:21.499617] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T17:44:21.751027] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-21T17:44:22.176536] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T17:44:22.179090] [INFO ] [REMOTE ] BUI: Full fetch complete (16577 records). [2025-10-21T17:44:22.179183] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-21T17:44:22.568423] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-21T17:44:22.579559] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-21T17:44:22.579631] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-21T17:44:22.580097] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-21T17:44:22.580173] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-21T17:44:22.580906] [DEBUG] [LOCAL ] BUI: Trimmed 16577 records to 11926 (keeping 200 days of data) [2025-10-21T17:44:22.656234] [DEBUG] [LOCAL ] BUI: Primary data saved (11926 records). [2025-10-21T17:44:22.656355] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-21T17:44:22.656426] [INFO ] [MAIN ] Update Progress: 354/2366 symbols completed. BUI took 19.1s. Estimated remaining: 4h 11m 50s. Rate: 8.0 symbols/min [2025-10-21T17:44:22.820474] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:44:22.862439] [DEBUG] [LOCAL ] BURL: Loaded 45583 existing records from primary storage. [2025-10-21T17:44:22.862753] [INFO ] [MAIN ] BURL: Loaded 45583 existing records. [2025-10-21T17:44:23.033953] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:44:23.034160] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-21T17:44:23.034226] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-21T17:44:23.035062] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-21T17:44:23.035124] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-21T17:44:23.360009] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-21T17:44:23.388997] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:44:23.555125] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T17:44:24.143205] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T17:44:24.151055] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-21T17:44:24.641213] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T17:44:24.951072] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-21T17:44:25.562983] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T17:44:25.751076] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-21T17:44:26.474619] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T17:44:26.551015] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-21T17:44:27.350997] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-21T17:44:27.623772] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T17:44:28.152229] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-21T17:44:28.157163] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T17:44:28.927130] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T17:44:28.951009] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-21T17:44:29.647204] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T17:44:29.651401] [INFO ] [REMOTE ] BTZ: Full fetch complete (33360 records). [2025-10-21T17:44:29.651532] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-21T17:44:29.757846] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-21T17:44:30.036242] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-21T17:44:30.036315] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-21T17:44:30.036805] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-21T17:44:30.036865] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-21T17:44:30.037556] [DEBUG] [LOCAL ] BTZ: Trimmed 33360 records to 22540 (keeping 200 days of data) [2025-10-21T17:44:30.173579] [DEBUG] [LOCAL ] BTZ: Primary data saved (22540 records). [2025-10-21T17:44:30.173723] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-21T17:44:30.173809] [INFO ] [MAIN ] Update Progress: 355/2366 symbols completed. BTZ took 39.7s. Estimated remaining: 4h 11m 43s. Rate: 8.0 symbols/min [2025-10-21T17:44:30.370228] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:44:30.386129] [DEBUG] [LOCAL ] BUXX: Loaded 15466 existing records from primary storage. [2025-10-21T17:44:30.386345] [INFO ] [MAIN ] BUXX: Loaded 15466 existing records. [2025-10-21T17:44:30.552329] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-21T17:44:30.595616] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:44:30.596580] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-21T17:44:30.596770] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-21T17:44:30.597288] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-21T17:44:30.597406] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-21T17:44:30.875756] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-21T17:44:31.003563] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:44:31.351009] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-21T17:44:31.932995] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-21T17:44:31.985497] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-21T17:44:32.151004] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-21T17:44:32.411825] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T17:44:32.951047] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-21T17:44:33.683861] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-21T17:44:33.750995] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-21T17:44:33.870353] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T17:44:34.551046] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-21T17:44:35.351061] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-21T17:44:35.415976] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T17:44:35.519637] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T17:44:36.151073] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-21T17:44:36.951079] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-21T17:44:37.185979] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T17:44:37.335216] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-21T17:44:37.343682] [INFO ] [REMOTE ] BUD: Full fetch complete (76491 records). [2025-10-21T17:44:37.343805] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-21T17:44:37.732210] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-21T17:44:37.732308] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-21T17:44:37.733140] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-21T17:44:37.733207] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-21T17:44:37.734623] [DEBUG] [LOCAL ] BUD: Trimmed 76491 records to 52604 (keeping 200 days of data) [2025-10-21T17:44:37.785203] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-21T17:44:38.042235] [DEBUG] [LOCAL ] BUD: Primary data saved (52604 records). [2025-10-21T17:44:38.043185] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-21T17:44:38.043287] [INFO ] [MAIN ] Update Progress: 356/2366 symbols completed. BUD took 46.4s. Estimated remaining: 4h 11m 38s. Rate: 8.0 symbols/min [2025-10-21T17:44:38.224818] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:44:38.259662] [DEBUG] [LOCAL ] BV: Loaded 38556 existing records from primary storage. [2025-10-21T17:44:38.259948] [INFO ] [MAIN ] BV: Loaded 38556 existing records. [2025-10-21T17:44:38.442006] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:44:38.442290] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-21T17:44:38.442491] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-21T17:44:38.443232] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-21T17:44:38.443295] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-21T17:44:38.554768] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-21T17:44:38.629878] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T17:44:38.852720] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:44:39.350995] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-21T17:44:39.630543] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-21T17:44:39.788777] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-21T17:44:40.151075] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-21T17:44:40.608975] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-21T17:44:40.950998] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-21T17:44:41.187176] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T17:44:41.751102] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-21T17:44:42.274302] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T17:44:42.551042] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-21T17:44:43.351059] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-21T17:44:43.460383] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T17:44:44.151100] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-21T17:44:44.198463] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T17:44:44.517827] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-21T17:44:44.951088] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-21T17:44:45.754040] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-21T17:44:45.759341] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T17:44:46.447896] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T17:44:46.550986] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-21T17:44:46.957544] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-21T17:44:47.351039] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-21T17:44:48.151012] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-21T17:44:48.198405] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T17:44:48.741424] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T17:44:48.942464] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T17:44:48.950983] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-21T17:44:49.750997] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-21T17:44:49.867291] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T17:44:50.551029] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-21T17:44:51.290990] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T17:44:51.350992] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-21T17:44:51.566692] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T17:44:51.570583] [INFO ] [REMOTE ] BUXX: Full fetch complete (20728 records). [2025-10-21T17:44:51.570699] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-21T17:44:51.979017] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-21T17:44:51.979146] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-21T17:44:51.979695] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-21T17:44:51.979758] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-21T17:44:51.980587] [DEBUG] [LOCAL ] BUXX: Trimmed 20728 records to 15430 (keeping 200 days of data) [2025-10-21T17:44:52.080414] [DEBUG] [LOCAL ] BUXX: Primary data saved (15430 records). [2025-10-21T17:44:52.080548] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-21T17:44:52.080625] [INFO ] [MAIN ] Update Progress: 357/2366 symbols completed. BUXX took 21.9s. Estimated remaining: 4h 12m 7s. Rate: 8.0 symbols/min [2025-10-21T17:44:52.151002] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-21T17:44:52.891728] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T17:44:52.951056] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-21T17:44:53.751101] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-21T17:44:54.084218] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T17:44:54.551013] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-21T17:44:54.979568] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-21T17:44:54.987729] [INFO ] [REMOTE ] BURL: Full fetch complete (65820 records). [2025-10-21T17:44:54.987957] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-21T17:44:55.175478] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T17:44:55.356114] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-21T17:44:55.449003] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-21T17:44:55.449118] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-21T17:44:55.450224] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-21T17:44:55.450307] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-21T17:44:55.452462] [DEBUG] [LOCAL ] BURL: Trimmed 65820 records to 45509 (keeping 200 days of data) [2025-10-21T17:44:55.740203] [DEBUG] [LOCAL ] BURL: Primary data saved (45509 records). [2025-10-21T17:44:55.740384] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-21T17:44:55.741281] [INFO ] [MAIN ] Update Progress: 358/2366 symbols completed. BURL took 33.1s. Estimated remaining: 4h 11m 38s. Rate: 8.0 symbols/min [2025-10-21T17:44:55.920864] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T17:44:55.929300] [INFO ] [REMOTE ] BUR: Full fetch complete (64423 records). [2025-10-21T17:44:55.929435] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-21T17:44:56.375188] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-21T17:44:56.375285] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-21T17:44:56.376149] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-21T17:44:56.376237] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-21T17:44:56.377625] [DEBUG] [LOCAL ] BUR: Trimmed 64423 records to 45478 (keeping 200 days of data) [2025-10-21T17:44:56.656034] [DEBUG] [LOCAL ] BUR: Primary data saved (45478 records). [2025-10-21T17:44:56.656230] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-21T17:44:56.656632] [INFO ] [MAIN ] Update Progress: 359/2366 symbols completed. BUR took 39.0s. Estimated remaining: 4h 10m 53s. Rate: 8.0 symbols/min [2025-10-21T17:44:56.886155] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T17:44:56.894802] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-21T17:44:58.463446] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-21T17:44:58.473458] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-21T17:44:59.733210] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-21T17:44:59.742088] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-21T17:45:01.449977] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T17:45:01.456263] [INFO ] [REMOTE ] BV: Full fetch complete (54908 records). [2025-10-21T17:45:01.456379] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-21T17:45:01.868779] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-21T17:45:01.868883] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-21T17:45:01.869876] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-21T17:45:01.869942] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-21T17:45:01.871222] [DEBUG] [LOCAL ] BV: Trimmed 54908 records to 38499 (keeping 200 days of data) [2025-10-21T17:45:02.121919] [DEBUG] [LOCAL ] BV: Primary data saved (38499 records). [2025-10-21T17:45:02.122074] [INFO ] [MAIN ] BV: Full history saved. [2025-10-21T17:45:02.122178] [INFO ] [MAIN ] Update Progress: 360/2366 symbols completed. BV took 24.1s. Estimated remaining: 4h 10m 34s. Rate: 8.0 symbols/min [2025-10-21T17:45:02.815135] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:45:02.841808] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:45:02.933785] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:45:02.953749] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:45:02.969366] [DEBUG] [LOCAL ] BWG: Loaded 12624 existing records from primary storage. [2025-10-21T17:45:02.969836] [INFO ] [MAIN ] BWG: Loaded 12624 existing records. [2025-10-21T17:45:03.170789] [DEBUG] [LOCAL ] BVN: Loaded 44477 existing records from primary storage. [2025-10-21T17:45:03.209042] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:45:03.220866] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-21T17:45:03.223088] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-21T17:45:03.222869] [INFO ] [MAIN ] BVN: Loaded 44477 existing records. [2025-10-21T17:45:03.228624] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-21T17:45:03.258114] [DEBUG] [LOCAL ] BW: Loaded 40452 existing records from primary storage. [2025-10-21T17:45:03.284011] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-21T17:45:03.308542] [INFO ] [MAIN ] BW: Loaded 40452 existing records. [2025-10-21T17:45:03.418051] [DEBUG] [LOCAL ] BWA: Loaded 52108 existing records from primary storage. [2025-10-21T17:45:03.452237] [INFO ] [MAIN ] BWA: Loaded 52108 existing records. [2025-10-21T17:45:03.699838] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:45:03.715761] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-21T17:45:03.772514] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-21T17:45:03.821276] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-21T17:45:03.846501] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-21T17:45:04.017959] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:45:04.047229] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-21T17:45:04.056849] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-21T17:45:04.184034] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-21T17:45:04.211634] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-21T17:45:04.260534] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:45:04.277090] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-21T17:45:04.328944] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-21T17:45:04.536476] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-21T17:45:04.536632] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-21T17:45:04.541262] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:45:04.580044] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-21T17:45:04.983450] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:45:05.023633] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-21T17:45:05.360503] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:45:05.377381] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-21T17:45:05.380729] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:45:05.381773] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-21T17:45:05.776845] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T17:45:05.780406] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-21T17:45:06.641857] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T17:45:06.644408] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-21T17:45:07.097675] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-21T17:45:07.106004] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-21T17:45:07.287344] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-21T17:45:07.295830] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-21T17:45:07.336062] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-21T17:45:07.346318] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-21T17:45:07.395314] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-21T17:45:07.397596] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-21T17:45:08.299092] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-21T17:45:08.302060] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-21T17:45:08.530569] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:45:08.540686] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-21T17:45:08.791369] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T17:45:08.801233] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-21T17:45:08.902082] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-21T17:45:08.951032] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-21T17:45:09.350471] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-21T17:45:09.433864] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-21T17:45:09.751104] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-21T17:45:10.379295] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T17:45:10.461940] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-21T17:45:10.551030] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-21T17:45:10.854738] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T17:45:11.351026] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-21T17:45:12.151037] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-21T17:45:12.248747] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-21T17:45:12.444189] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T17:45:12.951025] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-21T17:45:13.634794] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-21T17:45:13.751000] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-21T17:45:14.206885] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-21T17:45:14.551085] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-21T17:45:15.351031] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-21T17:45:15.568740] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T17:45:16.135265] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-21T17:45:16.151003] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-21T17:45:16.951003] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-21T17:45:16.968912] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-21T17:45:16.970625] [INFO ] [REMOTE ] BWG: Full fetch complete (17716 records). [2025-10-21T17:45:16.970721] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-21T17:45:17.340098] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-21T17:45:17.340173] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-21T17:45:17.340572] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-21T17:45:17.340615] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-21T17:45:17.341183] [DEBUG] [LOCAL ] BWG: Trimmed 17716 records to 12632 (keeping 200 days of data) [2025-10-21T17:45:17.424788] [DEBUG] [LOCAL ] BWG: Primary data saved (12632 records). [2025-10-21T17:45:17.424973] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-21T17:45:17.425102] [INFO ] [MAIN ] Update Progress: 361/2366 symbols completed. BWG took 15.3s. Estimated remaining: 4h 11m 10s. Rate: 8.0 symbols/min [2025-10-21T17:45:17.631288] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:45:17.661971] [DEBUG] [LOCAL ] BWLP: Loaded 32227 existing records from primary storage. [2025-10-21T17:45:17.662248] [INFO ] [MAIN ] BWLP: Loaded 32227 existing records. [2025-10-21T17:45:17.756229] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-21T17:45:17.845039] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:45:17.845276] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-21T17:45:17.845325] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-21T17:45:17.845922] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-21T17:45:17.845981] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-21T17:45:18.242589] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:45:18.263466] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-21T17:45:18.551091] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-21T17:45:19.099284] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-21T17:45:19.350998] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-21T17:45:19.466093] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T17:45:19.901566] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T17:45:20.151021] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-21T17:45:20.951055] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-21T17:45:21.071331] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T17:45:21.757177] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-21T17:45:21.762793] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T17:45:22.430863] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T17:45:22.551028] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-21T17:45:23.351020] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-21T17:45:23.479153] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T17:45:23.954548] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T17:45:24.151078] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-21T17:45:24.951014] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-21T17:45:25.046494] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T17:45:25.706795] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T17:45:25.751019] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-21T17:45:26.551013] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-21T17:45:26.736948] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T17:45:27.351021] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-21T17:45:27.437947] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T17:45:27.890212] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T17:45:28.151114] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-21T17:45:28.951004] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-21T17:45:29.145180] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T17:45:29.575536] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-21T17:45:29.751033] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-21T17:45:30.551008] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-21T17:45:30.963194] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-21T17:45:31.351039] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-21T17:45:32.131184] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-21T17:45:32.139001] [INFO ] [REMOTE ] BW: Full fetch complete (59373 records). [2025-10-21T17:45:32.139141] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-21T17:45:32.174624] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-21T17:45:32.549570] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-21T17:45:32.549740] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-21T17:45:32.550477] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-21T17:45:32.550556] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-21T17:45:32.551834] [DEBUG] [LOCAL ] BW: Trimmed 59373 records to 40403 (keeping 200 days of data) [2025-10-21T17:45:32.773060] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T17:45:32.805066] [DEBUG] [LOCAL ] BW: Primary data saved (40403 records). [2025-10-21T17:45:32.805312] [INFO ] [MAIN ] BW: Full history saved. [2025-10-21T17:45:32.805417] [INFO ] [MAIN ] Update Progress: 362/2366 symbols completed. BW took 30.7s. Estimated remaining: 4h 11m 46s. Rate: 8.0 symbols/min [2025-10-21T17:45:32.952023] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-21T17:45:32.946785] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-21T17:45:33.007601] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:45:33.008863] [INFO ] [REMOTE ] BVN: Full fetch complete (63089 records). [2025-10-21T17:45:33.008987] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-21T17:45:33.009921] [FATAL] [VALIDATOR ] BVN: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:45:33.010004] [FATAL] [MAIN ] BVN: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:45:33.010046] [WARN ] [MAIN ] BVN: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:45:33.010113] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-21T17:45:33.010176] [DEBUG] [LOCAL ] BVN: No primary data file found to delete. [2025-10-21T17:45:33.010211] [INFO ] [LOCAL ] BVN: Starting deletion of derivative data. [2025-10-21T17:45:33.010467] [DEBUG] [LOCAL ] BVN: Deleted derivative data file. [2025-10-21T17:45:33.010566] [INFO ] [MAIN ] Update Progress: 363/2366 symbols completed. BVN took 30.9s. Estimated remaining: 4h 10m 58s. Rate: 8.0 symbols/min [2025-10-21T17:45:33.116446] [DEBUG] [LOCAL ] BWMX: Loaded 7887 existing records from primary storage. [2025-10-21T17:45:33.119560] [INFO ] [MAIN ] BWMX: Loaded 7887 existing records. [2025-10-21T17:45:33.302771] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:45:33.378357] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:45:33.381242] [DEBUG] [LOCAL ] BWNB: Loaded 4101 existing records from primary storage. [2025-10-21T17:45:33.381552] [INFO ] [MAIN ] BWNB: Loaded 4101 existing records. [2025-10-21T17:45:33.412978] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-21T17:45:33.445620] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-21T17:45:33.473707] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-21T17:45:33.484472] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-21T17:45:33.679487] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:45:33.685268] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-21T17:45:33.690481] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-21T17:45:33.701033] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-21T17:45:33.701302] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-21T17:45:34.102678] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:45:34.144490] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-21T17:45:34.344293] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-21T17:45:34.357524] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:45:34.551035] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-21T17:45:34.927356] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T17:45:35.289342] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T17:45:35.351028] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-21T17:45:35.858034] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-21T17:45:36.151042] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-21T17:45:36.475578] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-21T17:45:36.484188] [INFO ] [REMOTE ] BWA: Full fetch complete (75892 records). [2025-10-21T17:45:36.484317] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-21T17:45:36.751577] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-21T17:45:36.885338] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-21T17:45:36.885420] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-21T17:45:36.886249] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-21T17:45:36.886311] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-21T17:45:36.887698] [DEBUG] [LOCAL ] BWA: Trimmed 75892 records to 52084 (keeping 200 days of data) [2025-10-21T17:45:36.973279] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-21T17:45:37.198716] [DEBUG] [LOCAL ] BWA: Primary data saved (52084 records). [2025-10-21T17:45:37.198861] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-21T17:45:37.198943] [INFO ] [MAIN ] Update Progress: 364/2366 symbols completed. BWA took 35.1s. Estimated remaining: 4h 10m 32s. Rate: 8.0 symbols/min [2025-10-21T17:45:37.369301] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:45:37.376123] [DEBUG] [LOCAL ] BWSN: Loaded 5120 existing records from primary storage. [2025-10-21T17:45:37.376362] [INFO ] [MAIN ] BWSN: Loaded 5120 existing records. [2025-10-21T17:45:37.558151] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:45:37.558374] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-21T17:45:37.558421] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-21T17:45:37.558697] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-21T17:45:37.558753] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-21T17:45:37.761297] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-21T17:45:37.936484] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:45:37.956066] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-21T17:45:38.458312] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-21T17:45:38.551030] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-21T17:45:39.067983] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-21T17:45:39.351041] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-21T17:45:40.151022] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-21T17:45:40.736096] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T17:45:40.912234] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T17:45:40.951038] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-21T17:45:41.699294] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T17:45:41.751037] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-21T17:45:42.551039] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-21T17:45:42.654944] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-21T17:45:43.351020] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-21T17:45:43.914359] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T17:45:44.136518] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T17:45:44.150981] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-21T17:45:44.776491] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-21T17:45:44.951032] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-21T17:45:45.592325] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-21T17:45:45.751027] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-21T17:45:46.339223] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-21T17:45:46.551051] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-21T17:45:46.995524] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-21T17:45:47.351060] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-21T17:45:47.958607] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-21T17:45:48.151028] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-21T17:45:48.951034] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-21T17:45:49.751022] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-21T17:45:49.772428] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T17:45:49.820233] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T17:45:50.305782] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-21T17:45:50.551022] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-21T17:45:51.351020] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-21T17:45:51.951150] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T17:45:51.952224] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-21T17:45:52.151030] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-21T17:45:52.649554] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-21T17:45:52.951043] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-21T17:45:53.553444] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-21T17:45:53.751033] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-21T17:45:54.332976] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-21T17:45:54.551058] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-21T17:45:55.351030] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-21T17:45:55.951956] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T17:45:55.956905] [INFO ] [REMOTE ] BWLP: Full fetch complete (47605 records). [2025-10-21T17:45:55.956983] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-21T17:45:55.957507] [FATAL] [VALIDATOR ] BWLP: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:45:55.957587] [FATAL] [MAIN ] BWLP: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:45:55.957628] [WARN ] [MAIN ] BWLP: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:45:55.957713] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-21T17:45:55.957773] [DEBUG] [LOCAL ] BWLP: No primary data file found to delete. [2025-10-21T17:45:55.957806] [INFO ] [LOCAL ] BWLP: Starting deletion of derivative data. [2025-10-21T17:45:55.957956] [DEBUG] [LOCAL ] BWLP: Deleted derivative data file. [2025-10-21T17:45:55.958038] [INFO ] [MAIN ] Update Progress: 365/2366 symbols completed. BWLP took 38.5s. Estimated remaining: 4h 11m 26s. Rate: 8.0 symbols/min [2025-10-21T17:45:56.063365] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T17:45:56.065334] [INFO ] [REMOTE ] BWMX: Full fetch complete (9939 records). [2025-10-21T17:45:56.076262] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-21T17:45:56.152979] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-21T17:45:56.210415] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:45:56.587536] [DEBUG] [LOCAL ] BWXT: Loaded 47285 existing records from primary storage. [2025-10-21T17:45:56.594462] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-21T17:45:56.594737] [INFO ] [MAIN ] BWXT: Loaded 47285 existing records. [2025-10-21T17:45:56.599995] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-21T17:45:56.600383] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-21T17:45:56.619752] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-21T17:45:56.691513] [DEBUG] [LOCAL ] BWMX: Trimmed 9939 records to 7868 (keeping 200 days of data) [2025-10-21T17:45:56.846010] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:45:56.849894] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-21T17:45:56.850017] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-21T17:45:56.857835] [DEBUG] [LOCAL ] BWMX: Primary data saved (7868 records). [2025-10-21T17:45:56.858076] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-21T17:45:56.858265] [INFO ] [MAIN ] Update Progress: 366/2366 symbols completed. BWMX took 24.1s. Estimated remaining: 4h 10m 43s. Rate: 8.0 symbols/min [2025-10-21T17:45:56.870209] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-21T17:45:56.870399] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-21T17:45:56.888802] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-21T17:45:56.974050] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-21T17:45:57.274876] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:45:57.479112] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:45:57.517354] [DEBUG] [LOCAL ] BX: Loaded 53483 existing records from primary storage. [2025-10-21T17:45:57.517708] [INFO ] [MAIN ] BX: Loaded 53483 existing records. [2025-10-21T17:45:57.626015] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-21T17:45:57.703102] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:45:57.703359] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-21T17:45:57.703406] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-21T17:45:57.704166] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-21T17:45:57.704224] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-21T17:45:57.756166] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-21T17:45:58.057085] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:45:58.463324] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-21T17:45:58.551037] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-21T17:45:59.351032] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-21T17:46:00.151026] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-21T17:46:00.295787] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T17:46:00.341696] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T17:46:00.342940] [INFO ] [REMOTE ] BWNB: Full fetch complete (5588 records). [2025-10-21T17:46:00.343022] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-21T17:46:00.756696] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-21T17:46:00.756801] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-21T17:46:00.757011] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-21T17:46:00.757053] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-21T17:46:00.757559] [DEBUG] [LOCAL ] BWNB: Trimmed 5588 records to 4079 (keeping 200 days of data) [2025-10-21T17:46:00.783493] [DEBUG] [LOCAL ] BWNB: Primary data saved (4079 records). [2025-10-21T17:46:00.783625] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-21T17:46:00.783741] [INFO ] [MAIN ] Update Progress: 367/2366 symbols completed. BWNB took 27.8s. Estimated remaining: 4h 10m 16s. Rate: 8.0 symbols/min [2025-10-21T17:46:00.950964] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:46:00.951039] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-21T17:46:00.968250] [DEBUG] [LOCAL ] BXC: Loaded 13571 existing records from primary storage. [2025-10-21T17:46:00.968500] [INFO ] [MAIN ] BXC: Loaded 13571 existing records. [2025-10-21T17:46:01.144148] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:46:01.144382] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-21T17:46:01.144429] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-21T17:46:01.144603] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-21T17:46:01.144709] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-21T17:46:01.441042] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-21T17:46:01.521661] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:46:01.751052] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-21T17:46:02.300878] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-21T17:46:02.551017] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-21T17:46:02.645877] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-21T17:46:03.351065] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-21T17:46:03.673187] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-21T17:46:03.899401] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-21T17:46:04.151018] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-21T17:46:04.950988] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-21T17:46:05.021141] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T17:46:05.022443] [INFO ] [REMOTE ] BWSN: Full fetch complete (6342 records). [2025-10-21T17:46:05.022510] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-21T17:46:05.022881] [FATAL] [VALIDATOR ] BWSN: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:46:05.022965] [FATAL] [MAIN ] BWSN: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:46:05.023042] [WARN ] [MAIN ] BWSN: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:46:05.023114] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-21T17:46:05.023175] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-10-21T17:46:05.023210] [INFO ] [LOCAL ] BWSN: Starting deletion of derivative data. [2025-10-21T17:46:05.023356] [DEBUG] [LOCAL ] BWSN: Deleted derivative data file. [2025-10-21T17:46:05.023441] [INFO ] [MAIN ] Update Progress: 368/2366 symbols completed. BWSN took 27.8s. Estimated remaining: 4h 9m 50s. Rate: 8.0 symbols/min [2025-10-21T17:46:05.193123] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:46:05.235475] [DEBUG] [LOCAL ] BXMT: Loaded 47292 existing records from primary storage. [2025-10-21T17:46:05.235805] [INFO ] [MAIN ] BXMT: Loaded 47292 existing records. [2025-10-21T17:46:05.412188] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:46:05.412797] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-21T17:46:05.412856] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-21T17:46:05.413126] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-21T17:46:05.413162] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-21T17:46:05.787821] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:46:05.751971] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-21T17:46:05.790157] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-21T17:46:06.551064] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-21T17:46:07.351001] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-21T17:46:07.451472] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-21T17:46:07.744008] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-21T17:46:08.151043] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-21T17:46:08.951065] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-21T17:46:09.082920] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T17:46:09.751002] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-21T17:46:09.822607] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-21T17:46:09.956754] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T17:46:10.551096] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-21T17:46:11.351035] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-21T17:46:11.678297] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-21T17:46:11.700785] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T17:46:12.151111] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-21T17:46:12.951032] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-21T17:46:13.132959] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T17:46:13.261592] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-21T17:46:13.751063] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-21T17:46:14.551029] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-21T17:46:14.632366] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T17:46:15.350998] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-21T17:46:15.608050] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T17:46:16.151021] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-21T17:46:16.403593] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T17:46:16.640505] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-21T17:46:16.951083] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-21T17:46:17.530968] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T17:46:17.751013] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-21T17:46:17.794443] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-21T17:46:18.551031] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-21T17:46:19.351022] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-21T17:46:19.765968] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T17:46:20.152569] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-21T17:46:20.154754] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T17:46:20.411386] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T17:46:20.951097] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-21T17:46:21.751063] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-21T17:46:21.824208] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T17:46:22.064575] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T17:46:22.066818] [INFO ] [REMOTE ] BXC: Full fetch complete (18336 records). [2025-10-21T17:46:22.066887] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-21T17:46:22.419680] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-21T17:46:22.419763] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-21T17:46:22.420154] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-21T17:46:22.420191] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-21T17:46:22.420731] [DEBUG] [LOCAL ] BXC: Trimmed 18336 records to 13531 (keeping 200 days of data) [2025-10-21T17:46:22.496718] [DEBUG] [LOCAL ] BXC: Primary data saved (13531 records). [2025-10-21T17:46:22.496838] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-21T17:46:22.496911] [INFO ] [MAIN ] Update Progress: 369/2366 symbols completed. BXC took 21.7s. Estimated remaining: 4h 10m 37s. Rate: 8.0 symbols/min [2025-10-21T17:46:22.563770] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-21T17:46:22.671749] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:46:22.690795] [DEBUG] [LOCAL ] BXMX: Loaded 19355 existing records from primary storage. [2025-10-21T17:46:22.691023] [INFO ] [MAIN ] BXMX: Loaded 19355 existing records. [2025-10-21T17:46:22.886989] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:46:22.887182] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-21T17:46:22.887227] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-21T17:46:22.887709] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-21T17:46:22.887766] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-21T17:46:23.242201] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:46:23.320538] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T17:46:23.350982] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-21T17:46:24.151082] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-21T17:46:24.516572] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T17:46:24.537788] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-21T17:46:24.951016] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-21T17:46:25.751049] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-21T17:46:26.254001] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-21T17:46:26.551033] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-21T17:46:26.912348] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-21T17:46:27.045337] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T17:46:27.324533] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T17:46:27.350981] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-21T17:46:28.151028] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-21T17:46:28.244111] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-21T17:46:28.951072] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-21T17:46:29.756174] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-21T17:46:29.761972] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T17:46:30.551079] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-21T17:46:30.984974] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-21T17:46:31.351060] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-21T17:46:31.590415] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T17:46:32.151019] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-21T17:46:32.233360] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T17:46:32.951048] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-21T17:46:33.255475] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T17:46:33.746604] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T17:46:33.751564] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-21T17:46:34.120636] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-21T17:46:34.551075] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-21T17:46:35.351094] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-21T17:46:35.949414] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-21T17:46:35.957272] [INFO ] [REMOTE ] BWXT: Full fetch complete (68071 records). [2025-10-21T17:46:35.957431] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-21T17:46:36.163380] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-21T17:46:36.282498] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-21T17:46:36.378608] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-21T17:46:36.378707] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-21T17:46:36.379432] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-21T17:46:36.379478] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-21T17:46:36.380719] [DEBUG] [LOCAL ] BWXT: Trimmed 68071 records to 47258 (keeping 200 days of data) [2025-10-21T17:46:36.669468] [DEBUG] [LOCAL ] BWXT: Primary data saved (47258 records). [2025-10-21T17:46:36.669689] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-21T17:46:36.669785] [INFO ] [MAIN ] Update Progress: 370/2366 symbols completed. BWXT took 40.7s. Estimated remaining: 4h 11m 5s. Rate: 7.9 symbols/min [2025-10-21T17:46:36.872476] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-21T17:46:36.874055] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:46:36.874277] [DEBUG] [LOCAL ] BXP: No existing data file found in primary storage. [2025-10-21T17:46:36.882131] [WARN ] [MAIN ] BXP: No existing data found, performing full refresh instead. [2025-10-21T17:46:36.882373] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-21T17:46:36.882429] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-21T17:46:36.882473] [DEBUG] [LOCAL ] BXP: No primary data file found to delete. [2025-10-21T17:46:36.882506] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-21T17:46:36.926671] [INFO ] [REMOTE ] BX: Full fetch complete (77596 records). [2025-10-21T17:46:36.949024] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-21T17:46:36.960195] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-21T17:46:37.602355] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:46:37.679220] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-21T17:46:37.679385] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-21T17:46:37.680394] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-21T17:46:37.680474] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-21T17:46:37.705202] [DEBUG] [LOCAL ] BX: Trimmed 77596 records to 53483 (keeping 200 days of data) [2025-10-21T17:46:37.706875] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T17:46:37.770627] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-21T17:46:38.040668] [DEBUG] [LOCAL ] BX: Primary data saved (53483 records). [2025-10-21T17:46:38.040886] [INFO ] [MAIN ] BX: Full history saved. [2025-10-21T17:46:38.041691] [INFO ] [MAIN ] Update Progress: 371/2366 symbols completed. BX took 41.2s. Estimated remaining: 4h 10m 24s. Rate: 8.0 symbols/min [2025-10-21T17:46:38.211340] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:46:38.224130] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-21T17:46:38.267010] [DEBUG] [LOCAL ] BXSL: Loaded 48208 existing records from primary storage. [2025-10-21T17:46:38.267289] [INFO ] [MAIN ] BXSL: Loaded 48208 existing records. [2025-10-21T17:46:38.444955] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:46:38.445165] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-21T17:46:38.445222] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-21T17:46:38.445478] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-21T17:46:38.445514] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-21T17:46:38.556216] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-21T17:46:38.795905] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:46:39.351073] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-21T17:46:39.678892] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-21T17:46:40.151069] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-21T17:46:40.206619] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T17:46:40.512451] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T17:46:40.951051] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-21T17:46:41.751028] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-21T17:46:41.858765] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T17:46:41.926335] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-21T17:46:42.551078] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-21T17:46:43.351039] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-21T17:46:43.455299] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-21T17:46:43.463134] [INFO ] [REMOTE ] BXMT: Full fetch complete (69883 records). [2025-10-21T17:46:43.463248] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-21T17:46:43.860747] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-21T17:46:43.860948] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-21T17:46:43.861866] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-21T17:46:43.861929] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-21T17:46:43.863215] [DEBUG] [LOCAL ] BXMT: Trimmed 69883 records to 47278 (keeping 200 days of data) [2025-10-21T17:46:44.151439] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-21T17:46:44.180136] [DEBUG] [LOCAL ] BXMT: Primary data saved (47278 records). [2025-10-21T17:46:44.180312] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-21T17:46:44.181172] [INFO ] [MAIN ] Update Progress: 372/2366 symbols completed. BXMT took 39.2s. Estimated remaining: 4h 10m 9s. Rate: 8.0 symbols/min [2025-10-21T17:46:44.183872] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T17:46:44.361113] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:46:44.383408] [DEBUG] [LOCAL ] BY: Loaded 21868 existing records from primary storage. [2025-10-21T17:46:44.383678] [INFO ] [MAIN ] BY: Loaded 21868 existing records. [2025-10-21T17:46:44.563999] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:46:44.564220] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-21T17:46:44.564265] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-21T17:46:44.564464] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-21T17:46:44.564518] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-21T17:46:44.941152] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:46:44.950980] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-21T17:46:44.995814] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T17:46:45.167369] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T17:46:45.751087] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-21T17:46:46.164720] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-21T17:46:46.551078] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-21T17:46:47.351018] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-21T17:46:47.466452] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T17:46:47.619120] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T17:46:48.151031] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-21T17:46:48.682193] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-21T17:46:48.951051] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-21T17:46:49.037635] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-21T17:46:49.040882] [INFO ] [REMOTE ] BXMX: Full fetch complete (28569 records). [2025-10-21T17:46:49.040969] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-21T17:46:49.407509] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-21T17:46:49.407599] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-21T17:46:49.408107] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-21T17:46:49.408182] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-21T17:46:49.408865] [DEBUG] [LOCAL ] BXMX: Trimmed 28569 records to 19175 (keeping 200 days of data) [2025-10-21T17:46:49.520489] [DEBUG] [LOCAL ] BXMX: Primary data saved (19175 records). [2025-10-21T17:46:49.520621] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-21T17:46:49.520744] [INFO ] [MAIN ] Update Progress: 373/2366 symbols completed. BXMX took 27.0s. Estimated remaining: 4h 9m 50s. Rate: 8.0 symbols/min [2025-10-21T17:46:49.687422] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:46:49.687577] [DEBUG] [LOCAL ] BYD: No existing data file found in primary storage. [2025-10-21T17:46:49.687612] [WARN ] [MAIN ] BYD: No existing data found, performing full refresh instead. [2025-10-21T17:46:49.687769] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-21T17:46:49.687859] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-21T17:46:49.687927] [DEBUG] [LOCAL ] BYD: No primary data file found to delete. [2025-10-21T17:46:49.687962] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-21T17:46:49.756199] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-21T17:46:50.047554] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:46:50.551054] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-21T17:46:50.695933] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T17:46:50.729721] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-21T17:46:51.351019] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-21T17:46:52.150990] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-21T17:46:52.359468] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T17:46:52.951047] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-21T17:46:53.231894] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T17:46:53.375237] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T17:46:53.751023] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-21T17:46:54.552061] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-21T17:46:54.551832] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T17:46:54.604270] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-21T17:46:55.351051] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-21T17:46:56.151008] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-21T17:46:56.206634] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T17:46:56.594807] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-21T17:46:56.951023] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-21T17:46:57.676062] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T17:46:57.751038] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-21T17:46:58.551036] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-21T17:46:58.668368] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T17:46:58.860148] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T17:46:59.351012] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-21T17:46:59.915844] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T17:47:00.150999] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-21T17:47:00.951007] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-21T17:47:01.382112] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-21T17:47:01.751081] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-21T17:47:01.950672] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T17:47:02.551087] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-21T17:47:02.712737] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T17:47:03.027420] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-21T17:47:03.351086] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-21T17:47:04.020272] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-21T17:47:04.150995] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-21T17:47:04.951001] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-21T17:47:05.124960] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T17:47:05.151297] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-21T17:47:05.751024] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-21T17:47:06.551008] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-21T17:47:07.021072] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-21T17:47:07.209391] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-21T17:47:07.350994] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-21T17:47:07.662452] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T17:47:07.670819] [INFO ] [REMOTE ] BXSL: Full fetch complete (70040 records). [2025-10-21T17:47:07.670933] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-21T17:47:08.074181] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-21T17:47:08.074263] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-21T17:47:08.075035] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-21T17:47:08.075097] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-21T17:47:08.076347] [DEBUG] [LOCAL ] BXSL: Trimmed 70040 records to 48203 (keeping 200 days of data) [2025-10-21T17:47:08.163245] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-21T17:47:08.369270] [DEBUG] [LOCAL ] BXSL: Primary data saved (48203 records). [2025-10-21T17:47:08.369364] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-21T17:47:08.369437] [INFO ] [MAIN ] Update Progress: 374/2366 symbols completed. BXSL took 30.3s. Estimated remaining: 4h 10m 43s. Rate: 7.9 symbols/min [2025-10-21T17:47:08.539605] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:47:08.552819] [DEBUG] [LOCAL ] BYM: Loaded 11543 existing records from primary storage. [2025-10-21T17:47:08.553020] [INFO ] [MAIN ] BYM: Loaded 11543 existing records. [2025-10-21T17:47:08.738577] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:47:08.738786] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-21T17:47:08.738840] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-21T17:47:08.738997] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-21T17:47:08.739053] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-21T17:47:08.953484] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-21T17:47:09.112727] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:47:09.225420] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T17:47:09.297006] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T17:47:09.751015] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-21T17:47:10.551014] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-21T17:47:10.703271] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T17:47:10.762223] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T17:47:11.350999] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-21T17:47:12.151071] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-21T17:47:12.246342] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T17:47:12.922556] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T17:47:12.950985] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-21T17:47:12.980229] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T17:47:13.751058] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-21T17:47:14.180134] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-21T17:47:14.551089] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-21T17:47:14.880073] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T17:47:14.883680] [INFO ] [REMOTE ] BY: Full fetch complete (29622 records). [2025-10-21T17:47:14.883769] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-21T17:47:15.264715] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-21T17:47:15.264795] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-21T17:47:15.265241] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-21T17:47:15.265280] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-21T17:47:15.265974] [DEBUG] [LOCAL ] BY: Trimmed 29622 records to 21802 (keeping 200 days of data) [2025-10-21T17:47:15.352965] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-21T17:47:15.399176] [DEBUG] [LOCAL ] BY: Primary data saved (21802 records). [2025-10-21T17:47:15.399290] [INFO ] [MAIN ] BY: Full history saved. [2025-10-21T17:47:15.399362] [INFO ] [MAIN ] Update Progress: 375/2366 symbols completed. BY took 31.2s. Estimated remaining: 4h 10m 33s. Rate: 7.9 symbols/min [2025-10-21T17:47:15.570683] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:47:15.601581] [DEBUG] [LOCAL ] BZH: Loaded 32291 existing records from primary storage. [2025-10-21T17:47:15.601909] [INFO ] [MAIN ] BZH: Loaded 32291 existing records. [2025-10-21T17:47:15.784792] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:47:15.785014] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-21T17:47:15.785068] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-21T17:47:15.785388] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-21T17:47:15.785453] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-21T17:47:16.152811] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:47:16.152899] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-21T17:47:16.484499] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-21T17:47:16.514001] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-21T17:47:16.951079] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-21T17:47:17.751016] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-21T17:47:17.796913] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-21T17:47:17.804747] [INFO ] [REMOTE ] BXP: Full fetch complete (72240 records). [2025-10-21T17:47:17.804885] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-21T17:47:18.202682] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-21T17:47:18.202821] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-21T17:47:18.203619] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-21T17:47:18.203777] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-21T17:47:18.205083] [DEBUG] [LOCAL ] BXP: Trimmed 72240 records to 49875 (keeping 200 days of data) [2025-10-21T17:47:18.429749] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T17:47:18.527519] [DEBUG] [LOCAL ] BXP: Primary data saved (49875 records). [2025-10-21T17:47:18.527662] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-21T17:47:18.527753] [INFO ] [MAIN ] Update Progress: 376/2366 symbols completed. BXP took 41.9s. Estimated remaining: 4h 10m 2s. Rate: 8.0 symbols/min [2025-10-21T17:47:18.557241] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-21T17:47:18.699484] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:47:18.699738] [DEBUG] [LOCAL ] C: No existing data file found in primary storage. [2025-10-21T17:47:18.699784] [WARN ] [MAIN ] C: No existing data found, performing full refresh instead. [2025-10-21T17:47:18.699891] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-21T17:47:18.699930] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-21T17:47:18.699970] [DEBUG] [LOCAL ] C: No primary data file found to delete. [2025-10-21T17:47:18.700005] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-21T17:47:19.052826] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:47:19.351076] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-21T17:47:19.493929] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T17:47:19.645105] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T17:47:19.652093] [INFO ] [REMOTE ] BYD: Full fetch complete (65381 records). [2025-10-21T17:47:19.652225] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-21T17:47:20.044918] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-21T17:47:20.044986] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-21T17:47:20.045728] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-21T17:47:20.045788] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-21T17:47:20.047020] [DEBUG] [LOCAL ] BYD: Trimmed 65381 records to 44943 (keeping 200 days of data) [2025-10-21T17:47:20.151103] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-21T17:47:20.315926] [DEBUG] [LOCAL ] BYD: Primary data saved (44943 records). [2025-10-21T17:47:20.316049] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-21T17:47:20.316115] [INFO ] [MAIN ] Update Progress: 377/2366 symbols completed. BYD took 30.8s. Estimated remaining: 4h 9m 24s. Rate: 8.0 symbols/min [2025-10-21T17:47:20.486373] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:47:20.506137] [DEBUG] [LOCAL ] CAAP: Loaded 19913 existing records from primary storage. [2025-10-21T17:47:20.506354] [INFO ] [MAIN ] CAAP: Loaded 19913 existing records. [2025-10-21T17:47:20.681612] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:47:20.681837] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-21T17:47:20.681890] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-21T17:47:20.682026] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-21T17:47:20.682062] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-21T17:47:20.953675] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-21T17:47:21.032764] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:47:21.511164] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-21T17:47:21.664799] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T17:47:21.751050] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-21T17:47:21.948076] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-21T17:47:22.551029] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-21T17:47:23.079171] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T17:47:23.351013] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-21T17:47:23.457951] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-21T17:47:24.151086] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-21T17:47:24.475540] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T17:47:24.952082] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-21T17:47:24.953048] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T17:47:25.751054] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-21T17:47:26.551009] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-21T17:47:26.570424] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T17:47:26.881625] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-21T17:47:27.351075] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-21T17:47:27.600475] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-21T17:47:28.151090] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-21T17:47:28.951250] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T17:47:28.951338] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-21T17:47:29.181168] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T17:47:29.751030] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-21T17:47:30.226867] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T17:47:30.551014] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-21T17:47:30.616709] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T17:47:30.619145] [INFO ] [REMOTE ] BYM: Full fetch complete (17327 records). [2025-10-21T17:47:30.619218] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-21T17:47:31.013736] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-21T17:47:31.013821] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-21T17:47:31.014178] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-21T17:47:31.014217] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-21T17:47:31.014730] [DEBUG] [LOCAL ] BYM: Trimmed 17327 records to 11430 (keeping 200 days of data) [2025-10-21T17:47:31.081440] [DEBUG] [LOCAL ] BYM: Primary data saved (11430 records). [2025-10-21T17:47:31.081567] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-21T17:47:31.081668] [INFO ] [MAIN ] Update Progress: 378/2366 symbols completed. BYM took 22.7s. Estimated remaining: 4h 9m 33s. Rate: 8.0 symbols/min [2025-10-21T17:47:31.249062] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:47:31.268106] [DEBUG] [LOCAL ] CABO: Loaded 16723 existing records from primary storage. [2025-10-21T17:47:31.268402] [INFO ] [MAIN ] CABO: Loaded 16723 existing records. [2025-10-21T17:47:31.360051] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-21T17:47:31.453804] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:47:31.454032] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-21T17:47:31.454081] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-21T17:47:31.454285] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-21T17:47:31.454342] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-21T17:47:31.830274] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:47:32.151056] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-21T17:47:32.534086] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-21T17:47:32.740352] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-21T17:47:32.951086] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-21T17:47:33.172077] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-21T17:47:33.751082] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-21T17:47:33.836059] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-21T17:47:34.551060] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-21T17:47:35.351003] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-21T17:47:35.610734] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-21T17:47:35.868362] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-21T17:47:36.151094] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-21T17:47:36.581193] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T17:47:36.951055] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-21T17:47:37.750982] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-21T17:47:37.997706] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T17:47:38.059815] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T17:47:38.425140] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-21T17:47:38.551018] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-21T17:47:39.351021] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-21T17:47:39.908710] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T17:47:40.151033] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-21T17:47:40.426235] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T17:47:40.951077] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-21T17:47:41.236531] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-21T17:47:41.751085] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-21T17:47:42.470372] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T17:47:42.550989] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-21T17:47:42.704970] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T17:47:43.351061] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-21T17:47:44.151015] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-21T17:47:44.309466] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-21T17:47:44.951055] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-21T17:47:45.026770] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-21T17:47:45.065900] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-21T17:47:45.751034] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-21T17:47:46.101188] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T17:47:46.551024] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-21T17:47:47.081117] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T17:47:47.086926] [INFO ] [REMOTE ] BZH: Full fetch complete (46963 records). [2025-10-21T17:47:47.087081] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-21T17:47:47.087829] [FATAL] [VALIDATOR ] BZH: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:47:47.087938] [FATAL] [MAIN ] BZH: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:47:47.088006] [WARN ] [MAIN ] BZH: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:47:47.088086] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-21T17:47:47.088203] [DEBUG] [LOCAL ] BZH: No primary data file found to delete. [2025-10-21T17:47:47.088275] [INFO ] [LOCAL ] BZH: Starting deletion of derivative data. [2025-10-21T17:47:47.088479] [DEBUG] [LOCAL ] BZH: Deleted derivative data file. [2025-10-21T17:47:47.088967] [INFO ] [MAIN ] Update Progress: 379/2366 symbols completed. BZH took 31.7s. Estimated remaining: 4h 10m 10s. Rate: 7.9 symbols/min [2025-10-21T17:47:47.263191] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:47:47.286043] [DEBUG] [LOCAL ] CACI: Loaded 22704 existing records from primary storage. [2025-10-21T17:47:47.286278] [INFO ] [MAIN ] CACI: Loaded 22704 existing records. [2025-10-21T17:47:47.359723] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-21T17:47:47.466797] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:47:47.467050] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-21T17:47:47.477850] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-21T17:47:47.478191] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-21T17:47:47.478931] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-21T17:47:47.478552] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-21T17:47:47.855449] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:47:48.151022] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-21T17:47:48.951038] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-21T17:47:49.545269] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-21T17:47:49.690807] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T17:47:49.711320] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-21T17:47:49.750990] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-21T17:47:50.551059] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-21T17:47:51.130003] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T17:47:51.351000] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-21T17:47:51.563802] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-21T17:47:52.151031] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-21T17:47:52.512681] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T17:47:52.951078] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-21T17:47:53.751015] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-21T17:47:54.225091] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T17:47:54.228943] [INFO ] [REMOTE ] CAAP: Full fetch complete (27898 records). [2025-10-21T17:47:54.229025] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-21T17:47:54.551378] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-21T17:47:54.639255] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-21T17:47:54.640190] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-21T17:47:54.640744] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-21T17:47:54.640857] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-21T17:47:54.643532] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-21T17:47:54.655850] [DEBUG] [LOCAL ] CAAP: Trimmed 27898 records to 19895 (keeping 200 days of data) [2025-10-21T17:47:54.767489] [DEBUG] [LOCAL ] CAAP: Primary data saved (19895 records). [2025-10-21T17:47:54.767616] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-21T17:47:54.767720] [INFO ] [MAIN ] Update Progress: 380/2366 symbols completed. CAAP took 34.5s. Estimated remaining: 4h 10m 3s. Rate: 7.9 symbols/min [2025-10-21T17:47:54.940068] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:47:54.984318] [DEBUG] [LOCAL ] CADE: Loaded 49658 existing records from primary storage. [2025-10-21T17:47:54.984611] [INFO ] [MAIN ] CADE: Loaded 49658 existing records. [2025-10-21T17:47:55.162401] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:47:55.162614] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-21T17:47:55.162699] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-21T17:47:55.163450] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-21T17:47:55.163507] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-21T17:47:55.356662] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-21T17:47:55.445496] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-21T17:47:55.548232] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T17:47:55.569009] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:47:56.151071] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-21T17:47:56.951025] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-21T17:47:57.660522] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T17:47:57.751001] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-21T17:47:57.898477] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (2.54 seconds). [2025-10-21T17:47:57.906973] [INFO ] [REMOTE ] C: Full fetch complete (77918 records). [2025-10-21T17:47:57.907103] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-21T17:47:58.328569] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-21T17:47:58.328687] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-21T17:47:58.329523] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-21T17:47:58.329566] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-21T17:47:58.330962] [DEBUG] [LOCAL ] C: Trimmed 77918 records to 53741 (keeping 200 days of data) [2025-10-21T17:47:58.557096] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-21T17:47:58.660300] [DEBUG] [LOCAL ] C: Primary data saved (53741 records). [2025-10-21T17:47:58.660626] [INFO ] [MAIN ] C: Full history saved. [2025-10-21T17:47:58.660854] [INFO ] [MAIN ] Update Progress: 381/2366 symbols completed. C took 40.1s. Estimated remaining: 4h 9m 37s. Rate: 8.0 symbols/min [2025-10-21T17:47:58.747216] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-21T17:47:58.857611] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:47:58.883693] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T17:47:58.924060] [DEBUG] [LOCAL ] CAE: Loaded 39223 existing records from primary storage. [2025-10-21T17:47:58.924334] [INFO ] [MAIN ] CAE: Loaded 39223 existing records. [2025-10-21T17:47:59.102038] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:47:59.102261] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-21T17:47:59.102307] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-21T17:47:59.102705] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-21T17:47:59.102762] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-21T17:47:59.361337] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-21T17:47:59.456346] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:47:59.656718] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T17:47:59.658789] [INFO ] [REMOTE ] CABO: Full fetch complete (23157 records). [2025-10-21T17:47:59.658857] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-21T17:48:00.030607] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-21T17:48:00.030768] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-21T17:48:00.031301] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-21T17:48:00.031363] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-21T17:48:00.032034] [DEBUG] [LOCAL ] CABO: Trimmed 23157 records to 16710 (keeping 200 days of data) [2025-10-21T17:48:00.130383] [DEBUG] [LOCAL ] CABO: Primary data saved (16710 records). [2025-10-21T17:48:00.130515] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-21T17:48:00.130592] [INFO ] [MAIN ] Update Progress: 382/2366 symbols completed. CABO took 29.0s. Estimated remaining: 4h 8m 58s. Rate: 8.0 symbols/min [2025-10-21T17:48:00.164899] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-21T17:48:00.299934] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:48:00.300114] [DEBUG] [LOCAL ] CAF: No existing data file found in primary storage. [2025-10-21T17:48:00.300150] [WARN ] [MAIN ] CAF: No existing data found, performing full refresh instead. [2025-10-21T17:48:00.300257] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-21T17:48:00.300297] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-21T17:48:00.300336] [DEBUG] [LOCAL ] CAF: No primary data file found to delete. [2025-10-21T17:48:00.300367] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-21T17:48:00.648928] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:48:00.950997] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-21T17:48:01.192589] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T17:48:01.414769] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T17:48:01.588626] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-21T17:48:01.751053] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-21T17:48:02.551051] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-21T17:48:02.680838] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-21T17:48:03.351027] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-21T17:48:03.956104] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T17:48:04.085913] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T17:48:04.150988] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-21T17:48:04.951037] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-21T17:48:05.554597] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T17:48:05.751029] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-21T17:48:06.545486] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T17:48:06.554704] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-21T17:48:07.351100] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-21T17:48:07.802452] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-21T17:48:07.967792] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-21T17:48:08.043218] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-21T17:48:08.151046] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-21T17:48:08.951040] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-21T17:48:09.750991] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-21T17:48:09.799901] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-21T17:48:09.880317] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T17:48:10.551021] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-21T17:48:11.281782] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T17:48:11.350990] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-21T17:48:12.151045] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-21T17:48:12.951060] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-21T17:48:12.995902] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T17:48:13.751035] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-21T17:48:13.892369] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T17:48:14.070412] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-21T17:48:14.073336] [INFO ] [REMOTE ] CACI: Full fetch complete (38287 records). [2025-10-21T17:48:14.073427] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-21T17:48:14.450379] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-21T17:48:14.450459] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-21T17:48:14.451009] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-21T17:48:14.451071] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-21T17:48:14.451865] [DEBUG] [LOCAL ] CACI: Trimmed 38287 records to 22510 (keeping 200 days of data) [2025-10-21T17:48:14.551683] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-21T17:48:14.587666] [DEBUG] [LOCAL ] CACI: Primary data saved (22510 records). [2025-10-21T17:48:14.587787] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-21T17:48:14.587868] [INFO ] [MAIN ] Update Progress: 383/2366 symbols completed. CACI took 27.5s. Estimated remaining: 4h 9m 26s. Rate: 8.0 symbols/min [2025-10-21T17:48:14.760279] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:48:14.815777] [DEBUG] [LOCAL ] CAG: Loaded 53665 existing records from primary storage. [2025-10-21T17:48:14.816089] [INFO ] [MAIN ] CAG: Loaded 53665 existing records. [2025-10-21T17:48:14.994872] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:48:14.995173] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-21T17:48:14.995234] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-21T17:48:14.996078] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-21T17:48:14.996138] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-21T17:48:15.359781] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:48:15.360133] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-21T17:48:15.447102] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T17:48:16.151115] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-21T17:48:16.431702] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T17:48:16.951048] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-21T17:48:17.402863] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T17:48:17.461447] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-21T17:48:17.511247] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (6.96 seconds). [2025-10-21T17:48:17.751037] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-21T17:48:18.551072] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-21T17:48:18.655452] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T17:48:19.137477] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-21T17:48:19.351069] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-21T17:48:20.151049] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-21T17:48:20.435281] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-10-21T17:48:20.905124] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T17:48:20.950988] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-21T17:48:21.750984] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-21T17:48:22.028450] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T17:48:22.447582] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T17:48:22.551043] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-21T17:48:23.351036] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-21T17:48:23.621670] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T17:48:23.774312] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-21T17:48:23.879578] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-21T17:48:24.151102] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-21T17:48:24.951032] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-21T17:48:25.751000] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-21T17:48:25.995461] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T17:48:26.003746] [INFO ] [REMOTE ] CADE: Full fetch complete (70705 records). [2025-10-21T17:48:26.003882] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-21T17:48:26.287272] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-21T17:48:26.395173] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-21T17:48:26.395259] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-21T17:48:26.396264] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-21T17:48:26.396893] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-21T17:48:26.398485] [DEBUG] [LOCAL ] CADE: Trimmed 70705 records to 49677 (keeping 200 days of data) [2025-10-21T17:48:26.576294] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-21T17:48:26.713719] [DEBUG] [LOCAL ] CADE: Primary data saved (49677 records). [2025-10-21T17:48:26.713951] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-21T17:48:26.714086] [INFO ] [MAIN ] Update Progress: 384/2366 symbols completed. CADE took 31.9s. Estimated remaining: 4h 9m 42s. Rate: 7.9 symbols/min [2025-10-21T17:48:26.905342] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:48:26.963704] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-21T17:48:26.992523] [DEBUG] [LOCAL ] CAH: Loaded 51463 existing records from primary storage. [2025-10-21T17:48:26.992898] [INFO ] [MAIN ] CAH: Loaded 51463 existing records. [2025-10-21T17:48:27.110188] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-21T17:48:27.197101] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:48:27.197319] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-21T17:48:27.197367] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-21T17:48:27.197986] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-21T17:48:27.198046] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-21T17:48:27.352393] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-21T17:48:27.550595] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:48:28.151040] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-21T17:48:28.951052] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-21T17:48:29.410618] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-21T17:48:29.515753] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-21T17:48:29.751060] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-21T17:48:29.869460] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T17:48:29.875799] [INFO ] [REMOTE ] CAE: Full fetch complete (56225 records). [2025-10-21T17:48:29.875926] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-21T17:48:29.876528] [FATAL] [VALIDATOR ] CAE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:48:29.876615] [FATAL] [MAIN ] CAE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:48:29.876693] [WARN ] [MAIN ] CAE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:48:29.876769] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-21T17:48:29.876866] [DEBUG] [LOCAL ] CAE: No primary data file found to delete. [2025-10-21T17:48:29.876939] [INFO ] [LOCAL ] CAE: Starting deletion of derivative data. [2025-10-21T17:48:29.877118] [DEBUG] [LOCAL ] CAE: Deleted derivative data file. [2025-10-21T17:48:29.877208] [INFO ] [MAIN ] Update Progress: 385/2366 symbols completed. CAE took 31.2s. Estimated remaining: 4h 9m 12s. Rate: 7.9 symbols/min [2025-10-21T17:48:30.075166] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:48:30.116807] [DEBUG] [LOCAL ] CAL: Loaded 42891 existing records from primary storage. [2025-10-21T17:48:30.117126] [INFO ] [MAIN ] CAL: Loaded 42891 existing records. [2025-10-21T17:48:30.303124] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:48:30.303332] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-21T17:48:30.303379] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-21T17:48:30.304148] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-21T17:48:30.304205] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-21T17:48:30.556196] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-21T17:48:30.653701] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:48:31.270844] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T17:48:31.272083] [INFO ] [REMOTE ] CAF: Full fetch complete (5525 records). [2025-10-21T17:48:31.272150] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-21T17:48:31.355579] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-21T17:48:31.656822] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-21T17:48:31.656930] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-21T17:48:31.657136] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-21T17:48:31.657261] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-21T17:48:31.657918] [DEBUG] [LOCAL ] CAF: Trimmed 5525 records to 3490 (keeping 200 days of data) [2025-10-21T17:48:31.694380] [DEBUG] [LOCAL ] CAF: Primary data saved (3490 records). [2025-10-21T17:48:31.705787] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-21T17:48:31.706035] [INFO ] [MAIN ] Update Progress: 386/2366 symbols completed. CAF took 31.6s. Estimated remaining: 4h 8m 35s. Rate: 8.0 symbols/min [2025-10-21T17:48:31.719910] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-21T17:48:31.897738] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:48:31.932022] [DEBUG] [LOCAL ] CALX: Loaded 37496 existing records from primary storage. [2025-10-21T17:48:31.932329] [INFO ] [MAIN ] CALX: Loaded 37496 existing records. [2025-10-21T17:48:32.114046] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:48:32.114258] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-21T17:48:32.114306] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-21T17:48:32.114979] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-21T17:48:32.115041] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-21T17:48:32.158040] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-21T17:48:32.517555] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:48:32.951039] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-21T17:48:33.028542] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T17:48:33.751058] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-21T17:48:33.907501] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T17:48:34.551081] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-21T17:48:34.589126] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T17:48:35.161776] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T17:48:35.351022] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-21T17:48:36.151039] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-21T17:48:36.276388] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T17:48:36.835023] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T17:48:36.951036] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-21T17:48:37.120484] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T17:48:37.751038] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-21T17:48:38.350088] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T17:48:38.551072] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-21T17:48:39.351033] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-21T17:48:39.698864] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-21T17:48:40.151043] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-21T17:48:40.450770] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-21T17:48:40.939230] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T17:48:40.950968] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-21T17:48:41.667054] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T17:48:41.750988] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-21T17:48:42.362857] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T17:48:42.551025] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-21T17:48:42.803099] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-21T17:48:43.351037] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-21T17:48:44.080941] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T17:48:44.151046] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-21T17:48:44.880966] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-21T17:48:44.951007] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-21T17:48:45.750999] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-21T17:48:46.111956] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-21T17:48:46.551038] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-21T17:48:46.624374] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T17:48:47.257280] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T17:48:47.351034] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-21T17:48:48.039031] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T17:48:48.151006] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-21T17:48:48.686109] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T17:48:48.951073] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-21T17:48:49.751087] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-21T17:48:49.983492] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-21T17:48:50.480302] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T17:48:50.550986] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-21T17:48:50.871537] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-21T17:48:51.351099] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-21T17:48:52.091249] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T17:48:52.150997] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-21T17:48:52.951046] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-21T17:48:53.118592] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-21T17:48:53.222894] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-21T17:48:53.231797] [INFO ] [REMOTE ] CAG: Full fetch complete (77826 records). [2025-10-21T17:48:53.231954] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-21T17:48:53.626093] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-21T17:48:53.626181] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-21T17:48:53.627061] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-21T17:48:53.627126] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-21T17:48:53.628615] [DEBUG] [LOCAL ] CAG: Trimmed 77826 records to 53666 (keeping 200 days of data) [2025-10-21T17:48:53.754760] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-21T17:48:53.962337] [DEBUG] [LOCAL ] CAG: Primary data saved (53666 records). [2025-10-21T17:48:53.962473] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-21T17:48:53.962959] [INFO ] [MAIN ] Update Progress: 387/2366 symbols completed. CAG took 39.4s. Estimated remaining: 4h 9m 43s. Rate: 7.9 symbols/min [2025-10-21T17:48:54.139630] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:48:54.168368] [DEBUG] [LOCAL ] CANG: Loaded 27136 existing records from primary storage. [2025-10-21T17:48:54.168677] [INFO ] [MAIN ] CANG: Loaded 27136 existing records. [2025-10-21T17:48:54.358588] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:48:54.377328] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-21T17:48:54.377559] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-21T17:48:54.378954] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T17:48:54.386071] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-21T17:48:54.386569] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-21T17:48:54.563384] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-21T17:48:54.744739] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:48:55.351056] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-21T17:48:55.386985] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T17:48:56.021764] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-21T17:48:56.029386] [INFO ] [REMOTE ] CALX: Full fetch complete (54069 records). [2025-10-21T17:48:56.029531] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-21T17:48:56.156157] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-21T17:48:56.428860] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-21T17:48:56.428961] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-21T17:48:56.429578] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-21T17:48:56.429615] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-21T17:48:56.430616] [DEBUG] [LOCAL ] CALX: Trimmed 54069 records to 37319 (keeping 200 days of data) [2025-10-21T17:48:56.636447] [DEBUG] [LOCAL ] CALX: Primary data saved (37319 records). [2025-10-21T17:48:56.636567] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-21T17:48:56.636660] [INFO ] [MAIN ] Update Progress: 388/2366 symbols completed. CALX took 24.9s. Estimated remaining: 4h 9m 10s. Rate: 7.9 symbols/min [2025-10-21T17:48:56.804727] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:48:56.804850] [DEBUG] [LOCAL ] CAPL: No existing data file found in primary storage. [2025-10-21T17:48:56.804886] [WARN ] [MAIN ] CAPL: No existing data found, performing full refresh instead. [2025-10-21T17:48:56.804988] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-21T17:48:56.805029] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-21T17:48:56.805068] [DEBUG] [LOCAL ] CAPL: No primary data file found to delete. [2025-10-21T17:48:56.805098] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-21T17:48:56.953119] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-21T17:48:57.170037] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:48:57.203191] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T17:48:57.750999] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-21T17:48:57.917609] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-21T17:48:57.924323] [INFO ] [REMOTE ] CAL: Full fetch complete (61826 records). [2025-10-21T17:48:57.924432] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-21T17:48:58.333112] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-21T17:48:58.333240] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-21T17:48:58.334140] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-21T17:48:58.334224] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-21T17:48:58.335566] [DEBUG] [LOCAL ] CAL: Trimmed 61826 records to 42780 (keeping 200 days of data) [2025-10-21T17:48:58.551543] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-21T17:48:58.568607] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T17:48:58.589594] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-21T17:48:58.631165] [DEBUG] [LOCAL ] CAL: Primary data saved (42780 records). [2025-10-21T17:48:58.631289] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-21T17:48:58.631375] [INFO ] [MAIN ] Update Progress: 389/2366 symbols completed. CAL took 28.8s. Estimated remaining: 4h 8m 34s. Rate: 8.0 symbols/min [2025-10-21T17:48:58.798358] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:48:58.846741] [DEBUG] [LOCAL ] CARR: Loaded 53603 existing records from primary storage. [2025-10-21T17:48:58.847028] [INFO ] [MAIN ] CARR: Loaded 53603 existing records. [2025-10-21T17:48:59.023894] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:48:59.024100] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-21T17:48:59.024146] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-21T17:48:59.024993] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-21T17:48:59.025060] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-21T17:48:59.352828] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-21T17:48:59.381390] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:49:00.038994] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T17:49:00.151012] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-21T17:49:00.304830] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T17:49:00.951032] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-21T17:49:01.440389] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T17:49:01.751037] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-21T17:49:02.505077] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-21T17:49:02.551077] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-21T17:49:03.173088] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-21T17:49:03.181010] [INFO ] [REMOTE ] CAH: Full fetch complete (74840 records). [2025-10-21T17:49:03.181120] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-21T17:49:03.355686] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-21T17:49:03.573482] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-21T17:49:03.573554] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-21T17:49:03.574367] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-21T17:49:03.574429] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-21T17:49:03.575765] [DEBUG] [LOCAL ] CAH: Trimmed 74840 records to 51443 (keeping 200 days of data) [2025-10-21T17:49:03.887141] [DEBUG] [LOCAL ] CAH: Primary data saved (51443 records). [2025-10-21T17:49:03.887298] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-21T17:49:03.888222] [INFO ] [MAIN ] Update Progress: 390/2366 symbols completed. CAH took 37.2s. Estimated remaining: 4h 8m 15s. Rate: 8.0 symbols/min [2025-10-21T17:49:04.067830] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:49:04.112177] [DEBUG] [LOCAL ] CARS: Loaded 39802 existing records from primary storage. [2025-10-21T17:49:04.112491] [INFO ] [MAIN ] CARS: Loaded 39802 existing records. [2025-10-21T17:49:04.156745] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-21T17:49:04.288060] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-21T17:49:04.309299] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:49:04.312105] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-21T17:49:04.312208] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-21T17:49:04.313081] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-21T17:49:04.313141] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-21T17:49:04.674915] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:49:04.702406] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-21T17:49:04.951057] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-21T17:49:05.166369] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-21T17:49:05.349454] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-21T17:49:05.751047] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-21T17:49:06.551049] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-21T17:49:06.890341] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T17:49:07.351062] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-21T17:49:08.151029] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-21T17:49:08.237601] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T17:49:08.843572] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T17:49:08.871259] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T17:49:08.951004] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-21T17:49:09.623178] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-21T17:49:09.751031] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-21T17:49:10.551038] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-21T17:49:11.029914] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-21T17:49:11.351014] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-21T17:49:11.582625] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T17:49:11.861134] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-21T17:49:12.151004] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-21T17:49:12.951081] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-21T17:49:13.751074] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-21T17:49:14.334119] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-21T17:49:14.448739] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-21T17:49:14.551002] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-21T17:49:14.740606] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T17:49:14.742051] [INFO ] [REMOTE ] CAPL: Full fetch complete (8709 records). [2025-10-21T17:49:14.742124] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-21T17:49:15.115180] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-21T17:49:15.115257] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-21T17:49:15.115467] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-21T17:49:15.115525] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-21T17:49:15.115983] [DEBUG] [LOCAL ] CAPL: Trimmed 8709 records to 5485 (keeping 200 days of data) [2025-10-21T17:49:15.147887] [DEBUG] [LOCAL ] CAPL: Primary data saved (5485 records). [2025-10-21T17:49:15.148001] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-21T17:49:15.148067] [INFO ] [MAIN ] Update Progress: 391/2366 symbols completed. CAPL took 18.5s. Estimated remaining: 4h 8m 26s. Rate: 7.9 symbols/min [2025-10-21T17:49:15.316196] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:49:15.364692] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-21T17:49:15.367594] [DEBUG] [LOCAL ] CAT: Loaded 52966 existing records from primary storage. [2025-10-21T17:49:15.368006] [INFO ] [MAIN ] CAT: Loaded 52966 existing records. [2025-10-21T17:49:15.563940] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:49:15.564120] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-21T17:49:15.564168] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-21T17:49:15.564828] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-21T17:49:15.564885] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-21T17:49:15.957303] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:49:16.151065] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-21T17:49:16.410229] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T17:49:16.951045] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-21T17:49:17.327834] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-21T17:49:17.512319] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-21T17:49:17.751095] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-21T17:49:18.551084] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-21T17:49:19.200403] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-21T17:49:19.351038] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-21T17:49:19.612259] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T17:49:19.716115] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T17:49:20.151049] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-21T17:49:20.951061] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-21T17:49:21.165160] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T17:49:21.751019] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-21T17:49:22.085537] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-21T17:49:22.113155] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-21T17:49:22.551033] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-21T17:49:22.886531] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T17:49:23.351006] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-21T17:49:23.708511] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-21T17:49:24.151018] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-21T17:49:24.800861] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T17:49:24.951029] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-21T17:49:25.751113] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-21T17:49:25.906880] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T17:49:26.524694] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T17:49:26.551009] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-21T17:49:27.351014] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-21T17:49:27.594702] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-21T17:49:28.068401] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T17:49:28.151036] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-21T17:49:28.750367] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T17:49:28.951045] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-21T17:49:29.566589] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T17:49:29.751050] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-21T17:49:30.257402] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T17:49:30.262095] [INFO ] [REMOTE ] CANG: Full fetch complete (39685 records). [2025-10-21T17:49:30.262169] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-21T17:49:30.557390] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-21T17:49:30.656062] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-21T17:49:30.656130] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-21T17:49:30.656691] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-21T17:49:30.656751] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-21T17:49:30.657676] [DEBUG] [LOCAL ] CANG: Trimmed 39685 records to 27080 (keeping 200 days of data) [2025-10-21T17:49:30.801753] [DEBUG] [LOCAL ] CANG: Primary data saved (27080 records). [2025-10-21T17:49:30.801924] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-21T17:49:30.802008] [INFO ] [MAIN ] Update Progress: 392/2366 symbols completed. CANG took 36.8s. Estimated remaining: 4h 8m 60s. Rate: 7.9 symbols/min [2025-10-21T17:49:30.944434] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T17:49:30.999192] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:49:31.006163] [DEBUG] [LOCAL ] CATO: Loaded 6648 existing records from primary storage. [2025-10-21T17:49:31.006303] [INFO ] [MAIN ] CATO: Loaded 6648 existing records. [2025-10-21T17:49:31.179224] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:49:31.179422] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-21T17:49:31.179467] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-21T17:49:31.179606] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-21T17:49:31.179676] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-21T17:49:31.357122] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-21T17:49:31.556137] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:49:32.151018] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-21T17:49:32.932304] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-21T17:49:32.956593] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-21T17:49:32.960149] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T17:49:32.966749] [INFO ] [REMOTE ] CARS: Full fetch complete (56100 records). [2025-10-21T17:49:32.966848] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-21T17:49:32.967478] [FATAL] [VALIDATOR ] CARS: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:49:32.967562] [FATAL] [MAIN ] CARS: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:49:32.967603] [WARN ] [MAIN ] CARS: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:49:32.967693] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-21T17:49:32.967760] [DEBUG] [LOCAL ] CARS: No primary data file found to delete. [2025-10-21T17:49:32.967794] [INFO ] [LOCAL ] CARS: Starting deletion of derivative data. [2025-10-21T17:49:32.967942] [DEBUG] [LOCAL ] CARS: Deleted derivative data file. [2025-10-21T17:49:32.968097] [INFO ] [MAIN ] Update Progress: 393/2366 symbols completed. CARS took 29.1s. Estimated remaining: 4h 8m 25s. Rate: 7.9 symbols/min [2025-10-21T17:49:33.135280] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:49:33.186456] [DEBUG] [LOCAL ] CAVA: Loaded 53552 existing records from primary storage. [2025-10-21T17:49:33.186767] [INFO ] [MAIN ] CAVA: Loaded 53552 existing records. [2025-10-21T17:49:33.387221] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:49:33.387390] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-21T17:49:33.387435] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-21T17:49:33.387604] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-21T17:49:33.387670] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-21T17:49:33.744602] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:49:33.750977] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-21T17:49:33.933938] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T17:49:34.551013] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-21T17:49:35.351002] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-21T17:49:35.458862] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-21T17:49:35.923588] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-21T17:49:36.151006] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-21T17:49:36.170878] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-21T17:49:36.377592] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T17:49:36.386808] [INFO ] [REMOTE ] CARR: Full fetch complete (77772 records). [2025-10-21T17:49:36.387018] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-21T17:49:36.791809] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-21T17:49:36.791888] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-21T17:49:36.792751] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-21T17:49:36.792848] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-21T17:49:36.794261] [DEBUG] [LOCAL ] CARR: Trimmed 77772 records to 53603 (keeping 200 days of data) [2025-10-21T17:49:36.966499] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-21T17:49:37.114918] [DEBUG] [LOCAL ] CARR: Primary data saved (53603 records). [2025-10-21T17:49:37.115056] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-21T17:49:37.115133] [INFO ] [MAIN ] Update Progress: 394/2366 symbols completed. CARR took 38.5s. Estimated remaining: 4h 8m 0s. Rate: 8.0 symbols/min [2025-10-21T17:49:37.286918] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:49:37.332843] [DEBUG] [LOCAL ] CB: Loaded 49967 existing records from primary storage. [2025-10-21T17:49:37.333172] [INFO ] [MAIN ] CB: Loaded 49967 existing records. [2025-10-21T17:49:37.511938] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:49:37.512175] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-21T17:49:37.512223] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-21T17:49:37.512406] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-21T17:49:37.512444] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-21T17:49:37.755393] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-21T17:49:37.866541] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-21T17:49:37.909302] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:49:38.180845] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T17:49:38.551018] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-21T17:49:39.351042] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-21T17:49:39.487854] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T17:49:40.151061] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-21T17:49:40.705482] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-21T17:49:40.951046] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-21T17:49:41.016702] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T17:49:41.591316] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T17:49:41.750992] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-21T17:49:41.910327] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T17:49:42.551025] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-21T17:49:43.361335] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-21T17:49:43.366683] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T17:49:44.151053] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-21T17:49:44.548266] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-21T17:49:44.658226] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-21T17:49:44.951052] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-21T17:49:45.570464] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-21T17:49:45.751045] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-21T17:49:46.551030] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-21T17:49:47.134694] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-21T17:49:47.150768] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-21T17:49:47.351027] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-21T17:49:47.781360] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-21T17:49:48.151045] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-21T17:49:48.951001] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-21T17:49:49.474979] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-21T17:49:49.751085] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-21T17:49:49.919359] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-21T17:49:49.927804] [INFO ] [REMOTE ] CAT: Full fetch complete (76886 records). [2025-10-21T17:49:49.927936] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-21T17:49:50.319757] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-21T17:49:50.319841] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-21T17:49:50.320688] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-21T17:49:50.320909] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-21T17:49:50.322420] [DEBUG] [LOCAL ] CAT: Trimmed 76886 records to 52953 (keeping 200 days of data) [2025-10-21T17:49:50.555707] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-21T17:49:50.652238] [DEBUG] [LOCAL ] CAT: Primary data saved (52953 records). [2025-10-21T17:49:50.652534] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-21T17:49:50.653207] [INFO ] [MAIN ] Update Progress: 395/2366 symbols completed. CAT took 35.5s. Estimated remaining: 4h 8m 23s. Rate: 7.9 symbols/min [2025-10-21T17:49:50.825556] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:49:50.860824] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T17:49:50.881661] [DEBUG] [LOCAL ] CBAN: Loaded 10299 existing records from primary storage. [2025-10-21T17:49:50.881911] [INFO ] [MAIN ] CBAN: Loaded 10299 existing records. [2025-10-21T17:49:51.058380] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:49:51.058725] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-21T17:49:51.058782] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-21T17:49:51.058937] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-21T17:49:51.058976] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-21T17:49:51.280210] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T17:49:51.354399] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-21T17:49:51.437894] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:49:51.889347] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-21T17:49:52.047142] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-21T17:49:52.151024] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-21T17:49:52.911851] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T17:49:52.951043] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-21T17:49:53.751044] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-21T17:49:54.517333] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-21T17:49:54.551016] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-21T17:49:54.876739] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T17:49:55.056067] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-21T17:49:55.057513] [INFO ] [REMOTE ] CATO: Full fetch complete (10694 records). [2025-10-21T17:49:55.057579] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-21T17:49:55.356186] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-21T17:49:55.413939] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-21T17:49:55.414016] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-21T17:49:55.414273] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-21T17:49:55.414311] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-21T17:49:55.414765] [DEBUG] [LOCAL ] CATO: Trimmed 10694 records to 6616 (keeping 200 days of data) [2025-10-21T17:49:55.450253] [DEBUG] [LOCAL ] CATO: Primary data saved (6616 records). [2025-10-21T17:49:55.450347] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-21T17:49:55.450416] [INFO ] [MAIN ] Update Progress: 396/2366 symbols completed. CATO took 24.6s. Estimated remaining: 4h 8m 1s. Rate: 7.9 symbols/min [2025-10-21T17:49:55.614932] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:49:55.630039] [DEBUG] [LOCAL ] CBL: Loaded 16230 existing records from primary storage. [2025-10-21T17:49:55.630251] [INFO ] [MAIN ] CBL: Loaded 16230 existing records. [2025-10-21T17:49:55.802046] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:49:55.802277] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-21T17:49:55.802322] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-21T17:49:55.802531] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-21T17:49:55.802568] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-21T17:49:56.149432] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:49:56.150978] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-21T17:49:56.951010] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-21T17:49:57.195888] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-21T17:49:57.271288] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-21T17:49:57.751045] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-21T17:49:58.551069] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-21T17:49:58.724231] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T17:49:59.241489] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-21T17:49:59.351010] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-21T17:50:00.151019] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-21T17:50:00.190243] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-21T17:50:00.951034] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-21T17:50:01.186900] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-21T17:50:01.613607] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-21T17:50:01.751017] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-21T17:50:01.904746] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T17:50:02.551108] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-21T17:50:02.810339] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T17:50:03.346870] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-21T17:50:03.350974] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-21T17:50:04.151021] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-21T17:50:04.284170] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-21T17:50:04.951033] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-21T17:50:05.751038] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-21T17:50:06.447780] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-21T17:50:06.457003] [INFO ] [REMOTE ] CAVA: Full fetch complete (77452 records). [2025-10-21T17:50:06.457215] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-21T17:50:06.560087] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-21T17:50:06.883284] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-21T17:50:06.945198] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-21T17:50:06.945411] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-21T17:50:06.946583] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-21T17:50:06.946712] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-21T17:50:06.948726] [DEBUG] [LOCAL ] CAVA: Trimmed 77452 records to 53551 (keeping 200 days of data) [2025-10-21T17:50:07.125838] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-21T17:50:07.346441] [DEBUG] [LOCAL ] CAVA: Primary data saved (53551 records). [2025-10-21T17:50:07.346599] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-21T17:50:07.347593] [INFO ] [MAIN ] Update Progress: 397/2366 symbols completed. CAVA took 34.4s. Estimated remaining: 4h 8m 15s. Rate: 7.9 symbols/min [2025-10-21T17:50:07.350999] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-21T17:50:07.482696] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T17:50:08.151053] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-21T17:50:08.951022] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-21T17:50:09.294176] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-21T17:50:09.315032] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-21T17:50:09.751032] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-21T17:50:09.860147] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-21T17:50:10.551108] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-21T17:50:11.351018] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-21T17:50:11.464320] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-21T17:50:11.715401] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T17:50:12.151088] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-21T17:50:12.164045] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-21T17:50:12.951002] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-21T17:50:13.322461] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-21T17:50:13.751078] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-21T17:50:14.550997] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-21T17:50:14.766916] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-21T17:50:14.995755] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-21T17:50:15.006717] [INFO ] [REMOTE ] CB: Full fetch complete (72856 records). [2025-10-21T17:50:15.006887] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-21T17:50:15.293138] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-21T17:50:15.356122] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-21T17:50:15.437516] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-21T17:50:15.437808] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-21T17:50:15.438788] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-21T17:50:15.438854] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-21T17:50:15.440332] [DEBUG] [LOCAL ] CB: Trimmed 72856 records to 49973 (keeping 200 days of data) [2025-10-21T17:50:15.749739] [DEBUG] [LOCAL ] CB: Primary data saved (49973 records). [2025-10-21T17:50:15.749875] [INFO ] [MAIN ] CB: Full history saved. [2025-10-21T17:50:15.749953] [INFO ] [MAIN ] Update Progress: 398/2366 symbols completed. CB took 38.6s. Estimated remaining: 4h 8m 12s. Rate: 7.9 symbols/min [2025-10-21T17:50:16.024625] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-21T17:50:16.151027] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-21T17:50:16.950991] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-21T17:50:17.261541] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T17:50:17.751008] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-21T17:50:19.708718] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (2.76 seconds). [2025-10-21T17:50:19.711116] [INFO ] [REMOTE ] CBAN: Full fetch complete (16155 records). [2025-10-21T17:50:19.711199] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-21T17:50:19.711605] [FATAL] [VALIDATOR ] CBAN: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:50:19.711709] [FATAL] [MAIN ] CBAN: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:50:19.711775] [WARN ] [MAIN ] CBAN: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:50:19.712060] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-21T17:50:19.712120] [DEBUG] [LOCAL ] CBAN: No primary data file found to delete. [2025-10-21T17:50:19.712155] [INFO ] [LOCAL ] CBAN: Starting deletion of derivative data. [2025-10-21T17:50:19.712451] [DEBUG] [LOCAL ] CBAN: Deleted derivative data file. [2025-10-21T17:50:19.712541] [INFO ] [MAIN ] Update Progress: 399/2366 symbols completed. CBAN took 29.1s. Estimated remaining: 4h 7m 47s. Rate: 7.9 symbols/min [2025-10-21T17:50:20.473779] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (2.72 seconds). [2025-10-21T17:50:20.476367] [INFO ] [REMOTE ] CBL: Full fetch complete (24733 records). [2025-10-21T17:50:20.476440] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-21T17:50:20.476890] [FATAL] [VALIDATOR ] CBL: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:50:20.476971] [FATAL] [MAIN ] CBL: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:50:20.477012] [WARN ] [MAIN ] CBL: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:50:20.477074] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-21T17:50:20.477134] [DEBUG] [LOCAL ] CBL: No primary data file found to delete. [2025-10-21T17:50:20.477168] [INFO ] [LOCAL ] CBL: Starting deletion of derivative data. [2025-10-21T17:50:20.477283] [DEBUG] [LOCAL ] CBL: Deleted derivative data file. [2025-10-21T17:50:20.477453] [INFO ] [MAIN ] Update Progress: 400/2366 symbols completed. CBL took 25.0s. Estimated remaining: 4h 7m 6s. Rate: 8.0 symbols/min [2025-10-21T17:50:21.099854] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:50:21.108994] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:50:21.197224] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:50:21.225668] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:50:21.226580] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-21T17:50:21.229078] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-21T17:50:21.230350] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-21T17:50:21.229953] [DEBUG] [LOCAL ] CBNA: Loaded 2900 existing records from primary storage. [2025-10-21T17:50:21.230435] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-21T17:50:21.230784] [INFO ] [MAIN ] CBNA: Loaded 2900 existing records. [2025-10-21T17:50:21.230587] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-21T17:50:21.251067] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-21T17:50:21.519063] [DEBUG] [LOCAL ] CBT: Loaded 31150 existing records from primary storage. [2025-10-21T17:50:21.549444] [INFO ] [MAIN ] CBT: Loaded 31150 existing records. [2025-10-21T17:50:21.622133] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:50:21.670857] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-21T17:50:21.693198] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-21T17:50:21.759924] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-21T17:50:21.787324] [DEBUG] [LOCAL ] CBRE: Loaded 50305 existing records from primary storage. [2025-10-21T17:50:21.780628] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-21T17:50:21.877591] [INFO ] [MAIN ] CBRE: Loaded 50305 existing records. [2025-10-21T17:50:22.136745] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:50:22.267100] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-21T17:50:22.267218] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-21T17:50:22.266931] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:50:22.283302] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-10-21T17:50:22.288482] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-21T17:50:22.334952] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-21T17:50:22.430612] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:50:22.508054] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-21T17:50:22.522932] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-21T17:50:22.566504] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-21T17:50:22.566578] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-21T17:50:22.675472] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:50:22.746208] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-10-21T17:50:22.821702] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:50:22.913509] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:50:22.918963] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-21T17:50:22.887776] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-21T17:50:22.972180] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:50:22.993356] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-21T17:50:23.006675] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-21T17:50:23.009759] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-21T17:50:23.033152] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-21T17:50:23.039567] [INFO ] [MAIN ] Update Progress: 401/2366 symbols completed. CBO took 2.6s. Estimated remaining: 4h 6m 34s. Rate: 8.0 symbols/min [2025-10-21T17:50:23.330349] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:50:23.358220] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-21T17:50:23.479511] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:50:23.499335] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:50:23.496966] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-21T17:50:23.522526] [DEBUG] [LOCAL ] CBU: Loaded 22862 existing records from primary storage. [2025-10-21T17:50:23.522815] [INFO ] [MAIN ] CBU: Loaded 22862 existing records. [2025-10-21T17:50:23.619011] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-21T17:50:23.631423] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-21T17:50:23.709174] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:50:23.709356] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-21T17:50:23.709404] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-21T17:50:23.709625] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-21T17:50:23.709700] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-21T17:50:24.054104] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:50:24.054435] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-21T17:50:24.201444] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T17:50:24.203376] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-21T17:50:24.643792] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-21T17:50:24.644984] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-21T17:50:24.994812] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T17:50:25.001542] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-21T17:50:25.044905] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T17:50:25.104142] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-21T17:50:25.273525] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T17:50:25.751065] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-21T17:50:26.029207] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T17:50:26.441805] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T17:50:26.551057] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-21T17:50:27.351032] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-21T17:50:28.148465] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T17:50:28.158076] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-21T17:50:28.254711] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-21T17:50:28.951078] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-21T17:50:29.554337] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T17:50:29.750993] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-21T17:50:29.933684] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T17:50:30.323941] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-21T17:50:30.551043] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-21T17:50:31.351072] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-21T17:50:31.577853] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T17:50:32.151058] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-21T17:50:32.458468] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-21T17:50:32.951018] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-21T17:50:33.758104] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-21T17:50:33.781100] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T17:50:34.040053] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T17:50:34.551027] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-21T17:50:35.280385] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T17:50:35.296041] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T17:50:35.350995] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-21T17:50:35.992529] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-21T17:50:36.151009] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-21T17:50:36.951031] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-21T17:50:37.483283] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T17:50:37.751017] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-21T17:50:38.551000] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-21T17:50:38.671173] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T17:50:38.994263] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T17:50:39.109260] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T17:50:39.351030] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-21T17:50:40.151065] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-21T17:50:40.670071] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T17:50:40.951020] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-21T17:50:41.222017] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T17:50:41.307539] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-21T17:50:41.751048] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-21T17:50:42.551045] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-21T17:50:42.629928] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-21T17:50:43.351037] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-21T17:50:44.151036] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-21T17:50:44.450092] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-21T17:50:44.481179] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T17:50:44.951033] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-21T17:50:45.051849] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T17:50:45.055984] [INFO ] [REMOTE ] CBU: Full fetch complete (32714 records). [2025-10-21T17:50:45.056065] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-21T17:50:45.426430] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-21T17:50:45.426507] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-21T17:50:45.427015] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-21T17:50:45.427076] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-21T17:50:45.427834] [DEBUG] [LOCAL ] CBU: Trimmed 32714 records to 22773 (keeping 200 days of data) [2025-10-21T17:50:45.561855] [DEBUG] [LOCAL ] CBU: Primary data saved (22773 records). [2025-10-21T17:50:45.562005] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-21T17:50:45.562098] [INFO ] [MAIN ] Update Progress: 402/2366 symbols completed. CBU took 22.5s. Estimated remaining: 4h 7m 40s. Rate: 7.9 symbols/min [2025-10-21T17:50:45.748829] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:50:45.749009] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-21T17:50:45.749058] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-21T17:50:45.749168] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-21T17:50:45.749210] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-21T17:50:45.749251] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-21T17:50:45.749283] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-21T17:50:45.760638] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-21T17:50:45.788836] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-21T17:50:45.814929] [INFO ] [REMOTE ] CBNA: Full fetch complete (4328 records). [2025-10-21T17:50:45.830731] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-21T17:50:46.472661] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:50:46.540058] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-21T17:50:46.540138] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-21T17:50:46.540278] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-21T17:50:46.540316] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-21T17:50:46.540683] [DEBUG] [LOCAL ] CBNA: Trimmed 4328 records to 2888 (keeping 200 days of data) [2025-10-21T17:50:46.557375] [DEBUG] [LOCAL ] CBNA: Primary data saved (2888 records). [2025-10-21T17:50:46.553021] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-10-21T17:50:46.557469] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-21T17:50:46.557727] [INFO ] [MAIN ] Update Progress: 403/2366 symbols completed. CBNA took 26.1s. Estimated remaining: 4h 6m 60s. Rate: 7.9 symbols/min [2025-10-21T17:50:46.736571] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:50:46.773299] [DEBUG] [LOCAL ] CBZ: Loaded 34284 existing records from primary storage. [2025-10-21T17:50:46.773592] [INFO ] [MAIN ] CBZ: Loaded 34284 existing records. [2025-10-21T17:50:46.872853] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:50:46.875611] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-10-21T17:50:46.886177] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:50:46.914425] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-21T17:50:46.919759] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:50:46.927855] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-21T17:50:46.934876] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-21T17:50:46.935676] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-21T17:50:46.956001] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:50:46.956186] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-21T17:50:46.956420] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-21T17:50:46.956611] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-21T17:50:46.956761] [INFO ] [MAIN ] Update Progress: 404/2366 symbols completed. CBX took 1.4s. Estimated remaining: 4h 6m 18s. Rate: 8.0 symbols/min [2025-10-21T17:50:46.970875] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-21T17:50:46.991544] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-21T17:50:47.275299] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:50:47.358072] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-21T17:50:47.550257] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:50:47.598923] [DEBUG] [LOCAL ] CC: Loaded 53030 existing records from primary storage. [2025-10-21T17:50:47.601008] [INFO ] [MAIN ] CC: Loaded 53030 existing records. [2025-10-21T17:50:47.600858] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-21T17:50:47.794312] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:50:47.794622] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-21T17:50:47.794707] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-21T17:50:47.794905] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-21T17:50:47.794943] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-21T17:50:48.151687] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-21T17:50:48.153772] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:50:48.762243] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T17:50:48.951096] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-21T17:50:49.751092] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-21T17:50:49.989515] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T17:50:50.039394] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-21T17:50:50.551023] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-21T17:50:51.211942] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-21T17:50:51.351047] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-21T17:50:51.684263] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T17:50:52.151092] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-21T17:50:52.943295] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T17:50:52.952438] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-21T17:50:53.509279] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-21T17:50:53.514337] [INFO ] [REMOTE ] CBT: Full fetch complete (45793 records). [2025-10-21T17:50:53.514416] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-21T17:50:53.762200] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-21T17:50:53.899269] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-21T17:50:53.899362] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-21T17:50:53.900010] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-21T17:50:53.900114] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-21T17:50:53.901207] [DEBUG] [LOCAL ] CBT: Trimmed 45793 records to 31053 (keeping 200 days of data) [2025-10-21T17:50:54.093416] [DEBUG] [LOCAL ] CBT: Primary data saved (31053 records). [2025-10-21T17:50:54.093556] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-21T17:50:54.094135] [INFO ] [MAIN ] Update Progress: 405/2366 symbols completed. CBT took 33.6s. Estimated remaining: 4h 6m 8s. Rate: 8.0 symbols/min [2025-10-21T17:50:54.266542] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:50:54.319111] [DEBUG] [LOCAL ] CCI: Loaded 53116 existing records from primary storage. [2025-10-21T17:50:54.319438] [INFO ] [MAIN ] CCI: Loaded 53116 existing records. [2025-10-21T17:50:54.498349] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:50:54.498632] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-21T17:50:54.498730] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-21T17:50:54.499141] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-21T17:50:54.499197] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-21T17:50:54.566707] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-21T17:50:54.865477] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:50:54.898415] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-21T17:50:55.255889] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T17:50:55.351045] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-21T17:50:56.151026] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-21T17:50:56.414366] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T17:50:56.826963] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-21T17:50:56.951058] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-21T17:50:57.591367] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T17:50:57.751035] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-21T17:50:58.243973] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T17:50:58.551013] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-21T17:50:59.350998] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-21T17:50:59.448464] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T17:51:00.150995] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-21T17:51:00.511323] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-21T17:51:00.796954] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T17:51:00.951011] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-21T17:51:01.750992] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-21T17:51:02.245622] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-21T17:51:02.377306] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T17:51:02.551264] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-21T17:51:03.147055] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T17:51:03.351122] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-21T17:51:04.151028] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-21T17:51:04.388892] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-21T17:51:04.950983] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-21T17:51:05.193010] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T17:51:05.751064] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-21T17:51:05.801189] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T17:51:06.551096] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-21T17:51:07.060495] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-21T17:51:07.351017] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-21T17:51:07.857415] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-21T17:51:07.865795] [INFO ] [REMOTE ] CBRE: Full fetch complete (73767 records). [2025-10-21T17:51:07.865951] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-21T17:51:08.161405] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-21T17:51:08.290040] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-21T17:51:08.290192] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-21T17:51:08.291137] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-21T17:51:08.291242] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-21T17:51:08.292566] [DEBUG] [LOCAL ] CBRE: Trimmed 73767 records to 50283 (keeping 200 days of data) [2025-10-21T17:51:08.548467] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-21T17:51:08.636943] [DEBUG] [LOCAL ] CBRE: Primary data saved (50283 records). [2025-10-21T17:51:08.637068] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-21T17:51:08.637144] [INFO ] [MAIN ] Update Progress: 406/2366 symbols completed. CBRE took 48.2s. Estimated remaining: 4h 6m 35s. Rate: 7.9 symbols/min [2025-10-21T17:51:08.819340] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:51:08.819515] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-21T17:51:08.819556] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-21T17:51:08.819688] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-21T17:51:08.819741] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-21T17:51:08.819783] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-21T17:51:08.819816] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-21T17:51:08.960416] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-21T17:51:09.181394] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:51:09.211582] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T17:51:09.718802] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T17:51:09.751039] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-21T17:51:10.551032] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-21T17:51:11.134453] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-21T17:51:11.137141] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-21T17:51:11.351019] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-21T17:51:11.409758] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-21T17:51:11.415407] [INFO ] [REMOTE ] CBZ: Full fetch complete (46282 records). [2025-10-21T17:51:11.415496] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-21T17:51:11.795963] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-21T17:51:11.798813] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-21T17:51:11.798936] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-21T17:51:11.800935] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-21T17:51:11.801000] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-21T17:51:11.801942] [DEBUG] [LOCAL ] CBZ: Trimmed 46282 records to 34322 (keeping 200 days of data) [2025-10-21T17:51:11.997004] [DEBUG] [LOCAL ] CBZ: Primary data saved (34322 records). [2025-10-21T17:51:11.997125] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-21T17:51:11.997212] [INFO ] [MAIN ] Update Progress: 407/2366 symbols completed. CBZ took 25.4s. Estimated remaining: 4h 6m 7s. Rate: 8.0 symbols/min [2025-10-21T17:51:12.155563] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-21T17:51:12.164703] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:51:12.179514] [DEBUG] [LOCAL ] CCIF: Loaded 15294 existing records from primary storage. [2025-10-21T17:51:12.179763] [INFO ] [MAIN ] CCIF: Loaded 15294 existing records. [2025-10-21T17:51:12.351480] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:51:12.351725] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-21T17:51:12.351798] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-21T17:51:12.352032] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-21T17:51:12.352078] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-21T17:51:12.699754] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:51:12.951010] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-21T17:51:13.751051] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-21T17:51:13.998587] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T17:51:14.182954] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T17:51:14.551052] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-21T17:51:15.351029] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-21T17:51:15.970958] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-21T17:51:16.002152] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-21T17:51:16.151010] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-21T17:51:16.458768] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-21T17:51:16.578840] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-21T17:51:16.951042] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-21T17:51:17.751036] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-21T17:51:18.527603] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T17:51:18.536241] [INFO ] [REMOTE ] CC: Full fetch complete (76191 records). [2025-10-21T17:51:18.536390] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-21T17:51:18.558148] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-21T17:51:18.931559] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-21T17:51:18.931663] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-21T17:51:18.932503] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-21T17:51:18.932546] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-21T17:51:18.933976] [DEBUG] [LOCAL ] CC: Trimmed 76191 records to 53021 (keeping 200 days of data) [2025-10-21T17:51:19.252581] [DEBUG] [LOCAL ] CC: Primary data saved (53021 records). [2025-10-21T17:51:19.252740] [INFO ] [MAIN ] CC: Full history saved. [2025-10-21T17:51:19.252846] [INFO ] [MAIN ] Update Progress: 408/2366 symbols completed. CC took 32.3s. Estimated remaining: 4h 5m 58s. Rate: 8.0 symbols/min [2025-10-21T17:51:19.354534] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-21T17:51:19.439497] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:51:19.475778] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T17:51:19.500074] [DEBUG] [LOCAL ] CCJ: Loaded 53690 existing records from primary storage. [2025-10-21T17:51:19.500421] [INFO ] [MAIN ] CCJ: Loaded 53690 existing records. [2025-10-21T17:51:19.704543] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:51:19.704909] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-21T17:51:19.726331] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-21T17:51:19.739308] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-21T17:51:19.740740] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-21T17:51:19.740882] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-21T17:51:19.966844] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-21T17:51:20.156515] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-21T17:51:20.190774] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:51:20.951018] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-21T17:51:21.050297] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-21T17:51:21.751047] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-21T17:51:22.551061] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-21T17:51:22.932219] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T17:51:23.154567] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-21T17:51:23.351097] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-21T17:51:23.968676] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-21T17:51:24.079849] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T17:51:24.151063] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-21T17:51:24.951038] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-21T17:51:25.751061] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-21T17:51:25.979336] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T17:51:26.064774] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T17:51:26.551047] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-21T17:51:27.351035] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-21T17:51:27.830097] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-21T17:51:27.859165] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-21T17:51:27.867535] [INFO ] [REMOTE ] CCI: Full fetch complete (77095 records). [2025-10-21T17:51:27.867703] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-21T17:51:28.153029] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-21T17:51:28.289342] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-21T17:51:28.289492] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-21T17:51:28.290439] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-21T17:51:28.290523] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-21T17:51:28.292106] [DEBUG] [LOCAL ] CCI: Trimmed 77095 records to 53111 (keeping 200 days of data) [2025-10-21T17:51:28.640837] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-21T17:51:28.667855] [DEBUG] [LOCAL ] CCI: Primary data saved (53111 records). [2025-10-21T17:51:28.668010] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-21T17:51:28.668378] [INFO ] [MAIN ] Update Progress: 409/2366 symbols completed. CCI took 34.6s. Estimated remaining: 4h 5m 59s. Rate: 8.0 symbols/min [2025-10-21T17:51:28.842847] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:51:28.884733] [DEBUG] [LOCAL ] CCK: Loaded 46482 existing records from primary storage. [2025-10-21T17:51:28.885036] [INFO ] [MAIN ] CCK: Loaded 46482 existing records. [2025-10-21T17:51:28.958745] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-21T17:51:29.067336] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:51:29.067620] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-21T17:51:29.067710] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-21T17:51:29.068173] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-21T17:51:29.068247] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-21T17:51:29.338060] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T17:51:29.446627] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:51:29.751042] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-21T17:51:30.551044] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-21T17:51:30.846129] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-21T17:51:30.872187] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-21T17:51:31.047174] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-21T17:51:31.351019] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-21T17:51:32.151031] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-21T17:51:32.951006] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-21T17:51:33.122928] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-21T17:51:33.356112] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T17:51:33.751042] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-21T17:51:34.202358] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-21T17:51:34.551003] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-21T17:51:34.700348] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-21T17:51:34.820599] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-21T17:51:35.351013] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-21T17:51:36.151016] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-21T17:51:36.938335] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T17:51:36.939264] [INFO ] [REMOTE ] CCIA: Full fetch complete (2178 records). [2025-10-21T17:51:36.939330] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-21T17:51:36.960721] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-21T17:51:37.124853] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-21T17:51:37.125056] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:51:37.125123] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:51:37.125195] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-21T17:51:37.125270] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-21T17:51:37.125324] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-21T17:51:37.125366] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-21T17:51:37.125425] [INFO ] [MAIN ] Update Progress: 410/2366 symbols completed. CCIA took 28.5s. Estimated remaining: 4h 5m 56s. Rate: 8.0 symbols/min [2025-10-21T17:51:37.291067] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:51:37.341473] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-21T17:51:37.341797] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-10-21T17:51:37.527816] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:51:37.528052] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-21T17:51:37.528137] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-21T17:51:37.529171] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-21T17:51:37.529243] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-21T17:51:37.755895] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-21T17:51:37.848134] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-21T17:51:37.866515] [INFO ] [REMOTE ] CCIF: Full fetch complete (21880 records). [2025-10-21T17:51:37.892988] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-21T17:51:38.059839] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:51:38.068620] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-10-21T17:51:38.355963] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-21T17:51:38.356037] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-21T17:51:38.356352] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-21T17:51:38.356390] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-21T17:51:38.356991] [DEBUG] [LOCAL ] CCIF: Trimmed 21880 records to 15216 (keeping 200 days of data) [2025-10-21T17:51:38.440975] [DEBUG] [LOCAL ] CCIF: Primary data saved (15216 records). [2025-10-21T17:51:38.441094] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-21T17:51:38.441168] [INFO ] [MAIN ] Update Progress: 411/2366 symbols completed. CCIF took 26.4s. Estimated remaining: 4h 5m 19s. Rate: 8.0 symbols/min [2025-10-21T17:51:38.556210] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-21T17:51:38.612236] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:51:38.654762] [DEBUG] [LOCAL ] CCO: Loaded 48483 existing records from primary storage. [2025-10-21T17:51:38.655043] [INFO ] [MAIN ] CCO: Loaded 48483 existing records. [2025-10-21T17:51:38.829960] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:51:38.830180] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-21T17:51:38.830236] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-21T17:51:38.831061] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-21T17:51:38.831121] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-21T17:51:39.192140] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:51:39.351005] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-21T17:51:39.385732] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T17:51:40.151015] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-21T17:51:40.879105] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T17:51:40.950986] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-21T17:51:41.119349] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-21T17:51:41.375314] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-21T17:51:41.751019] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-21T17:51:42.418922] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T17:51:42.550988] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-21T17:51:43.351010] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-21T17:51:44.027977] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T17:51:44.079453] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-21T17:51:44.150982] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-21T17:51:44.951001] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-21T17:51:45.034449] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T17:51:45.751041] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-21T17:51:46.295562] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-21T17:51:46.445381] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-21T17:51:46.551013] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-21T17:51:47.351015] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-21T17:51:47.716047] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-21T17:51:48.162827] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-21T17:51:48.196690] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T17:51:48.951019] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-21T17:51:49.547707] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-21T17:51:49.751012] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-21T17:51:50.543490] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T17:51:50.552849] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-21T17:51:50.648932] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-21T17:51:51.351017] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-21T17:51:52.150991] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-21T17:51:52.179181] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-21T17:51:52.188540] [INFO ] [REMOTE ] CCJ: Full fetch complete (77840 records). [2025-10-21T17:51:52.188725] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-21T17:51:52.565948] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-21T17:51:52.679938] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-21T17:51:52.680035] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-21T17:51:52.681177] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-21T17:51:52.681246] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-21T17:51:52.683041] [DEBUG] [LOCAL ] CCJ: Trimmed 77840 records to 53690 (keeping 200 days of data) [2025-10-21T17:51:52.956693] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-21T17:51:52.998920] [DEBUG] [LOCAL ] CCJ: Primary data saved (53690 records). [2025-10-21T17:51:52.999071] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-21T17:51:52.999154] [INFO ] [MAIN ] Update Progress: 412/2366 symbols completed. CCJ took 33.7s. Estimated remaining: 4h 5m 45s. Rate: 8.0 symbols/min [2025-10-21T17:51:53.163442] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:51:53.174282] [DEBUG] [LOCAL ] CCRD: Loaded 9603 existing records from primary storage. [2025-10-21T17:51:53.174476] [INFO ] [MAIN ] CCRD: Loaded 9603 existing records. [2025-10-21T17:51:53.348281] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:51:53.348596] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-21T17:51:53.348685] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-21T17:51:53.348868] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-21T17:51:53.348929] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-21T17:51:53.707015] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:51:53.732458] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T17:51:53.750987] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-21T17:51:54.039738] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-21T17:51:54.551087] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-21T17:51:54.592285] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T17:51:55.190027] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T17:51:55.351017] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-21T17:51:55.939905] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-21T17:51:56.150997] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-21T17:51:56.684948] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-21T17:51:56.951075] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-21T17:51:57.759210] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-21T17:51:57.779038] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T17:51:58.551050] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-21T17:51:58.939773] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-21T17:51:59.141807] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-21T17:51:59.351002] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-21T17:51:59.422299] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T17:52:00.151026] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-21T17:52:00.951024] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-21T17:52:01.751020] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-21T17:52:01.845580] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-21T17:52:01.897896] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T17:52:02.327818] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-21T17:52:02.551008] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-21T17:52:02.629060] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T17:52:03.351017] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-21T17:52:04.151029] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-21T17:52:04.897947] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-21T17:52:04.929952] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-21T17:52:04.950971] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-21T17:52:05.103201] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T17:52:05.110922] [INFO ] [REMOTE ] CCO: Full fetch complete (67273 records). [2025-10-21T17:52:05.111042] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-21T17:52:05.504258] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-21T17:52:05.504333] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-21T17:52:05.505100] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-21T17:52:05.505162] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-21T17:52:05.506386] [DEBUG] [LOCAL ] CCO: Trimmed 67273 records to 48523 (keeping 200 days of data) [2025-10-21T17:52:05.760534] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-21T17:52:05.769151] [DEBUG] [LOCAL ] CCO: Primary data saved (48523 records). [2025-10-21T17:52:05.769225] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-21T17:52:05.769974] [INFO ] [MAIN ] Update Progress: 413/2366 symbols completed. CCO took 27.3s. Estimated remaining: 4h 6m 2s. Rate: 7.9 symbols/min [2025-10-21T17:52:05.936286] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:52:05.968456] [DEBUG] [LOCAL ] CCS: Loaded 30084 existing records from primary storage. [2025-10-21T17:52:05.968739] [INFO ] [MAIN ] CCS: Loaded 30084 existing records. [2025-10-21T17:52:06.146846] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:52:06.147078] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-21T17:52:06.147130] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-21T17:52:06.147327] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-21T17:52:06.147383] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-21T17:52:06.507739] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:52:06.550982] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-21T17:52:07.324734] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-21T17:52:07.350986] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-21T17:52:07.897965] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-21T17:52:07.905417] [INFO ] [REMOTE ] CCK: Full fetch complete (68086 records). [2025-10-21T17:52:07.905535] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-21T17:52:08.102750] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-21T17:52:08.162996] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-21T17:52:08.331102] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-21T17:52:08.331183] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-21T17:52:08.332030] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-21T17:52:08.332094] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-21T17:52:08.333487] [DEBUG] [LOCAL ] CCK: Trimmed 68086 records to 46497 (keeping 200 days of data) [2025-10-21T17:52:08.610176] [DEBUG] [LOCAL ] CCK: Primary data saved (46497 records). [2025-10-21T17:52:08.610304] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-21T17:52:08.610867] [INFO ] [MAIN ] Update Progress: 414/2366 symbols completed. CCK took 39.9s. Estimated remaining: 4h 5m 32s. Rate: 7.9 symbols/min [2025-10-21T17:52:08.780938] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:52:08.804555] [DEBUG] [LOCAL ] CCU: Loaded 21982 existing records from primary storage. [2025-10-21T17:52:08.804818] [INFO ] [MAIN ] CCU: Loaded 21982 existing records. [2025-10-21T17:52:08.959085] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-21T17:52:08.990460] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:52:08.991302] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-21T17:52:08.991355] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-21T17:52:08.991502] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-21T17:52:08.991540] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-21T17:52:09.079587] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T17:52:09.366663] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:52:09.751050] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-21T17:52:09.800797] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-21T17:52:09.810431] [INFO ] [REMOTE ] CCL: Full fetch complete (77590 records). [2025-10-21T17:52:09.810617] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-21T17:52:09.811542] [FATAL] [VALIDATOR ] CCL: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:52:09.811637] [FATAL] [MAIN ] CCL: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:52:09.811719] [WARN ] [MAIN ] CCL: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:52:09.811764] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-21T17:52:09.811824] [DEBUG] [LOCAL ] CCL: No primary data file found to delete. [2025-10-21T17:52:09.811861] [INFO ] [LOCAL ] CCL: Starting deletion of derivative data. [2025-10-21T17:52:09.812018] [DEBUG] [LOCAL ] CCL: Deleted derivative data file. [2025-10-21T17:52:09.812901] [INFO ] [MAIN ] Update Progress: 415/2366 symbols completed. CCL took 32.7s. Estimated remaining: 4h 4m 55s. Rate: 8.0 symbols/min [2025-10-21T17:52:09.990420] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:52:09.990615] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-21T17:52:09.990693] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-21T17:52:09.990811] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-21T17:52:09.990854] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-21T17:52:09.990894] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-21T17:52:09.990925] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-21T17:52:10.374325] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:52:10.395928] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T17:52:10.550996] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-21T17:52:10.918220] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T17:52:10.932096] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-21T17:52:11.351071] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-21T17:52:12.151106] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-21T17:52:12.650518] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T17:52:12.951126] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-21T17:52:13.111519] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-21T17:52:13.751054] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-21T17:52:14.298144] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-21T17:52:14.551003] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-21T17:52:14.611625] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-21T17:52:14.818073] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-21T17:52:15.351050] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-21T17:52:16.151121] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-21T17:52:16.172474] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-21T17:52:16.387191] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-21T17:52:16.951029] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-21T17:52:17.265713] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-21T17:52:17.751045] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-21T17:52:18.551100] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-21T17:52:18.747984] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-21T17:52:19.351002] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-21T17:52:19.579529] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-21T17:52:19.649390] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T17:52:20.151039] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-21T17:52:20.951031] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-21T17:52:21.485014] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T17:52:21.751014] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-21T17:52:21.872326] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T17:52:22.115588] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:52:22.115907] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-21T17:52:22.115996] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:52:22.116070] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-21T17:52:22.116131] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:52:22.116203] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-21T17:52:22.116264] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-21T17:52:22.116299] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-21T17:52:22.116339] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-21T17:52:22.116385] [INFO ] [MAIN ] Update Progress: 416/2366 symbols completed. CCZ took 12.3s. Estimated remaining: 4h 5m 10s. Rate: 8.0 symbols/min [2025-10-21T17:52:22.286099] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:52:22.340283] [DEBUG] [LOCAL ] CDE: Loaded 53643 existing records from primary storage. [2025-10-21T17:52:22.340574] [INFO ] [MAIN ] CDE: Loaded 53643 existing records. [2025-10-21T17:52:22.523209] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:52:22.523410] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-21T17:52:22.523457] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-21T17:52:22.523822] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-21T17:52:22.523880] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-21T17:52:22.556129] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-21T17:52:22.894062] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:52:23.162153] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-21T17:52:23.163998] [INFO ] [REMOTE ] CCRD: Full fetch complete (11799 records). [2025-10-21T17:52:23.164066] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-21T17:52:23.356173] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-21T17:52:23.525120] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-21T17:52:23.525204] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-21T17:52:23.525466] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-21T17:52:23.525549] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-21T17:52:23.526104] [DEBUG] [LOCAL ] CCRD: Trimmed 11799 records to 9582 (keeping 200 days of data) [2025-10-21T17:52:23.580820] [DEBUG] [LOCAL ] CCRD: Primary data saved (9582 records). [2025-10-21T17:52:23.580956] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-21T17:52:23.581035] [INFO ] [MAIN ] Update Progress: 417/2366 symbols completed. CCRD took 30.6s. Estimated remaining: 4h 4m 34s. Rate: 8.0 symbols/min [2025-10-21T17:52:23.747082] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:52:23.758274] [DEBUG] [LOCAL ] CDLR: Loaded 10221 existing records from primary storage. [2025-10-21T17:52:23.758464] [INFO ] [MAIN ] CDLR: Loaded 10221 existing records. [2025-10-21T17:52:23.930285] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:52:23.930493] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-21T17:52:23.930540] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-21T17:52:23.930702] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-21T17:52:23.930758] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-21T17:52:24.156166] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-21T17:52:24.291765] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:52:24.840011] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T17:52:24.951018] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-21T17:52:25.330514] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-21T17:52:25.751024] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-21T17:52:26.237537] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T17:52:26.551057] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-21T17:52:27.233484] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T17:52:27.258506] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-21T17:52:27.351045] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-21T17:52:28.151067] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-21T17:52:28.951058] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-21T17:52:29.283404] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-21T17:52:29.497102] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T17:52:29.751052] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-21T17:52:30.024319] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-21T17:52:30.293739] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-21T17:52:30.551054] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-21T17:52:31.351035] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-21T17:52:31.794981] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T17:52:32.151116] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-21T17:52:32.602729] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T17:52:32.951062] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-21T17:52:33.144058] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-21T17:52:33.526620] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T17:52:33.751060] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-21T17:52:34.551004] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-21T17:52:35.351062] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-21T17:52:35.588247] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T17:52:36.034119] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T17:52:36.049630] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-21T17:52:36.151010] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-21T17:52:36.951020] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-21T17:52:37.487631] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T17:52:37.492249] [INFO ] [REMOTE ] CCS: Full fetch complete (44757 records). [2025-10-21T17:52:37.492353] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-21T17:52:37.611293] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-21T17:52:37.756203] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-21T17:52:37.900248] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-21T17:52:37.900333] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-21T17:52:37.900971] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-21T17:52:37.901057] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-21T17:52:37.902120] [DEBUG] [LOCAL ] CCS: Trimmed 44757 records to 30011 (keeping 200 days of data) [2025-10-21T17:52:38.081712] [DEBUG] [LOCAL ] CCS: Primary data saved (30011 records). [2025-10-21T17:52:38.081840] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-21T17:52:38.081915] [INFO ] [MAIN ] Update Progress: 418/2366 symbols completed. CCS took 32.3s. Estimated remaining: 4h 4m 59s. Rate: 8.0 symbols/min [2025-10-21T17:52:38.248660] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:52:38.248841] [DEBUG] [LOCAL ] CDP: No existing data file found in primary storage. [2025-10-21T17:52:38.248886] [WARN ] [MAIN ] CDP: No existing data found, performing full refresh instead. [2025-10-21T17:52:38.249049] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-21T17:52:38.249091] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-21T17:52:38.249130] [DEBUG] [LOCAL ] CDP: No primary data file found to delete. [2025-10-21T17:52:38.249159] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-21T17:52:38.565014] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-21T17:52:38.606140] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:52:38.818956] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-21T17:52:38.822341] [INFO ] [REMOTE ] CCU: Full fetch complete (32490 records). [2025-10-21T17:52:38.822474] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-21T17:52:39.194231] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-21T17:52:39.194313] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-21T17:52:39.194867] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-21T17:52:39.194929] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-21T17:52:39.195725] [DEBUG] [LOCAL ] CCU: Trimmed 32490 records to 21804 (keeping 200 days of data) [2025-10-21T17:52:39.321425] [DEBUG] [LOCAL ] CCU: Primary data saved (21804 records). [2025-10-21T17:52:39.321555] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-21T17:52:39.321631] [INFO ] [MAIN ] Update Progress: 419/2366 symbols completed. CCU took 30.7s. Estimated remaining: 4h 4m 22s. Rate: 8.0 symbols/min [2025-10-21T17:52:39.352869] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-21T17:52:39.432556] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-21T17:52:39.519061] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:52:39.544748] [DEBUG] [LOCAL ] CDRE: Loaded 24879 existing records from primary storage. [2025-10-21T17:52:39.545020] [INFO ] [MAIN ] CDRE: Loaded 24879 existing records. [2025-10-21T17:52:39.735217] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:52:39.735509] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-21T17:52:39.735566] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-21T17:52:39.736342] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-21T17:52:39.736401] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-21T17:52:40.091077] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:52:40.151063] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-21T17:52:40.933718] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T17:52:40.950973] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-21T17:52:41.751060] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-21T17:52:42.128116] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T17:52:42.348298] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T17:52:42.551051] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-21T17:52:42.960007] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-21T17:52:43.351068] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-21T17:52:44.151001] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-21T17:52:44.307971] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-21T17:52:44.490750] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T17:52:44.951030] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-21T17:52:45.690485] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T17:52:45.751014] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-21T17:52:45.874861] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-21T17:52:46.551006] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-21T17:52:47.351010] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-21T17:52:47.482400] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T17:52:47.772707] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T17:52:48.151071] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-21T17:52:48.189550] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T17:52:48.951031] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-21T17:52:49.398890] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T17:52:49.751039] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-21T17:52:50.551016] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-21T17:52:50.624093] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-21T17:52:50.849153] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T17:52:51.351051] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-21T17:52:52.116370] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T17:52:52.151022] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-21T17:52:52.199970] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T17:52:52.951002] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-21T17:52:53.000026] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-21T17:52:53.751028] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-21T17:52:54.551011] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-21T17:52:54.904039] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-21T17:52:55.046409] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-21T17:52:55.350990] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-21T17:52:55.568792] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T17:52:55.571586] [INFO ] [REMOTE ] CDLR: Full fetch complete (14179 records). [2025-10-21T17:52:55.571722] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-21T17:52:55.940936] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-21T17:52:55.941010] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-21T17:52:55.941304] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-21T17:52:55.941340] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-21T17:52:55.941841] [DEBUG] [LOCAL ] CDLR: Trimmed 14179 records to 10233 (keeping 200 days of data) [2025-10-21T17:52:56.000046] [DEBUG] [LOCAL ] CDLR: Primary data saved (10233 records). [2025-10-21T17:52:56.000181] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-21T17:52:56.000255] [INFO ] [MAIN ] Update Progress: 420/2366 symbols completed. CDLR took 32.4s. Estimated remaining: 4h 4m 57s. Rate: 7.9 symbols/min [2025-10-21T17:52:56.151913] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-21T17:52:56.170611] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:52:56.216448] [DEBUG] [LOCAL ] CE: Loaded 51312 existing records from primary storage. [2025-10-21T17:52:56.216778] [INFO ] [MAIN ] CE: Loaded 51312 existing records. [2025-10-21T17:52:56.397092] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:52:56.397342] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-21T17:52:56.397431] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-21T17:52:56.398059] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-21T17:52:56.398144] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-21T17:52:56.660218] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T17:52:56.775418] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:52:56.951015] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-21T17:52:57.760316] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-21T17:52:57.765332] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T17:52:58.551047] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-21T17:52:58.766632] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T17:52:58.987227] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T17:52:59.351090] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-21T17:53:00.151012] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-21T17:53:00.529783] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T17:53:00.774121] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:53:00.951028] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-21T17:53:01.757995] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-21T17:53:01.775921] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-21T17:53:02.550992] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-21T17:53:02.824735] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T17:53:02.945235] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T17:53:03.351034] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-21T17:53:04.151077] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-21T17:53:04.951104] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-21T17:53:04.999292] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-21T17:53:05.009129] [INFO ] [REMOTE ] CDE: Full fetch complete (77788 records). [2025-10-21T17:53:05.009337] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-21T17:53:05.655966] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T17:53:05.665235] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-21T17:53:05.701490] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-21T17:53:05.707728] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-21T17:53:05.707942] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-21T17:53:05.712292] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-21T17:53:05.727013] [DEBUG] [LOCAL ] CDE: Trimmed 77788 records to 53644 (keeping 200 days of data) [2025-10-21T17:53:05.787688] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-21T17:53:06.161978] [DEBUG] [LOCAL ] CDE: Primary data saved (53644 records). [2025-10-21T17:53:06.162144] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-21T17:53:06.162977] [INFO ] [MAIN ] Update Progress: 421/2366 symbols completed. CDE took 44.0s. Estimated remaining: 4h 5m 1s. Rate: 7.9 symbols/min [2025-10-21T17:53:06.368458] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:53:06.406710] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T17:53:06.419923] [DEBUG] [LOCAL ] CEE: Loaded 5304 existing records from primary storage. [2025-10-21T17:53:06.420573] [INFO ] [MAIN ] CEE: Loaded 5304 existing records. [2025-10-21T17:53:06.556166] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-21T17:53:06.616038] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:53:06.616426] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-21T17:53:06.616477] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-21T17:53:06.616632] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-21T17:53:06.616713] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-21T17:53:06.944958] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T17:53:07.014802] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:53:07.351021] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-21T17:53:07.948958] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T17:53:07.956386] [INFO ] [REMOTE ] CDP: Full fetch complete (62036 records). [2025-10-21T17:53:07.956614] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-21T17:53:08.158347] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-21T17:53:08.370345] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-21T17:53:08.370468] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-21T17:53:08.371298] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-21T17:53:08.371363] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-21T17:53:08.372703] [DEBUG] [LOCAL ] CDP: Trimmed 62036 records to 42295 (keeping 200 days of data) [2025-10-21T17:53:08.634066] [DEBUG] [LOCAL ] CDP: Primary data saved (42295 records). [2025-10-21T17:53:08.634193] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-21T17:53:08.634260] [INFO ] [MAIN ] Update Progress: 422/2366 symbols completed. CDP took 30.6s. Estimated remaining: 4h 4m 30s. Rate: 8.0 symbols/min [2025-10-21T17:53:08.823349] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:53:08.830908] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-21T17:53:08.846471] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-21T17:53:08.851951] [INFO ] [REMOTE ] CDRE: Full fetch complete (35010 records). [2025-10-21T17:53:08.852185] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-21T17:53:08.951414] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-21T17:53:08.983349] [DEBUG] [LOCAL ] CEPU: Loaded 26925 existing records from primary storage. [2025-10-21T17:53:09.010183] [INFO ] [MAIN ] CEPU: Loaded 26925 existing records. [2025-10-21T17:53:09.393521] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:53:09.418673] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-21T17:53:09.428927] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-21T17:53:09.439342] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-21T17:53:09.456521] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-21T17:53:09.504040] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-21T17:53:09.516544] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-21T17:53:09.530309] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-21T17:53:09.530396] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-21T17:53:09.581709] [DEBUG] [LOCAL ] CDRE: Trimmed 35010 records to 24817 (keeping 200 days of data) [2025-10-21T17:53:09.755068] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-21T17:53:09.943538] [DEBUG] [LOCAL ] CDRE: Primary data saved (24817 records). [2025-10-21T17:53:09.972099] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-21T17:53:10.011721] [INFO ] [MAIN ] Update Progress: 423/2366 symbols completed. CDRE took 30.7s. Estimated remaining: 4h 3m 54s. Rate: 8.0 symbols/min [2025-10-21T17:53:10.015616] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-21T17:53:10.018761] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:53:10.205163] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:53:10.262244] [DEBUG] [LOCAL ] CF: Loaded 52126 existing records from primary storage. [2025-10-21T17:53:10.262798] [INFO ] [MAIN ] CF: Loaded 52126 existing records. [2025-10-21T17:53:10.453018] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:53:10.453318] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-21T17:53:10.453433] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-21T17:53:10.454115] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-21T17:53:10.454175] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-21T17:53:10.560958] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-21T17:53:10.833938] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:53:11.350985] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-21T17:53:11.716044] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-21T17:53:11.891995] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-21T17:53:12.151030] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-21T17:53:12.721094] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T17:53:12.888706] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-21T17:53:12.951129] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-21T17:53:13.344594] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-21T17:53:13.750995] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-21T17:53:14.551028] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-21T17:53:15.351016] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-21T17:53:15.692796] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-21T17:53:16.151091] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-21T17:53:16.768715] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-21T17:53:16.956189] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-21T17:53:16.968882] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T17:53:17.751028] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-21T17:53:17.939586] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T17:53:18.380020] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-21T17:53:18.556119] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-21T17:53:18.578076] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T17:53:19.125785] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-21T17:53:19.351039] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-21T17:53:20.151077] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-21T17:53:20.951031] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-21T17:53:21.349112] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T17:53:21.722286] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T17:53:21.751034] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-21T17:53:21.948624] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T17:53:22.551097] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-21T17:53:22.603792] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-21T17:53:23.351079] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-21T17:53:24.151095] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-21T17:53:24.596680] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-21T17:53:24.951066] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-21T17:53:25.106561] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-21T17:53:25.405508] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T17:53:25.751086] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-21T17:53:26.551072] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-21T17:53:26.575186] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-21T17:53:26.583093] [INFO ] [REMOTE ] CE: Full fetch complete (74831 records). [2025-10-21T17:53:26.583218] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-21T17:53:26.972283] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-21T17:53:26.972440] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-21T17:53:26.973315] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-21T17:53:26.973394] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-21T17:53:26.993948] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T17:53:27.001236] [DEBUG] [LOCAL ] CE: Trimmed 74831 records to 51289 (keeping 200 days of data) [2025-10-21T17:53:27.302972] [DEBUG] [LOCAL ] CE: Primary data saved (51289 records). [2025-10-21T17:53:27.303109] [INFO ] [MAIN ] CE: Full history saved. [2025-10-21T17:53:27.303206] [INFO ] [MAIN ] Update Progress: 424/2366 symbols completed. CE took 31.3s. Estimated remaining: 4h 4m 32s. Rate: 7.9 symbols/min [2025-10-21T17:53:27.356772] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-21T17:53:27.414094] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T17:53:27.486265] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:53:27.535769] [DEBUG] [LOCAL ] CFG: Loaded 53623 existing records from primary storage. [2025-10-21T17:53:27.536096] [INFO ] [MAIN ] CFG: Loaded 53623 existing records. [2025-10-21T17:53:27.710798] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:53:27.711007] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-21T17:53:27.711085] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-21T17:53:27.711296] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-21T17:53:27.711334] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-21T17:53:28.064448] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:53:28.151020] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-21T17:53:28.444782] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T17:53:28.951016] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-21T17:53:29.655443] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-21T17:53:29.751008] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-21T17:53:30.077069] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T17:53:30.551031] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-21T17:53:31.197275] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-21T17:53:31.198527] [INFO ] [REMOTE ] CEE: Full fetch complete (10176 records). [2025-10-21T17:53:31.198600] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-21T17:53:31.355932] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-21T17:53:31.583741] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-21T17:53:31.583876] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-21T17:53:31.584202] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-21T17:53:31.584279] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-21T17:53:31.595266] [DEBUG] [LOCAL ] CEE: Trimmed 10176 records to 5247 (keeping 200 days of data) [2025-10-21T17:53:31.614412] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T17:53:31.657664] [DEBUG] [LOCAL ] CEE: Primary data saved (5247 records). [2025-10-21T17:53:31.657855] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-21T17:53:31.657949] [INFO ] [MAIN ] Update Progress: 425/2366 symbols completed. CEE took 25.5s. Estimated remaining: 4h 4m 9s. Rate: 7.9 symbols/min [2025-10-21T17:53:31.836386] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:53:31.836604] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-21T17:53:31.836663] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-21T17:53:31.836787] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-21T17:53:31.836828] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-21T17:53:31.836868] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-21T17:53:31.836899] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-21T17:53:32.156226] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-21T17:53:32.194523] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:53:32.643523] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T17:53:32.951085] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-21T17:53:33.757847] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-10-21T17:53:33.781769] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T17:53:33.998354] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:53:33.998683] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-10-21T17:53:33.998768] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:53:33.998813] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-21T17:53:33.998871] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:53:33.998940] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-21T17:53:33.999001] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-21T17:53:33.999036] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-21T17:53:33.999102] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-21T17:53:33.999170] [INFO ] [MAIN ] Update Progress: 426/2366 symbols completed. CFND took 2.3s. Estimated remaining: 4h 3m 38s. Rate: 8.0 symbols/min [2025-10-21T17:53:34.173356] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-21T17:53:34.190990] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:53:34.234268] [DEBUG] [LOCAL ] CFR: Loaded 32637 existing records from primary storage. [2025-10-21T17:53:34.234552] [INFO ] [MAIN ] CFR: Loaded 32637 existing records. [2025-10-21T17:53:34.418556] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:53:34.418813] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-21T17:53:34.418873] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-21T17:53:34.419427] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-21T17:53:34.419484] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-21T17:53:34.562069] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-21T17:53:34.809538] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:53:35.351055] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-21T17:53:36.151025] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-21T17:53:36.553538] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T17:53:36.612114] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-21T17:53:36.951028] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-21T17:53:37.751068] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-21T17:53:37.913848] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T17:53:38.551081] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-21T17:53:38.926580] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T17:53:39.239324] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T17:53:39.244760] [INFO ] [REMOTE ] CEPU: Full fetch complete (39758 records). [2025-10-21T17:53:39.244864] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-21T17:53:39.356093] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-21T17:53:39.630948] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-21T17:53:39.631025] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-21T17:53:39.631612] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-21T17:53:39.631679] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-21T17:53:39.632576] [DEBUG] [LOCAL ] CEPU: Trimmed 39758 records to 27014 (keeping 200 days of data) [2025-10-21T17:53:39.784982] [DEBUG] [LOCAL ] CEPU: Primary data saved (27014 records). [2025-10-21T17:53:39.785150] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-21T17:53:39.785263] [INFO ] [MAIN ] Update Progress: 427/2366 symbols completed. CEPU took 31.2s. Estimated remaining: 4h 3m 23s. Rate: 8.0 symbols/min [2025-10-21T17:53:39.958471] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:53:39.996864] [DEBUG] [LOCAL ] CGAU: Loaded 43818 existing records from primary storage. [2025-10-21T17:53:39.997151] [INFO ] [MAIN ] CGAU: Loaded 43818 existing records. [2025-10-21T17:53:40.164859] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T17:53:40.164016] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-21T17:53:40.208614] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:53:40.209300] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-21T17:53:40.209354] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-21T17:53:40.209631] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-21T17:53:40.209719] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-21T17:53:40.570358] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:53:40.951017] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-21T17:53:41.198431] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-21T17:53:41.751094] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-21T17:53:42.176276] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T17:53:42.315923] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-21T17:53:42.551086] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-21T17:53:43.139138] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T17:53:43.351093] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-21T17:53:44.151029] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-21T17:53:44.186224] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-21T17:53:44.774032] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:53:44.951058] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-21T17:53:45.417717] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-21T17:53:45.751041] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-21T17:53:46.551077] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-21T17:53:46.652565] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T17:53:47.351017] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-21T17:53:47.687144] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T17:53:48.038182] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T17:53:48.151027] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-21T17:53:48.951052] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-21T17:53:49.009218] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-21T17:53:49.017259] [INFO ] [REMOTE ] CF: Full fetch complete (75580 records). [2025-10-21T17:53:49.017382] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-21T17:53:49.323780] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-21T17:53:49.446815] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-21T17:53:49.446904] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-21T17:53:49.447757] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-21T17:53:49.447821] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-21T17:53:49.449221] [DEBUG] [LOCAL ] CF: Trimmed 75580 records to 52111 (keeping 200 days of data) [2025-10-21T17:53:49.752909] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-21T17:53:49.761264] [DEBUG] [LOCAL ] CF: Primary data saved (52111 records). [2025-10-21T17:53:49.761346] [INFO ] [MAIN ] CF: Full history saved. [2025-10-21T17:53:49.761770] [INFO ] [MAIN ] Update Progress: 428/2366 symbols completed. CF took 39.7s. Estimated remaining: 4h 3m 26s. Rate: 8.0 symbols/min [2025-10-21T17:53:49.934794] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:53:49.938002] [DEBUG] [LOCAL ] CGV: Loaded 1384 existing records from primary storage. [2025-10-21T17:53:49.938178] [INFO ] [MAIN ] CGV: Loaded 1384 existing records. [2025-10-21T17:53:50.119163] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:53:50.119356] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-21T17:53:50.119493] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-21T17:53:50.119743] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-21T17:53:50.119810] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-21T17:53:50.286928] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-21T17:53:50.504558] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:53:50.551006] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-21T17:53:51.075530] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-21T17:53:51.351000] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-21T17:53:51.516343] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-21T17:53:52.151080] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-21T17:53:52.540107] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T17:53:52.951076] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-21T17:53:53.751091] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-21T17:53:54.290054] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-21T17:53:54.298429] [INFO ] [REMOTE ] CFG: Full fetch complete (77763 records). [2025-10-21T17:53:54.298553] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-21T17:53:54.562724] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-21T17:53:54.669722] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T17:53:54.724963] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-21T17:53:54.725043] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-21T17:53:54.725923] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-21T17:53:54.725988] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-21T17:53:54.727365] [DEBUG] [LOCAL ] CFG: Trimmed 77763 records to 53623 (keeping 200 days of data) [2025-10-21T17:53:55.041175] [DEBUG] [LOCAL ] CFG: Primary data saved (53623 records). [2025-10-21T17:53:55.041307] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-21T17:53:55.041382] [INFO ] [MAIN ] Update Progress: 429/2366 symbols completed. CFG took 27.7s. Estimated remaining: 4h 3m 8s. Rate: 8.0 symbols/min [2025-10-21T17:53:55.108528] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-21T17:53:55.216690] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:53:55.239935] [DEBUG] [LOCAL ] CHCT: Loaded 24343 existing records from primary storage. [2025-10-21T17:53:55.240195] [INFO ] [MAIN ] CHCT: Loaded 24343 existing records. [2025-10-21T17:53:55.361859] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-21T17:53:55.418177] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:53:55.418389] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-21T17:53:55.419382] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-21T17:53:55.420097] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-21T17:53:55.420191] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-21T17:53:55.558209] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T17:53:55.818801] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:53:55.821551] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-21T17:53:56.151032] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-21T17:53:56.951038] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-21T17:53:57.392298] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T17:53:57.751036] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-21T17:53:58.179272] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-21T17:53:58.298454] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T17:53:58.551069] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-21T17:53:59.351022] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-21T17:54:00.150995] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-21T17:54:00.212794] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T17:54:00.491507] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-21T17:54:00.553967] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T17:54:00.951048] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-21T17:54:01.751055] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-21T17:54:02.089056] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-21T17:54:02.551100] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-21T17:54:03.118237] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T17:54:03.351027] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-21T17:54:03.903548] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-21T17:54:04.151017] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-21T17:54:04.239807] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T17:54:04.951045] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-21T17:54:05.631062] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T17:54:05.751025] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-21T17:54:06.035896] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T17:54:06.551027] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-21T17:54:07.284406] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-21T17:54:07.351007] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-21T17:54:07.869299] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T17:54:08.151033] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-21T17:54:08.341027] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-21T17:54:08.951033] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-21T17:54:09.751077] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-21T17:54:10.031866] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-21T17:54:10.071906] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-21T17:54:10.079915] [INFO ] [REMOTE ] CGAU: Full fetch complete (62006 records). [2025-10-21T17:54:10.080049] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-21T17:54:10.472446] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-21T17:54:10.472527] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-21T17:54:10.473333] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-21T17:54:10.473396] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-21T17:54:10.474664] [DEBUG] [LOCAL ] CGAU: Trimmed 62006 records to 43896 (keeping 200 days of data) [2025-10-21T17:54:10.556498] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-21T17:54:10.726325] [DEBUG] [LOCAL ] CGAU: Primary data saved (43896 records). [2025-10-21T17:54:10.726451] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-21T17:54:10.726525] [INFO ] [MAIN ] Update Progress: 430/2366 symbols completed. CGAU took 30.9s. Estimated remaining: 4h 3m 38s. Rate: 7.9 symbols/min [2025-10-21T17:54:10.896922] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:54:10.947412] [DEBUG] [LOCAL ] CHD: Loaded 52329 existing records from primary storage. [2025-10-21T17:54:10.947727] [INFO ] [MAIN ] CHD: Loaded 52329 existing records. [2025-10-21T17:54:11.025212] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-21T17:54:11.129679] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:54:11.129900] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-21T17:54:11.129947] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-21T17:54:11.130743] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-21T17:54:11.130799] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-21T17:54:11.359291] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-21T17:54:11.473326] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T17:54:11.509954] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:54:11.510209] [INFO ] [REMOTE ] CFR: Full fetch complete (48548 records). [2025-10-21T17:54:11.510768] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-21T17:54:11.882522] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-21T17:54:11.882601] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-21T17:54:11.883267] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-21T17:54:11.883329] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-21T17:54:11.884277] [DEBUG] [LOCAL ] CFR: Trimmed 48548 records to 32535 (keeping 200 days of data) [2025-10-21T17:54:12.082594] [DEBUG] [LOCAL ] CFR: Primary data saved (32535 records). [2025-10-21T17:54:12.082779] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-21T17:54:12.083689] [INFO ] [MAIN ] Update Progress: 431/2366 symbols completed. CFR took 38.1s. Estimated remaining: 4h 3m 2s. Rate: 8.0 symbols/min [2025-10-21T17:54:12.158779] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-21T17:54:12.257739] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:54:12.278409] [DEBUG] [LOCAL ] CHE: Loaded 15304 existing records from primary storage. [2025-10-21T17:54:12.278712] [INFO ] [MAIN ] CHE: Loaded 15304 existing records. [2025-10-21T17:54:12.473481] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:54:12.473850] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-21T17:54:12.473986] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-21T17:54:12.479463] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-21T17:54:12.487660] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-21T17:54:12.522090] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T17:54:12.875988] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:54:12.951018] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-21T17:54:13.388174] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-21T17:54:13.751003] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-21T17:54:14.079995] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-21T17:54:14.551058] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-21T17:54:14.672880] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-21T17:54:15.020038] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-21T17:54:15.351048] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-21T17:54:16.151009] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-21T17:54:16.208479] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T17:54:16.951023] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-21T17:54:17.636892] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-21T17:54:17.637746] [INFO ] [REMOTE ] CGV: Full fetch complete (2217 records). [2025-10-21T17:54:17.637816] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-21T17:54:17.752935] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-21T17:54:18.052468] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-21T17:54:18.050907] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-21T17:54:18.061637] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-21T17:54:18.062818] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-21T17:54:18.062955] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-21T17:54:18.063602] [DEBUG] [LOCAL ] CGV: Trimmed 2217 records to 1377 (keeping 200 days of data) [2025-10-21T17:54:18.072591] [DEBUG] [LOCAL ] CGV: Primary data saved (1377 records). [2025-10-21T17:54:18.072693] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-21T17:54:18.072784] [INFO ] [MAIN ] Update Progress: 432/2366 symbols completed. CGV took 28.3s. Estimated remaining: 4h 2m 48s. Rate: 8.0 symbols/min [2025-10-21T17:54:18.239585] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:54:18.284391] [DEBUG] [LOCAL ] CHGG: Loaded 47673 existing records from primary storage. [2025-10-21T17:54:18.284700] [INFO ] [MAIN ] CHGG: Loaded 47673 existing records. [2025-10-21T17:54:18.459295] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:54:18.459512] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-21T17:54:18.459558] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-21T17:54:18.460332] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-21T17:54:18.460390] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-21T17:54:18.551682] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-21T17:54:18.822907] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:54:18.963692] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T17:54:19.351086] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-21T17:54:20.150996] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-21T17:54:20.237224] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:54:20.495095] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-21T17:54:20.951084] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-21T17:54:21.751057] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-21T17:54:21.943526] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-21T17:54:22.028359] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T17:54:22.551024] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-21T17:54:23.351004] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-21T17:54:23.548501] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-21T17:54:23.554332] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T17:54:24.151093] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-21T17:54:24.219321] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-21T17:54:24.951044] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-21T17:54:25.172370] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-21T17:54:25.751040] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-21T17:54:26.551032] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-21T17:54:26.860097] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T17:54:27.284925] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-21T17:54:27.350994] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-21T17:54:27.412947] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T17:54:28.150998] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-21T17:54:28.298203] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-21T17:54:28.950998] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-21T17:54:29.198698] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T17:54:29.683711] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-21T17:54:29.750985] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-21T17:54:30.551032] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-21T17:54:30.919499] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T17:54:30.922787] [INFO ] [REMOTE ] CHE: Full fetch complete (20437 records). [2025-10-21T17:54:30.922921] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-21T17:54:31.314403] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-21T17:54:31.314750] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-21T17:54:31.315182] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-21T17:54:31.315223] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-21T17:54:31.315962] [DEBUG] [LOCAL ] CHE: Trimmed 20437 records to 15306 (keeping 200 days of data) [2025-10-21T17:54:31.356884] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-21T17:54:31.414576] [DEBUG] [LOCAL ] CHE: Primary data saved (15306 records). [2025-10-21T17:54:31.414741] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-21T17:54:31.414828] [INFO ] [MAIN ] Update Progress: 433/2366 symbols completed. CHE took 19.3s. Estimated remaining: 4h 3m 6s. Rate: 8.0 symbols/min [2025-10-21T17:54:31.583025] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:54:31.615338] [DEBUG] [LOCAL ] CHH: Loaded 32329 existing records from primary storage. [2025-10-21T17:54:31.615598] [INFO ] [MAIN ] CHH: Loaded 32329 existing records. [2025-10-21T17:54:31.794010] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:54:31.794285] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-21T17:54:31.794331] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-21T17:54:31.795101] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-21T17:54:31.795159] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-21T17:54:32.151571] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-21T17:54:32.155455] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:54:32.388369] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-21T17:54:32.439578] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T17:54:32.444363] [INFO ] [REMOTE ] CHCT: Full fetch complete (34767 records). [2025-10-21T17:54:32.444494] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-21T17:54:32.812508] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-21T17:54:32.812586] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-21T17:54:32.813120] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-21T17:54:32.813180] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-21T17:54:32.813946] [DEBUG] [LOCAL ] CHCT: Trimmed 34767 records to 24339 (keeping 200 days of data) [2025-10-21T17:54:32.952273] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-21T17:54:32.957195] [DEBUG] [LOCAL ] CHCT: Primary data saved (24339 records). [2025-10-21T17:54:32.957319] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-21T17:54:32.957406] [INFO ] [MAIN ] Update Progress: 434/2366 symbols completed. CHCT took 37.9s. Estimated remaining: 4h 2m 32s. Rate: 8.0 symbols/min [2025-10-21T17:54:33.130147] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:54:33.150759] [DEBUG] [LOCAL ] CHMI: Loaded 21466 existing records from primary storage. [2025-10-21T17:54:33.151009] [INFO ] [MAIN ] CHMI: Loaded 21466 existing records. [2025-10-21T17:54:33.334151] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:54:33.334382] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-21T17:54:33.334430] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-21T17:54:33.334798] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-21T17:54:33.334856] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-21T17:54:33.683263] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:54:33.751049] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-21T17:54:34.034865] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T17:54:34.551036] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-21T17:54:34.755179] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T17:54:35.307715] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T17:54:35.350979] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-21T17:54:36.151059] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-21T17:54:36.215674] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T17:54:36.285159] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-21T17:54:36.951133] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-21T17:54:37.605760] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T17:54:37.751023] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-21T17:54:38.182879] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T17:54:38.551042] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-21T17:54:39.351026] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-21T17:54:39.591385] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-21T17:54:39.686535] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T17:54:40.151072] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-21T17:54:40.951075] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-21T17:54:41.139748] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T17:54:41.751008] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-21T17:54:41.896822] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T17:54:41.905772] [INFO ] [REMOTE ] CHD: Full fetch complete (74986 records). [2025-10-21T17:54:41.905962] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-21T17:54:42.098299] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-21T17:54:42.352743] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-21T17:54:42.352826] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-21T17:54:42.353702] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-21T17:54:42.353766] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-21T17:54:42.355156] [DEBUG] [LOCAL ] CHD: Trimmed 74986 records to 52328 (keeping 200 days of data) [2025-10-21T17:54:42.566252] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-21T17:54:42.671187] [DEBUG] [LOCAL ] CHD: Primary data saved (52328 records). [2025-10-21T17:54:42.671325] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-21T17:54:42.672226] [INFO ] [MAIN ] Update Progress: 435/2366 symbols completed. CHD took 31.9s. Estimated remaining: 4h 2m 34s. Rate: 8.0 symbols/min [2025-10-21T17:54:42.847469] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:54:42.855413] [DEBUG] [LOCAL ] CHN: Loaded 5002 existing records from primary storage. [2025-10-21T17:54:42.855668] [INFO ] [MAIN ] CHN: Loaded 5002 existing records. [2025-10-21T17:54:43.042935] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:54:43.043225] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-21T17:54:43.043287] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-21T17:54:43.043458] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-21T17:54:43.043497] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-21T17:54:43.356177] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-21T17:54:43.363775] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T17:54:43.455164] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:54:43.850768] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-21T17:54:44.151088] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-21T17:54:44.951040] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-21T17:54:44.976260] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-21T17:54:45.313442] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-21T17:54:45.751088] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-21T17:54:46.556977] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-21T17:54:46.561556] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T17:54:46.814543] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-21T17:54:46.990377] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-21T17:54:47.351019] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-21T17:54:48.151042] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-21T17:54:48.489022] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T17:54:48.721524] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-21T17:54:48.951081] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-21T17:54:49.751042] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-21T17:54:50.481229] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T17:54:50.551015] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-21T17:54:50.807390] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-21T17:54:51.351037] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-21T17:54:51.918610] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T17:54:52.045108] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-21T17:54:52.151098] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-21T17:54:52.594362] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-21T17:54:52.951056] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-21T17:54:53.751075] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-21T17:54:54.377938] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-21T17:54:54.379103] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T17:54:54.551020] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-21T17:54:55.351042] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-21T17:54:56.151014] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-21T17:54:56.479239] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T17:54:56.559026] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-21T17:54:56.951083] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-21T17:54:57.647046] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T17:54:57.751022] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-21T17:54:58.551012] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-21T17:54:58.670472] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T17:54:58.709044] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-21T17:54:58.712759] [INFO ] [REMOTE ] CHMI: Full fetch complete (31554 records). [2025-10-21T17:54:58.712833] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-21T17:54:59.069565] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-21T17:54:59.069662] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-21T17:54:59.070191] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-21T17:54:59.070233] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-21T17:54:59.070928] [DEBUG] [LOCAL ] CHMI: Trimmed 31554 records to 21355 (keeping 200 days of data) [2025-10-21T17:54:59.190091] [DEBUG] [LOCAL ] CHMI: Primary data saved (21355 records). [2025-10-21T17:54:59.190212] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-21T17:54:59.190285] [INFO ] [MAIN ] Update Progress: 436/2366 symbols completed. CHMI took 26.2s. Estimated remaining: 4h 3m 6s. Rate: 7.9 symbols/min [2025-10-21T17:54:59.356285] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-21T17:54:59.358809] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:54:59.406291] [DEBUG] [LOCAL ] CHPT: Loaded 47293 existing records from primary storage. [2025-10-21T17:54:59.406627] [INFO ] [MAIN ] CHPT: Loaded 47293 existing records. [2025-10-21T17:54:59.637294] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:54:59.637565] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-21T17:54:59.637732] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-21T17:54:59.638624] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-21T17:54:59.638720] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-21T17:54:59.986674] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T17:55:00.050753] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:55:00.151056] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-21T17:55:00.951029] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-21T17:55:01.352178] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-21T17:55:01.516245] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-21T17:55:01.751047] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-21T17:55:02.551036] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-21T17:55:02.986442] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.84 seconds). [2025-10-21T17:55:03.164354] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-21T17:55:03.351015] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-21T17:55:03.797716] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-21T17:55:03.804615] [INFO ] [REMOTE ] CHGG: Full fetch complete (69785 records). [2025-10-21T17:55:03.804753] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-21T17:55:03.805448] [FATAL] [VALIDATOR ] CHGG: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:55:03.805536] [FATAL] [MAIN ] CHGG: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:55:03.805580] [WARN ] [MAIN ] CHGG: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:55:03.805688] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-21T17:55:03.805776] [DEBUG] [LOCAL ] CHGG: No primary data file found to delete. [2025-10-21T17:55:03.805823] [INFO ] [LOCAL ] CHGG: Starting deletion of derivative data. [2025-10-21T17:55:03.806029] [DEBUG] [LOCAL ] CHGG: Deleted derivative data file. [2025-10-21T17:55:03.806482] [INFO ] [MAIN ] Update Progress: 437/2366 symbols completed. CHGG took 45.7s. Estimated remaining: 4h 2m 46s. Rate: 7.9 symbols/min [2025-10-21T17:55:03.876036] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-21T17:55:04.151025] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-21T17:55:04.951020] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-21T17:55:05.708067] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-21T17:55:05.714465] [INFO ] [REMOTE ] CHH: Full fetch complete (47465 records). [2025-10-21T17:55:05.714596] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-21T17:55:05.763389] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-21T17:55:06.141420] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-21T17:55:06.141543] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-21T17:55:06.142318] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-21T17:55:06.142385] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-21T17:55:06.143473] [DEBUG] [LOCAL ] CHH: Trimmed 47465 records to 32272 (keeping 200 days of data) [2025-10-21T17:55:06.362077] [DEBUG] [LOCAL ] CHH: Primary data saved (32272 records). [2025-10-21T17:55:06.362264] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-21T17:55:06.363104] [INFO ] [MAIN ] Update Progress: 438/2366 symbols completed. CHH took 34.9s. Estimated remaining: 4h 2m 16s. Rate: 8.0 symbols/min [2025-10-21T17:55:06.538280] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-21T17:55:06.550976] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-21T17:55:07.250059] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-21T17:55:07.268888] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-21T17:55:07.270407] [INFO ] [REMOTE ] CHN: Full fetch complete (7535 records). [2025-10-21T17:55:07.270480] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-21T17:55:07.356298] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-21T17:55:07.651837] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-21T17:55:07.651920] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-21T17:55:07.652124] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-21T17:55:07.652163] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-21T17:55:07.652559] [DEBUG] [LOCAL ] CHN: Trimmed 7535 records to 4994 (keeping 200 days of data) [2025-10-21T17:55:07.680516] [DEBUG] [LOCAL ] CHN: Primary data saved (4994 records). [2025-10-21T17:55:07.680599] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-21T17:55:07.680694] [INFO ] [MAIN ] Update Progress: 439/2366 symbols completed. CHN took 25.0s. Estimated remaining: 4h 1m 41s. Rate: 8.0 symbols/min [2025-10-21T17:55:09.556243] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-21T17:55:09.567571] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-21T17:55:11.785033] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-21T17:55:11.796190] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-21T17:55:14.201926] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-21T17:55:14.214237] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-21T17:55:16.306323] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-21T17:55:16.316930] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-21T17:55:19.035588] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-10-21T17:55:19.047328] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-21T17:55:20.681507] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T17:55:20.692429] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-21T17:55:22.305840] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T17:55:22.314664] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-21T17:55:24.217072] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T17:55:24.224185] [INFO ] [REMOTE ] CHPT: Full fetch complete (71261 records). [2025-10-21T17:55:24.224425] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-21T17:55:24.637670] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-21T17:55:24.637784] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-21T17:55:24.638726] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-21T17:55:24.638790] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-21T17:55:24.640169] [DEBUG] [LOCAL ] CHPT: Trimmed 71261 records to 47136 (keeping 200 days of data) [2025-10-21T17:55:24.925682] [DEBUG] [LOCAL ] CHPT: Primary data saved (47136 records). [2025-10-21T17:55:24.925819] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-21T17:55:24.925895] [INFO ] [MAIN ] Update Progress: 440/2366 symbols completed. CHPT took 25.7s. Estimated remaining: 4h 2m 16s. Rate: 7.9 symbols/min [2025-10-21T17:55:25.479395] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:55:25.511164] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:55:25.544365] [DEBUG] [LOCAL ] CHT: No existing data file found in primary storage. [2025-10-21T17:55:25.553005] [WARN ] [MAIN ] CHT: No existing data found, performing full refresh instead. [2025-10-21T17:55:25.559365] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-21T17:55:25.580857] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-21T17:55:25.662145] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:55:25.656179] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-10-21T17:55:25.668339] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-21T17:55:25.721834] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:55:25.828155] [DEBUG] [LOCAL ] CIA: Loaded 16550 existing records from primary storage. [2025-10-21T17:55:25.834198] [INFO ] [MAIN ] CIA: Loaded 16550 existing records. [2025-10-21T17:55:26.074146] [DEBUG] [LOCAL ] CI: Loaded 49691 existing records from primary storage. [2025-10-21T17:55:26.140121] [INFO ] [MAIN ] CI: Loaded 49691 existing records. [2025-10-21T17:55:26.352015] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:55:26.374085] [DEBUG] [LOCAL ] CHWY: Loaded 53656 existing records from primary storage. [2025-10-21T17:55:26.392633] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-21T17:55:26.403093] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-21T17:55:26.428841] [INFO ] [MAIN ] CHWY: Loaded 53656 existing records. [2025-10-21T17:55:26.453335] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-21T17:55:26.471111] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-21T17:55:26.500818] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:55:26.610417] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-21T17:55:26.675026] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:55:26.702008] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-21T17:55:26.795811] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-21T17:55:26.880924] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:55:26.874733] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-21T17:55:26.934239] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-21T17:55:26.934155] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-21T17:55:26.954242] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-21T17:55:26.974570] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-21T17:55:26.986953] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-21T17:55:27.394953] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:55:27.461235] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-21T17:55:27.771344] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:55:27.798076] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-21T17:55:27.849624] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:55:27.850776] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-21T17:55:27.878782] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T17:55:27.882401] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-21T17:55:28.530614] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T17:55:28.534023] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-21T17:55:28.859178] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T17:55:28.863183] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-21T17:55:29.351329] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T17:55:29.355259] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-21T17:55:29.526525] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-21T17:55:29.537396] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-21T17:55:29.653394] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-21T17:55:29.664865] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-21T17:55:30.078023] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T17:55:30.082926] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-21T17:55:30.316629] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-21T17:55:30.320386] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-21T17:55:31.217535] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T17:55:31.249175] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-21T17:55:31.248631] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-21T17:55:31.269252] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T17:55:31.268669] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-21T17:55:31.275325] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-21T17:55:31.310902] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T17:55:31.321092] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-21T17:55:32.133863] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-21T17:55:32.137362] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-21T17:55:32.410584] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T17:55:32.415442] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-21T17:55:33.239802] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T17:55:33.250730] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T17:55:33.263193] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-21T17:55:33.262762] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-21T17:55:33.293905] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T17:55:33.321471] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-21T17:55:33.325918] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-21T17:55:33.332793] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-21T17:55:34.346398] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T17:55:34.351127] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-21T17:55:34.448484] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-21T17:55:34.453612] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-21T17:55:35.280286] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-21T17:55:35.291608] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-21T17:55:35.399385] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-21T17:55:35.403192] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-21T17:55:35.446723] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-21T17:55:35.457341] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-21T17:55:35.487053] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T17:55:35.491956] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-21T17:55:36.321885] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T17:55:36.325673] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-21T17:55:36.551499] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-21T17:55:36.818030] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T17:55:36.950999] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-21T17:55:37.313074] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T17:55:37.318486] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T17:55:37.327272] [INFO ] [REMOTE ] CIA: Full fetch complete (23364 records). [2025-10-21T17:55:37.327348] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-21T17:55:37.689539] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-21T17:55:37.689614] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-21T17:55:37.690059] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-21T17:55:37.690121] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-21T17:55:37.690714] [DEBUG] [LOCAL ] CIA: Trimmed 23364 records to 16533 (keeping 200 days of data) [2025-10-21T17:55:37.755957] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-21T17:55:37.784125] [DEBUG] [LOCAL ] CIA: Primary data saved (16533 records). [2025-10-21T17:55:37.784242] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-21T17:55:37.784334] [INFO ] [MAIN ] Update Progress: 441/2366 symbols completed. CIA took 12.8s. Estimated remaining: 4h 2m 32s. Rate: 7.9 symbols/min [2025-10-21T17:55:37.951184] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:55:37.980032] [DEBUG] [LOCAL ] CIB: Loaded 30372 existing records from primary storage. [2025-10-21T17:55:37.980298] [INFO ] [MAIN ] CIB: Loaded 30372 existing records. [2025-10-21T17:55:38.154415] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:55:38.154675] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-21T17:55:38.154733] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-21T17:55:38.155196] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-21T17:55:38.155252] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-21T17:55:38.504125] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:55:38.551009] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-21T17:55:38.973174] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-21T17:55:39.010222] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T17:55:39.013492] [INFO ] [REMOTE ] CHT: Full fetch complete (27674 records). [2025-10-21T17:55:39.013568] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-21T17:55:39.363534] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-21T17:55:39.376871] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-21T17:55:39.376942] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-21T17:55:39.377478] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-21T17:55:39.377682] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-21T17:55:39.378447] [DEBUG] [LOCAL ] CHT: Trimmed 27674 records to 19274 (keeping 200 days of data) [2025-10-21T17:55:39.489812] [DEBUG] [LOCAL ] CHT: Primary data saved (19274 records). [2025-10-21T17:55:39.489936] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-21T17:55:39.490004] [INFO ] [MAIN ] Update Progress: 442/2366 symbols completed. CHT took 14.6s. Estimated remaining: 4h 1m 59s. Rate: 8.0 symbols/min [2025-10-21T17:55:39.659216] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:55:39.659358] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-21T17:55:39.659393] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-21T17:55:39.659498] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-21T17:55:39.659538] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-21T17:55:39.659578] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-21T17:55:39.659609] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-21T17:55:40.014764] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:55:40.032852] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T17:55:40.151000] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-21T17:55:40.508770] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-21T17:55:40.686416] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T17:55:40.951047] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-21T17:55:41.751093] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-21T17:55:42.294125] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T17:55:42.551027] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-21T17:55:42.984137] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-21T17:55:43.351068] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-21T17:55:43.540525] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T17:55:43.793869] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-21T17:55:44.151090] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-21T17:55:44.951019] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-21T17:55:45.751085] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-21T17:55:45.979548] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T17:55:46.551057] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-21T17:55:47.092533] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-21T17:55:47.099295] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T17:55:47.123766] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-21T17:55:47.351014] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-21T17:55:48.151020] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-21T17:55:48.506302] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-21T17:55:48.786122] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T17:55:48.951033] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-21T17:55:49.286761] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-21T17:55:49.751025] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-21T17:55:50.551049] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-21T17:55:51.351027] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-21T17:55:51.647579] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T17:55:51.887114] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-21T17:55:51.913865] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-21T17:55:52.151058] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-21T17:55:52.505193] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-21T17:55:52.951034] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-21T17:55:53.751006] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-21T17:55:54.352911] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T17:55:54.551026] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-21T17:55:55.351025] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-21T17:55:55.542680] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T17:55:56.150991] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-21T17:55:56.431596] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T17:55:56.509820] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T17:55:56.950990] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-21T17:55:57.750997] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-21T17:55:58.192567] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T17:55:58.367781] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-21T17:55:58.405549] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-21T17:55:58.414882] [INFO ] [REMOTE ] CHWY: Full fetch complete (77781 records). [2025-10-21T17:55:58.415038] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-21T17:55:58.557443] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-21T17:55:58.810312] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-21T17:55:58.810418] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-21T17:55:58.811289] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-21T17:55:58.811354] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-21T17:55:58.812811] [DEBUG] [LOCAL ] CHWY: Trimmed 77781 records to 53656 (keeping 200 days of data) [2025-10-21T17:55:59.117113] [DEBUG] [LOCAL ] CHWY: Primary data saved (53656 records). [2025-10-21T17:55:59.117254] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-21T17:55:59.117922] [INFO ] [MAIN ] Update Progress: 443/2366 symbols completed. CHWY took 34.2s. Estimated remaining: 4h 2m 44s. Rate: 7.9 symbols/min [2025-10-21T17:55:59.286211] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:55:59.336572] [DEBUG] [LOCAL ] CIEN: Loaded 52129 existing records from primary storage. [2025-10-21T17:55:59.336907] [INFO ] [MAIN ] CIEN: Loaded 52129 existing records. [2025-10-21T17:55:59.357317] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-21T17:55:59.513784] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:55:59.514018] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-21T17:55:59.514065] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-21T17:55:59.514792] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-21T17:55:59.514848] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-21T17:55:59.867701] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-21T17:55:59.867586] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:55:59.868633] [INFO ] [REMOTE ] CICB: Full fetch complete (1950 records). [2025-10-21T17:55:59.868731] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-21T17:56:00.047042] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-21T17:56:00.047198] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:56:00.047280] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:56:00.047349] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-21T17:56:00.047520] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-21T17:56:00.047615] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-21T17:56:00.047712] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-21T17:56:00.047782] [INFO ] [MAIN ] Update Progress: 444/2366 symbols completed. CICB took 20.6s. Estimated remaining: 4h 2m 8s. Rate: 7.9 symbols/min [2025-10-21T17:56:00.128242] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T17:56:00.151198] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-21T17:56:00.242053] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:56:00.247171] [DEBUG] [LOCAL ] CIF: Loaded 4025 existing records from primary storage. [2025-10-21T17:56:00.247314] [INFO ] [MAIN ] CIF: Loaded 4025 existing records. [2025-10-21T17:56:00.419632] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:56:00.419803] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-21T17:56:00.419848] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-21T17:56:00.420021] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-21T17:56:00.420077] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-21T17:56:00.763599] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:56:00.950980] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-21T17:56:01.676794] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-21T17:56:01.751098] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-21T17:56:02.412304] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-21T17:56:02.551075] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-21T17:56:03.129868] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T17:56:03.134514] [INFO ] [REMOTE ] CIB: Full fetch complete (45177 records). [2025-10-21T17:56:03.134615] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-21T17:56:03.135217] [FATAL] [VALIDATOR ] CIB: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:56:03.135308] [FATAL] [MAIN ] CIB: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:56:03.135378] [WARN ] [MAIN ] CIB: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:56:03.135464] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-21T17:56:03.135540] [DEBUG] [LOCAL ] CIB: No primary data file found to delete. [2025-10-21T17:56:03.135588] [INFO ] [LOCAL ] CIB: Starting deletion of derivative data. [2025-10-21T17:56:03.135802] [DEBUG] [LOCAL ] CIB: Deleted derivative data file. [2025-10-21T17:56:03.135909] [INFO ] [MAIN ] Update Progress: 445/2366 symbols completed. CIB took 25.4s. Estimated remaining: 4h 1m 41s. Rate: 7.9 symbols/min [2025-10-21T17:56:03.302499] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:56:03.342493] [DEBUG] [LOCAL ] CIG: Loaded 44324 existing records from primary storage. [2025-10-21T17:56:03.342818] [INFO ] [MAIN ] CIG: Loaded 44324 existing records. [2025-10-21T17:56:03.356155] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-21T17:56:03.525709] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:56:03.525896] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-21T17:56:03.525942] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-21T17:56:03.526567] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-21T17:56:03.526625] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-21T17:56:03.876364] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:56:04.151020] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-21T17:56:04.182195] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T17:56:04.260573] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T17:56:04.267885] [INFO ] [REMOTE ] CI: Full fetch complete (72071 records). [2025-10-21T17:56:04.267999] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-21T17:56:04.572240] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-21T17:56:04.660664] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-21T17:56:04.660751] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-21T17:56:04.661543] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-21T17:56:04.661582] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-21T17:56:04.662869] [DEBUG] [LOCAL ] CI: Trimmed 72071 records to 49617 (keeping 200 days of data) [2025-10-21T17:56:04.954780] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-21T17:56:04.965796] [DEBUG] [LOCAL ] CI: Primary data saved (49617 records). [2025-10-21T17:56:04.965863] [INFO ] [MAIN ] CI: Full history saved. [2025-10-21T17:56:04.966868] [INFO ] [MAIN ] Update Progress: 446/2366 symbols completed. CI took 40.0s. Estimated remaining: 4h 1m 9s. Rate: 8.0 symbols/min [2025-10-21T17:56:05.134478] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:56:05.152907] [DEBUG] [LOCAL ] CII: Loaded 15328 existing records from primary storage. [2025-10-21T17:56:05.153131] [INFO ] [MAIN ] CII: Loaded 15328 existing records. [2025-10-21T17:56:05.329197] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:56:05.329453] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-21T17:56:05.329506] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-21T17:56:05.329711] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-21T17:56:05.329766] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-21T17:56:05.676632] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:56:05.751017] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-21T17:56:06.550999] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-21T17:56:06.872672] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-21T17:56:06.922329] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T17:56:07.351053] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-21T17:56:08.098197] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-21T17:56:08.150433] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T17:56:08.157751] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-21T17:56:08.816255] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-21T17:56:08.951090] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-21T17:56:09.592083] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-21T17:56:09.751104] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-21T17:56:10.330782] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-21T17:56:10.551026] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-21T17:56:11.351060] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-21T17:56:11.405510] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-21T17:56:12.151014] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-21T17:56:12.776042] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:56:12.951058] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-21T17:56:13.751068] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-21T17:56:13.999354] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-21T17:56:14.020390] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T17:56:14.459403] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-21T17:56:14.550998] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-21T17:56:15.351003] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-21T17:56:15.592753] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T17:56:16.026832] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-21T17:56:16.151007] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-21T17:56:16.821932] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-21T17:56:16.823022] [INFO ] [REMOTE ] CIF: Full fetch complete (6533 records). [2025-10-21T17:56:16.823089] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-21T17:56:16.823435] [FATAL] [VALIDATOR ] CIF: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:56:16.823515] [FATAL] [MAIN ] CIF: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:56:16.823571] [WARN ] [MAIN ] CIF: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:56:16.823680] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-21T17:56:16.823770] [DEBUG] [LOCAL ] CIF: No primary data file found to delete. [2025-10-21T17:56:16.823818] [INFO ] [LOCAL ] CIF: Starting deletion of derivative data. [2025-10-21T17:56:16.823961] [DEBUG] [LOCAL ] CIF: Deleted derivative data file. [2025-10-21T17:56:16.824061] [INFO ] [MAIN ] Update Progress: 447/2366 symbols completed. CIF took 16.8s. Estimated remaining: 4h 1m 20s. Rate: 8.0 symbols/min [2025-10-21T17:56:16.960290] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-21T17:56:16.991301] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:56:17.027773] [DEBUG] [LOCAL ] CIM: Loaded 37626 existing records from primary storage. [2025-10-21T17:56:17.028066] [INFO ] [MAIN ] CIM: Loaded 37626 existing records. [2025-10-21T17:56:17.205092] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:56:17.205353] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-21T17:56:17.205407] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-21T17:56:17.206120] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-21T17:56:17.206177] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-21T17:56:17.549170] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:56:17.751019] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-21T17:56:18.056822] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T17:56:18.551064] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-21T17:56:19.351036] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-21T17:56:19.983437] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-21T17:56:20.122603] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T17:56:20.150983] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-21T17:56:20.839058] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T17:56:20.951024] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-21T17:56:21.751012] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-21T17:56:21.916928] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T17:56:21.998216] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-21T17:56:22.551053] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-21T17:56:23.351023] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-21T17:56:23.383473] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T17:56:23.524264] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-21T17:56:24.150990] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-21T17:56:24.917055] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T17:56:24.950999] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-21T17:56:25.050590] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-21T17:56:25.751083] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-21T17:56:26.409250] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T17:56:26.551047] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-21T17:56:26.939787] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T17:56:27.351024] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-21T17:56:28.151034] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-21T17:56:28.505329] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-21T17:56:28.880128] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T17:56:28.951004] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-21T17:56:29.227871] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-21T17:56:29.751011] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-21T17:56:30.434889] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T17:56:30.551056] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-21T17:56:30.819973] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-21T17:56:30.823772] [INFO ] [REMOTE ] CII: Full fetch complete (22868 records). [2025-10-21T17:56:30.823861] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-21T17:56:31.216421] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-21T17:56:31.216512] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-21T17:56:31.217014] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-21T17:56:31.217106] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-21T17:56:31.217859] [DEBUG] [LOCAL ] CII: Trimmed 22868 records to 15235 (keeping 200 days of data) [2025-10-21T17:56:31.310053] [DEBUG] [LOCAL ] CII: Primary data saved (15235 records). [2025-10-21T17:56:31.310202] [INFO ] [MAIN ] CII: Full history saved. [2025-10-21T17:56:31.310280] [INFO ] [MAIN ] Update Progress: 448/2366 symbols completed. CII took 26.3s. Estimated remaining: 4h 1m 42s. Rate: 7.9 symbols/min [2025-10-21T17:56:31.356185] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-21T17:56:31.483780] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:56:31.488603] [DEBUG] [LOCAL ] CIMN: Loaded 2756 existing records from primary storage. [2025-10-21T17:56:31.488778] [INFO ] [MAIN ] CIMN: Loaded 2756 existing records. [2025-10-21T17:56:31.661844] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:56:31.662061] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-21T17:56:31.662109] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-21T17:56:31.662269] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-21T17:56:31.662325] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-21T17:56:32.032990] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:56:32.151008] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-21T17:56:32.292330] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T17:56:32.722711] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-21T17:56:32.940493] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T17:56:32.950969] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-21T17:56:33.751024] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-21T17:56:34.468498] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T17:56:34.551031] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-21T17:56:35.351127] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-21T17:56:35.647828] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T17:56:36.151005] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-21T17:56:36.183522] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T17:56:36.522696] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-21T17:56:36.951097] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-21T17:56:37.751006] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-21T17:56:38.141546] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T17:56:38.150032] [INFO ] [REMOTE ] CIEN: Full fetch complete (75837 records). [2025-10-21T17:56:38.150182] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-21T17:56:38.549284] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-21T17:56:38.549402] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-21T17:56:38.550367] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-21T17:56:38.550526] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-21T17:56:38.551019] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-21T17:56:38.580379] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T17:56:38.589753] [DEBUG] [LOCAL ] CIEN: Trimmed 75837 records to 52126 (keeping 200 days of data) [2025-10-21T17:56:38.880666] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-21T17:56:38.969597] [DEBUG] [LOCAL ] CIEN: Primary data saved (52126 records). [2025-10-21T17:56:38.969816] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-21T17:56:38.970799] [INFO ] [MAIN ] Update Progress: 449/2366 symbols completed. CIEN took 39.9s. Estimated remaining: 4h 1m 35s. Rate: 7.9 symbols/min [2025-10-21T17:56:39.080933] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-21T17:56:39.153179] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:56:39.153353] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-21T17:56:39.153391] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-21T17:56:39.153539] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-21T17:56:39.153581] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-21T17:56:39.153622] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-21T17:56:39.153689] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-21T17:56:39.356224] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-21T17:56:39.514054] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:56:40.151066] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-21T17:56:40.882555] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T17:56:40.950980] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-21T17:56:41.751071] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-21T17:56:42.015094] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-21T17:56:42.022849] [INFO ] [REMOTE ] CIG: Full fetch complete (62632 records). [2025-10-21T17:56:42.022957] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-21T17:56:42.376011] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T17:56:42.475306] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-21T17:56:42.475403] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-21T17:56:42.476208] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-21T17:56:42.476281] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-21T17:56:42.477603] [DEBUG] [LOCAL ] CIG: Trimmed 62632 records to 44458 (keeping 200 days of data) [2025-10-21T17:56:42.559417] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-21T17:56:42.569615] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-21T17:56:42.732912] [DEBUG] [LOCAL ] CIG: Primary data saved (44458 records). [2025-10-21T17:56:42.733037] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-21T17:56:42.733121] [INFO ] [MAIN ] Update Progress: 450/2366 symbols completed. CIG took 39.6s. Estimated remaining: 4h 1m 11s. Rate: 7.9 symbols/min [2025-10-21T17:56:42.930322] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:56:42.930485] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-21T17:56:42.930521] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-21T17:56:42.930635] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-21T17:56:42.930712] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-21T17:56:42.930761] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-21T17:56:42.930796] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-21T17:56:43.281863] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:56:43.351014] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-10-21T17:56:43.541485] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:56:43.541899] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-10-21T17:56:43.542015] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:56:43.542060] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-21T17:56:43.542127] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:56:43.542194] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-21T17:56:43.542268] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-21T17:56:43.542321] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-21T17:56:43.542364] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-21T17:56:43.542409] [INFO ] [MAIN ] Update Progress: 451/2366 symbols completed. CIMP took 0.8s. Estimated remaining: 4h 0m 35s. Rate: 8.0 symbols/min [2025-10-21T17:56:43.710703] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:56:43.730602] [DEBUG] [LOCAL ] CINT: Loaded 20229 existing records from primary storage. [2025-10-21T17:56:43.730889] [INFO ] [MAIN ] CINT: Loaded 20229 existing records. [2025-10-21T17:56:43.907752] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:56:43.908118] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-21T17:56:43.908257] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-21T17:56:43.908815] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-21T17:56:43.908872] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-21T17:56:44.164393] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-21T17:56:44.217133] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-21T17:56:44.301873] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:56:44.659274] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-21T17:56:44.951007] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-21T17:56:45.751063] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-21T17:56:45.940542] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T17:56:46.189059] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-21T17:56:46.551067] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-21T17:56:47.113950] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-21T17:56:47.351047] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-21T17:56:48.151038] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-21T17:56:48.373807] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-21T17:56:48.685151] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-21T17:56:48.951031] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-21T17:56:49.519544] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-21T17:56:49.751028] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-21T17:56:50.217814] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-21T17:56:50.551024] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-21T17:56:50.892712] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-21T17:56:51.351021] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-21T17:56:51.922775] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-21T17:56:52.151009] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-21T17:56:52.951076] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-21T17:56:53.087622] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-21T17:56:53.387196] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-21T17:56:53.751056] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-21T17:56:54.049237] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-21T17:56:54.551060] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-21T17:56:55.123532] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-21T17:56:55.351079] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-21T17:56:56.151034] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-21T17:56:56.411357] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-21T17:56:56.903757] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-21T17:56:56.951004] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-21T17:56:57.583984] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-21T17:56:57.585268] [INFO ] [REMOTE ] CIMO: Full fetch complete (4580 records). [2025-10-21T17:56:57.585340] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-21T17:56:57.762804] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-21T17:56:57.769458] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T17:56:57.770804] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:56:57.770875] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:56:57.770944] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-21T17:56:57.771008] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-21T17:56:57.771043] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-21T17:56:57.771080] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-21T17:56:57.771138] [INFO ] [MAIN ] Update Progress: 452/2366 symbols completed. CIMO took 18.8s. Estimated remaining: 4h 0m 55s. Rate: 7.9 symbols/min [2025-10-21T17:56:57.941504] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:56:57.965416] [DEBUG] [LOCAL ] CIO: Loaded 21090 existing records from primary storage. [2025-10-21T17:56:57.965756] [INFO ] [MAIN ] CIO: Loaded 21090 existing records. [2025-10-21T17:56:58.157110] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:56:58.157332] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-21T17:56:58.157379] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-21T17:56:58.157603] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-21T17:56:58.157675] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-21T17:56:58.513566] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:56:58.550981] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-21T17:56:59.351027] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-21T17:56:59.563765] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T17:56:59.570074] [INFO ] [REMOTE ] CIM: Full fetch complete (54845 records). [2025-10-21T17:56:59.570174] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-21T17:56:59.849100] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T17:56:59.968142] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-21T17:56:59.968224] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-21T17:56:59.968916] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-21T17:56:59.968977] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-21T17:56:59.970025] [DEBUG] [LOCAL ] CIM: Trimmed 54845 records to 37513 (keeping 200 days of data) [2025-10-21T17:57:00.167857] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-21T17:57:00.201044] [DEBUG] [LOCAL ] CIM: Primary data saved (37513 records). [2025-10-21T17:57:00.201178] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-21T17:57:00.201677] [INFO ] [MAIN ] Update Progress: 453/2366 symbols completed. CIM took 43.4s. Estimated remaining: 4h 0m 26s. Rate: 8.0 symbols/min [2025-10-21T17:57:00.326733] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-21T17:57:00.390180] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:57:00.418815] [DEBUG] [LOCAL ] CION: Loaded 28316 existing records from primary storage. [2025-10-21T17:57:00.419083] [INFO ] [MAIN ] CION: Loaded 28316 existing records. [2025-10-21T17:57:00.602883] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:57:00.603093] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-21T17:57:00.603142] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-21T17:57:00.603439] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-10-21T17:57:00.603497] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-21T17:57:00.698978] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-21T17:57:00.957034] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-21T17:57:00.965787] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:57:01.751084] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-21T17:57:02.088705] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-21T17:57:02.551023] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-21T17:57:02.733694] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T17:57:03.351008] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-21T17:57:03.525057] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-21T17:57:03.835068] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-21T17:57:04.151024] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-21T17:57:04.655285] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-21T17:57:04.951022] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-21T17:57:05.751036] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-21T17:57:06.251820] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T17:57:06.551006] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-21T17:57:06.917202] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-21T17:57:07.145913] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-21T17:57:07.146934] [INFO ] [REMOTE ] CIMN: Full fetch complete (3945 records). [2025-10-21T17:57:07.147000] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-21T17:57:07.359779] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-21T17:57:07.548678] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-21T17:57:07.548765] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-21T17:57:07.548899] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-21T17:57:07.548938] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-21T17:57:07.549313] [DEBUG] [LOCAL ] CIMN: Trimmed 3945 records to 2746 (keeping 200 days of data) [2025-10-21T17:57:07.565826] [DEBUG] [LOCAL ] CIMN: Primary data saved (2746 records). [2025-10-21T17:57:07.565933] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-21T17:57:07.566009] [INFO ] [MAIN ] Update Progress: 454/2366 symbols completed. CIMN took 36.3s. Estimated remaining: 4h 0m 18s. Rate: 8.0 symbols/min [2025-10-21T17:57:07.738101] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:57:07.787026] [DEBUG] [LOCAL ] CIVI: Loaded 52736 existing records from primary storage. [2025-10-21T17:57:07.787338] [INFO ] [MAIN ] CIVI: Loaded 52736 existing records. [2025-10-21T17:57:07.961570] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:57:07.961811] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-21T17:57:07.961858] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-21T17:57:07.962720] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-21T17:57:07.963150] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-21T17:57:08.157278] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-21T17:57:08.322156] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:57:08.338329] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-21T17:57:08.951050] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-21T17:57:09.213975] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T17:57:09.751078] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-21T17:57:10.222815] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T17:57:10.227699] [INFO ] [REMOTE ] CINT: Full fetch complete (28331 records). [2025-10-21T17:57:10.227801] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-21T17:57:10.555288] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-21T17:57:10.615969] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-21T17:57:10.627084] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-21T17:57:10.629800] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-21T17:57:10.630951] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-21T17:57:10.630440] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-21T17:57:10.637787] [DEBUG] [LOCAL ] CINT: Trimmed 28331 records to 20318 (keeping 200 days of data) [2025-10-21T17:57:10.756717] [DEBUG] [LOCAL ] CINT: Primary data saved (20318 records). [2025-10-21T17:57:10.756899] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-21T17:57:10.756987] [INFO ] [MAIN ] Update Progress: 455/2366 symbols completed. CINT took 27.2s. Estimated remaining: 3h 59m 52s. Rate: 8.0 symbols/min [2025-10-21T17:57:10.953639] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:57:11.002683] [DEBUG] [LOCAL ] CL: Loaded 53649 existing records from primary storage. [2025-10-21T17:57:11.003068] [INFO ] [MAIN ] CL: Loaded 53649 existing records. [2025-10-21T17:57:11.203404] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:57:11.203607] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-21T17:57:11.203681] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-21T17:57:11.204563] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-21T17:57:11.204620] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-21T17:57:11.377416] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-21T17:57:11.561940] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:57:12.151063] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-21T17:57:12.482957] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T17:57:12.523979] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-21T17:57:12.950994] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-21T17:57:13.160860] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T17:57:13.751067] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-21T17:57:14.319483] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T17:57:14.551058] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-21T17:57:14.662784] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-21T17:57:15.351038] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-21T17:57:16.151052] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-21T17:57:16.951001] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-21T17:57:17.167433] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-10-21T17:57:17.267243] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-21T17:57:17.311514] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T17:57:17.751008] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-21T17:57:18.156134] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-21T17:57:18.551000] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-21T17:57:18.856115] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-21T17:57:19.351052] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-21T17:57:19.698371] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-21T17:57:20.151065] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-21T17:57:20.951007] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-21T17:57:21.318260] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T17:57:21.397379] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-21T17:57:21.751027] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-21T17:57:22.459294] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T17:57:22.551034] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-21T17:57:22.962862] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-21T17:57:23.351050] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-21T17:57:24.151000] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-21T17:57:24.435094] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T17:57:24.951052] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-21T17:57:25.358557] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-21T17:57:25.382209] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-21T17:57:25.751070] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-21T17:57:26.551080] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-21T17:57:27.026293] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-21T17:57:27.053022] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T17:57:27.059176] [INFO ] [REMOTE ] CIO: Full fetch complete (29675 records). [2025-10-21T17:57:27.059280] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-21T17:57:27.356542] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-21T17:57:27.438160] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-21T17:57:27.438261] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-21T17:57:27.438814] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-21T17:57:27.438880] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-21T17:57:27.439791] [DEBUG] [LOCAL ] CIO: Trimmed 29675 records to 21132 (keeping 200 days of data) [2025-10-21T17:57:27.555465] [DEBUG] [LOCAL ] CIO: Primary data saved (21132 records). [2025-10-21T17:57:27.555596] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-21T17:57:27.555692] [INFO ] [MAIN ] Update Progress: 456/2366 symbols completed. CIO took 29.8s. Estimated remaining: 4h 0m 23s. Rate: 7.9 symbols/min [2025-10-21T17:57:27.724512] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:57:27.757247] [DEBUG] [LOCAL ] CLB: Loaded 33606 existing records from primary storage. [2025-10-21T17:57:27.757527] [INFO ] [MAIN ] CLB: Loaded 33606 existing records. [2025-10-21T17:57:27.925409] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T17:57:27.973719] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:57:27.973938] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-21T17:57:27.974010] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-21T17:57:27.974626] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-21T17:57:27.974721] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-21T17:57:28.152202] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-21T17:57:28.346608] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:57:28.951067] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-21T17:57:29.163064] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T17:57:29.751000] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-21T17:57:29.949298] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T17:57:30.130931] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T17:57:30.550995] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-21T17:57:31.231215] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T17:57:31.351010] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-21T17:57:32.151020] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-21T17:57:32.300686] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T17:57:32.951056] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-21T17:57:33.155141] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T17:57:33.390029] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-21T17:57:33.751065] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-21T17:57:34.557022] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-21T17:57:34.571149] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T17:57:35.351006] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-21T17:57:35.568038] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T17:57:35.761154] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-21T17:57:36.151081] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-21T17:57:36.951010] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-21T17:57:37.044858] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T17:57:37.547035] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T17:57:37.751092] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-21T17:57:38.551017] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-21T17:57:38.726912] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T17:57:39.024479] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T17:57:39.029027] [INFO ] [REMOTE ] CION: Full fetch complete (40640 records). [2025-10-21T17:57:39.029116] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-21T17:57:39.356240] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-21T17:57:39.394820] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-10-21T17:57:39.394953] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-10-21T17:57:39.395527] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-10-21T17:57:39.395570] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-10-21T17:57:39.396466] [DEBUG] [LOCAL ] CION: Trimmed 40640 records to 28277 (keeping 200 days of data) [2025-10-21T17:57:39.561510] [DEBUG] [LOCAL ] CION: Primary data saved (28277 records). [2025-10-21T17:57:39.561687] [INFO ] [MAIN ] CION: Full history saved. [2025-10-21T17:57:39.561779] [INFO ] [MAIN ] Update Progress: 457/2366 symbols completed. CION took 39.4s. Estimated remaining: 4h 0m 35s. Rate: 7.9 symbols/min [2025-10-21T17:57:39.751542] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:57:39.765275] [DEBUG] [LOCAL ] CLCO: Loaded 13189 existing records from primary storage. [2025-10-21T17:57:39.765548] [INFO ] [MAIN ] CLCO: Loaded 13189 existing records. [2025-10-21T17:57:39.937499] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:57:39.937699] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-21T17:57:39.937755] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-21T17:57:39.938001] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-21T17:57:39.938055] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-21T17:57:40.156326] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-21T17:57:40.300214] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:57:40.531798] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T17:57:40.951049] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-21T17:57:40.987415] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T17:57:41.750986] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-21T17:57:41.903008] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T17:57:41.911353] [INFO ] [REMOTE ] CIVI: Full fetch complete (76064 records). [2025-10-21T17:57:41.911466] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-21T17:57:42.082135] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-21T17:57:42.316261] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-21T17:57:42.316343] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-21T17:57:42.317196] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-21T17:57:42.317260] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-21T17:57:42.318677] [DEBUG] [LOCAL ] CIVI: Trimmed 76064 records to 52734 (keeping 200 days of data) [2025-10-21T17:57:42.551285] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-21T17:57:42.630420] [DEBUG] [LOCAL ] CIVI: Primary data saved (52734 records). [2025-10-21T17:57:42.630519] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-21T17:57:42.631300] [INFO ] [MAIN ] Update Progress: 458/2366 symbols completed. CIVI took 35.1s. Estimated remaining: 4h 0m 8s. Rate: 7.9 symbols/min [2025-10-21T17:57:42.800858] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:57:42.827925] [DEBUG] [LOCAL ] CLDT: Loaded 25365 existing records from primary storage. [2025-10-21T17:57:42.828220] [INFO ] [MAIN ] CLDT: Loaded 25365 existing records. [2025-10-21T17:57:43.004504] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:57:43.004736] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-21T17:57:43.004789] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-21T17:57:43.005149] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-21T17:57:43.005205] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-21T17:57:43.351109] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-21T17:57:43.373782] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:57:43.698728] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-21T17:57:43.707134] [INFO ] [REMOTE ] CL: Full fetch complete (77817 records). [2025-10-21T17:57:43.707276] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-21T17:57:43.999017] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T17:57:44.127864] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-21T17:57:44.127958] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-21T17:57:44.129027] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-21T17:57:44.129126] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-21T17:57:44.130872] [DEBUG] [LOCAL ] CL: Trimmed 77817 records to 53649 (keeping 200 days of data) [2025-10-21T17:57:44.183916] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-21T17:57:44.479121] [DEBUG] [LOCAL ] CL: Primary data saved (53649 records). [2025-10-21T17:57:44.479308] [INFO ] [MAIN ] CL: Full history saved. [2025-10-21T17:57:44.479528] [INFO ] [MAIN ] Update Progress: 459/2366 symbols completed. CL took 33.7s. Estimated remaining: 3h 59m 37s. Rate: 8.0 symbols/min [2025-10-21T17:57:44.558265] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-21T17:57:44.668210] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:57:44.716873] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-21T17:57:44.717172] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-10-21T17:57:44.894039] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:57:44.894215] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-21T17:57:44.894262] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-21T17:57:44.895050] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-21T17:57:44.895110] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-21T17:57:44.958399] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-21T17:57:45.256899] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:57:45.415284] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T17:57:45.750997] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-21T17:57:46.237354] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-21T17:57:46.551014] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-21T17:57:47.125638] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T17:57:47.351040] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-21T17:57:47.722090] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-21T17:57:48.151107] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-21T17:57:48.335980] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-21T17:57:48.951130] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-21T17:57:49.751060] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-21T17:57:50.291609] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-21T17:57:50.351561] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-21T17:57:50.551109] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-21T17:57:50.748723] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-21T17:57:51.351049] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-21T17:57:51.751360] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T17:57:52.151027] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-21T17:57:52.951022] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-21T17:57:53.040814] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-21T17:57:53.163359] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T17:57:53.751042] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-21T17:57:53.946151] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-21T17:57:54.551087] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-21T17:57:54.574019] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-21T17:57:55.351076] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-21T17:57:55.690758] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-21T17:57:56.151024] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-21T17:57:56.560529] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-21T17:57:56.950975] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-21T17:57:57.191399] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-21T17:57:57.751008] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-21T17:57:58.282027] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T17:57:58.301564] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-21T17:57:58.551024] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-21T17:57:59.351068] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-21T17:57:59.552392] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T17:58:00.151017] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-21T17:58:00.951019] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-21T17:58:01.101812] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-21T17:58:01.106243] [INFO ] [REMOTE ] CLDT: Full fetch complete (37584 records). [2025-10-21T17:58:01.106320] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-21T17:58:01.488317] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-21T17:58:01.488500] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-21T17:58:01.489129] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-21T17:58:01.489242] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-21T17:58:01.490088] [DEBUG] [LOCAL ] CLDT: Trimmed 37584 records to 25283 (keeping 200 days of data) [2025-10-21T17:58:01.634535] [DEBUG] [LOCAL ] CLDT: Primary data saved (25283 records). [2025-10-21T17:58:01.634745] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-21T17:58:01.634948] [INFO ] [MAIN ] Update Progress: 460/2366 symbols completed. CLDT took 19.0s. Estimated remaining: 4h 0m 9s. Rate: 7.9 symbols/min [2025-10-21T17:58:01.774539] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T17:58:01.770337] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-21T17:58:01.790845] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-21T17:58:01.861768] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:58:01.887757] [DEBUG] [LOCAL ] CLH: Loaded 27808 existing records from primary storage. [2025-10-21T17:58:01.888005] [INFO ] [MAIN ] CLH: Loaded 27808 existing records. [2025-10-21T17:58:02.065167] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:58:02.065338] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-21T17:58:02.065390] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-21T17:58:02.066064] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-21T17:58:02.066156] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-21T17:58:02.412962] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:58:02.550995] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-21T17:58:02.852320] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-21T17:58:03.351044] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-21T17:58:04.133688] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T17:58:04.150969] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-21T17:58:04.951030] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-21T17:58:05.591543] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T17:58:05.675818] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-21T17:58:05.750980] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-21T17:58:06.283008] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T17:58:06.288364] [INFO ] [REMOTE ] CLB: Full fetch complete (47236 records). [2025-10-21T17:58:06.288443] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-21T17:58:06.559325] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-21T17:58:06.693616] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-21T17:58:06.693737] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-21T17:58:06.694662] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-21T17:58:06.694729] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-21T17:58:06.695856] [DEBUG] [LOCAL ] CLB: Trimmed 47236 records to 33495 (keeping 200 days of data) [2025-10-21T17:58:06.909881] [DEBUG] [LOCAL ] CLB: Primary data saved (33495 records). [2025-10-21T17:58:06.910018] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-21T17:58:06.910730] [INFO ] [MAIN ] Update Progress: 461/2366 symbols completed. CLB took 39.4s. Estimated remaining: 3h 59m 52s. Rate: 7.9 symbols/min [2025-10-21T17:58:07.101921] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:58:07.114359] [DEBUG] [LOCAL ] CLPR: Loaded 10162 existing records from primary storage. [2025-10-21T17:58:07.114586] [INFO ] [MAIN ] CLPR: Loaded 10162 existing records. [2025-10-21T17:58:07.317890] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:58:07.318162] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-21T17:58:07.318229] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-21T17:58:07.318503] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-10-21T17:58:07.318544] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-21T17:58:07.365357] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-21T17:58:07.631419] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T17:58:07.723954] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:58:07.754841] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-21T17:58:08.151016] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-21T17:58:08.706446] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T17:58:08.951018] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-21T17:58:09.751055] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-21T17:58:10.216193] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T17:58:10.219958] [INFO ] [REMOTE ] CLCO: Full fetch complete (22816 records). [2025-10-21T17:58:10.220033] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-21T17:58:10.551572] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-21T17:58:10.553293] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-21T17:58:10.643889] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-21T17:58:10.644392] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-21T17:58:10.644868] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-21T17:58:10.644943] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-21T17:58:10.645612] [DEBUG] [LOCAL ] CLCO: Trimmed 22816 records to 13154 (keeping 200 days of data) [2025-10-21T17:58:10.704911] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T17:58:10.727833] [DEBUG] [LOCAL ] CLCO: Primary data saved (13154 records). [2025-10-21T17:58:10.727919] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-21T17:58:10.727984] [INFO ] [MAIN ] Update Progress: 462/2366 symbols completed. CLCO took 31.2s. Estimated remaining: 3h 59m 29s. Rate: 8.0 symbols/min [2025-10-21T17:58:10.898896] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:58:10.950426] [DEBUG] [LOCAL ] CLS: Loaded 53569 existing records from primary storage. [2025-10-21T17:58:10.950752] [INFO ] [MAIN ] CLS: Loaded 53569 existing records. [2025-10-21T17:58:11.129982] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:58:11.130185] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-21T17:58:11.130231] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-21T17:58:11.131093] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-21T17:58:11.131148] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-21T17:58:11.356267] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-21T17:58:11.495414] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:58:12.151013] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-21T17:58:12.243557] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T17:58:12.951022] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-21T17:58:13.594125] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-21T17:58:13.750991] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-21T17:58:14.017200] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-21T17:58:14.401222] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-21T17:58:14.551014] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-21T17:58:14.959130] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-10-21T17:58:15.351027] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-21T17:58:15.855347] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T17:58:16.151020] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-21T17:58:16.596452] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T17:58:16.951030] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-21T17:58:16.998039] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-21T17:58:17.751038] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-21T17:58:18.373299] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-21T17:58:18.551051] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-21T17:58:19.351080] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-21T17:58:20.151006] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-21T17:58:20.312407] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-21T17:58:20.825876] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T17:58:20.936256] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-21T17:58:20.950987] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-21T17:58:21.073475] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T17:58:21.751077] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-21T17:58:22.551049] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-21T17:58:23.010867] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-21T17:58:23.351018] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-21T17:58:23.443468] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-21T17:58:23.976685] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-21T17:58:24.151024] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-21T17:58:24.951004] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-21T17:58:25.091560] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-21T17:58:25.741821] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-21T17:58:25.750136] [INFO ] [REMOTE ] CLF: Full fetch complete (77918 records). [2025-10-21T17:58:25.750261] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-21T17:58:25.751018] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-21T17:58:26.144003] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-21T17:58:26.144147] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-21T17:58:26.145043] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-21T17:58:26.145106] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-21T17:58:26.146566] [DEBUG] [LOCAL ] CLF: Trimmed 77918 records to 53741 (keeping 200 days of data) [2025-10-21T17:58:26.377601] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T17:58:26.478265] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-10-21T17:58:26.478411] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-21T17:58:26.478506] [INFO ] [MAIN ] Update Progress: 463/2366 symbols completed. CLF took 42.0s. Estimated remaining: 3h 59m 56s. Rate: 7.9 symbols/min [2025-10-21T17:58:26.552781] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-21T17:58:26.649799] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:58:26.685469] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-21T17:58:26.708129] [DEBUG] [LOCAL ] CLVT: Loaded 51923 existing records from primary storage. [2025-10-21T17:58:26.708441] [INFO ] [MAIN ] CLVT: Loaded 51923 existing records. [2025-10-21T17:58:26.880254] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:58:26.880463] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-21T17:58:26.880510] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-21T17:58:26.880755] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-21T17:58:26.880810] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-21T17:58:27.229992] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:58:27.351036] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-21T17:58:28.021194] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T17:58:28.027517] [INFO ] [REMOTE ] CLH: Full fetch complete (42206 records). [2025-10-21T17:58:28.027689] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-21T17:58:28.156131] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-21T17:58:28.402053] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-21T17:58:28.402129] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-21T17:58:28.402723] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-21T17:58:28.402783] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-21T17:58:28.403617] [DEBUG] [LOCAL ] CLH: Trimmed 42206 records to 27711 (keeping 200 days of data) [2025-10-21T17:58:28.566920] [DEBUG] [LOCAL ] CLH: Primary data saved (27711 records). [2025-10-21T17:58:28.567057] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-21T17:58:28.567138] [INFO ] [MAIN ] Update Progress: 464/2366 symbols completed. CLH took 26.9s. Estimated remaining: 3h 59m 25s. Rate: 7.9 symbols/min [2025-10-21T17:58:28.742098] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:58:28.752628] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-21T17:58:28.771041] [DEBUG] [LOCAL ] CLW: Loaded 21460 existing records from primary storage. [2025-10-21T17:58:28.771310] [INFO ] [MAIN ] CLW: Loaded 21460 existing records. [2025-10-21T17:58:28.955632] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-21T17:58:28.961550] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:58:28.962448] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-21T17:58:28.962519] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-21T17:58:28.962917] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-21T17:58:28.963025] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-21T17:58:29.087433] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T17:58:29.357459] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:58:29.751047] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-21T17:58:30.551093] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-21T17:58:31.306678] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T17:58:31.351052] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-21T17:58:31.435803] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T17:58:31.437445] [INFO ] [REMOTE ] CLPR: Full fetch complete (15943 records). [2025-10-21T17:58:31.437511] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-21T17:58:31.813441] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-10-21T17:58:31.813571] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-10-21T17:58:31.814188] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-10-21T17:58:31.814253] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-10-21T17:58:31.814901] [DEBUG] [LOCAL ] CLPR: Trimmed 15943 records to 10065 (keeping 200 days of data) [2025-10-21T17:58:31.893628] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-10-21T17:58:31.917011] [DEBUG] [LOCAL ] CLPR: Primary data saved (10065 records). [2025-10-21T17:58:31.917134] [INFO ] [MAIN ] CLPR: Full history saved. [2025-10-21T17:58:31.917209] [INFO ] [MAIN ] Update Progress: 465/2366 symbols completed. CLPR took 25.0s. Estimated remaining: 3h 59m 1s. Rate: 8.0 symbols/min [2025-10-21T17:58:32.086896] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:58:32.140745] [DEBUG] [LOCAL ] CLX: Loaded 51778 existing records from primary storage. [2025-10-21T17:58:32.141048] [INFO ] [MAIN ] CLX: Loaded 51778 existing records. [2025-10-21T17:58:32.161039] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-21T17:58:32.318477] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:58:32.318704] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-21T17:58:32.318760] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-21T17:58:32.319131] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-21T17:58:32.319192] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-21T17:58:32.681158] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:58:32.957682] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-21T17:58:32.977531] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T17:58:33.221707] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T17:58:33.751071] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-21T17:58:34.551037] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-21T17:58:34.747113] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T17:58:35.351060] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-21T17:58:35.408079] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T17:58:35.435608] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T17:58:36.151080] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-21T17:58:36.951007] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-21T17:58:37.532482] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-21T17:58:37.751001] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-21T17:58:37.954973] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T17:58:38.112410] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-21T17:58:38.551056] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-21T17:58:39.351060] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-21T17:58:39.899473] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-21T17:58:40.146888] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T17:58:40.156405] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-21T17:58:40.488866] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T17:58:40.951101] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-21T17:58:41.751084] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-21T17:58:42.549210] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-21T17:58:42.560440] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-21T17:58:42.650909] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T17:58:43.341540] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T17:58:43.351208] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-21T17:58:43.809151] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T17:58:44.151018] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-21T17:58:44.951042] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-21T17:58:45.103271] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-21T17:58:45.751078] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-21T17:58:45.934244] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T17:58:46.432369] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-21T17:58:46.551027] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-21T17:58:47.351062] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-21T17:58:47.547989] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-21T17:58:48.151058] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-21T17:58:48.370211] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-21T17:58:48.624543] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-21T17:58:48.951028] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-21T17:58:49.751045] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-21T17:58:49.938775] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T17:58:50.551091] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-21T17:58:50.932528] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T17:58:51.351022] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-21T17:58:52.023235] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-21T17:58:52.032495] [INFO ] [REMOTE ] CLS: Full fetch complete (77697 records). [2025-10-21T17:58:52.032625] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-21T17:58:52.154272] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-21T17:58:52.450033] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-21T17:58:52.450177] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-21T17:58:52.451262] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-21T17:58:52.451394] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-21T17:58:52.452947] [DEBUG] [LOCAL ] CLS: Trimmed 77697 records to 53563 (keeping 200 days of data) [2025-10-21T17:58:52.574246] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-21T17:58:52.810436] [DEBUG] [LOCAL ] CLS: Primary data saved (53563 records). [2025-10-21T17:58:52.810572] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-21T17:58:52.810919] [INFO ] [MAIN ] Update Progress: 466/2366 symbols completed. CLS took 42.1s. Estimated remaining: 3h 59m 48s. Rate: 7.9 symbols/min [2025-10-21T17:58:52.951808] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-21T17:58:52.984835] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:58:53.028238] [DEBUG] [LOCAL ] CM: Loaded 48575 existing records from primary storage. [2025-10-21T17:58:53.028536] [INFO ] [MAIN ] CM: Loaded 48575 existing records. [2025-10-21T17:58:53.213880] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:58:53.228711] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-21T17:58:53.228845] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-21T17:58:53.235811] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T17:58:53.235861] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-21T17:58:53.243679] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-21T17:58:53.276071] [INFO ] [REMOTE ] CLVT: Full fetch complete (75388 records). [2025-10-21T17:58:53.315446] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-21T17:58:53.527316] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T17:58:53.757814] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-21T17:58:53.965527] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:58:54.080339] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-21T17:58:54.080423] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-21T17:58:54.081351] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-21T17:58:54.081414] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-21T17:58:54.082816] [DEBUG] [LOCAL ] CLVT: Trimmed 75388 records to 51913 (keeping 200 days of data) [2025-10-21T17:58:54.365264] [DEBUG] [LOCAL ] CLVT: Primary data saved (51913 records). [2025-10-21T17:58:54.365393] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-21T17:58:54.365470] [INFO ] [MAIN ] Update Progress: 467/2366 symbols completed. CLVT took 27.9s. Estimated remaining: 3h 59m 16s. Rate: 7.9 symbols/min [2025-10-21T17:58:54.542429] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:58:54.550998] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-21T17:58:54.586745] [DEBUG] [LOCAL ] CMA: Loaded 50177 existing records from primary storage. [2025-10-21T17:58:54.587120] [INFO ] [MAIN ] CMA: Loaded 50177 existing records. [2025-10-21T17:58:54.771280] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:58:54.771596] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-21T17:58:54.771690] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-21T17:58:54.772169] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-21T17:58:54.772231] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-21T17:58:55.006766] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-21T17:58:55.152749] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T17:58:55.248027] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:58:55.351052] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-21T17:58:56.125687] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T17:58:56.151004] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-21T17:58:56.951068] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-21T17:58:57.235125] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T17:58:57.742632] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T17:58:57.751375] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-21T17:58:58.551024] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-21T17:58:58.829627] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T17:58:59.351026] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-21T17:58:59.382479] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T17:58:59.586611] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T17:58:59.590195] [INFO ] [REMOTE ] CLW: Full fetch complete (33715 records). [2025-10-21T17:58:59.590273] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-21T17:58:59.963131] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-21T17:58:59.963204] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-21T17:58:59.963701] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-21T17:58:59.963761] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-21T17:58:59.964535] [DEBUG] [LOCAL ] CLW: Trimmed 33715 records to 21289 (keeping 200 days of data) [2025-10-21T17:59:00.084350] [DEBUG] [LOCAL ] CLW: Primary data saved (21289 records). [2025-10-21T17:59:00.084467] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-21T17:59:00.084547] [INFO ] [MAIN ] Update Progress: 468/2366 symbols completed. CLW took 31.5s. Estimated remaining: 3h 59m 1s. Rate: 7.9 symbols/min [2025-10-21T17:59:00.160068] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-21T17:59:00.256448] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:59:00.281185] [DEBUG] [LOCAL ] CMBT: Loaded 27012 existing records from primary storage. [2025-10-21T17:59:00.281433] [INFO ] [MAIN ] CMBT: Loaded 27012 existing records. [2025-10-21T17:59:00.455283] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:59:00.455479] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-21T17:59:00.455525] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-21T17:59:00.455733] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-21T17:59:00.455788] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-21T17:59:00.809414] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:59:00.951068] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-21T17:59:01.254788] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T17:59:01.691723] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-21T17:59:01.751032] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-21T17:59:02.020204] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T17:59:02.551037] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-21T17:59:02.724565] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T17:59:03.351021] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-21T17:59:04.151041] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-21T17:59:04.469326] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-21T17:59:04.951049] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-21T17:59:05.201855] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-21T17:59:05.504396] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-21T17:59:05.751035] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-21T17:59:06.551003] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-21T17:59:06.760573] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T17:59:07.351014] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-21T17:59:07.551926] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T17:59:08.150999] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-21T17:59:08.238632] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-21T17:59:08.246563] [INFO ] [REMOTE ] CLX: Full fetch complete (73768 records). [2025-10-21T17:59:08.246702] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-21T17:59:08.647950] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-21T17:59:08.648024] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-21T17:59:08.648822] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-21T17:59:08.648884] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-21T17:59:08.650194] [DEBUG] [LOCAL ] CLX: Trimmed 73768 records to 51811 (keeping 200 days of data) [2025-10-21T17:59:08.802990] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (3.05 seconds). [2025-10-21T17:59:08.967590] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-21T17:59:09.009712] [DEBUG] [LOCAL ] CLX: Primary data saved (51811 records). [2025-10-21T17:59:09.009820] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-21T17:59:09.010564] [INFO ] [MAIN ] Update Progress: 469/2366 symbols completed. CLX took 37.1s. Estimated remaining: 3h 58m 59s. Rate: 7.9 symbols/min [2025-10-21T17:59:09.175541] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:59:09.215904] [DEBUG] [LOCAL ] CMC: Loaded 45569 existing records from primary storage. [2025-10-21T17:59:09.216183] [INFO ] [MAIN ] CMC: Loaded 45569 existing records. [2025-10-21T17:59:09.391552] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:59:09.391744] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-21T17:59:09.391793] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-21T17:59:09.392531] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-21T17:59:09.392588] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-21T17:59:09.762504] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:59:09.753693] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-21T17:59:09.826445] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T17:59:10.091528] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-21T17:59:10.551031] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-21T17:59:11.335557] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T17:59:11.351032] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-21T17:59:12.151110] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-21T17:59:12.348262] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T17:59:12.393564] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T17:59:12.951041] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-21T17:59:13.698048] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T17:59:13.750980] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-21T17:59:14.355402] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T17:59:14.551045] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-21T17:59:15.150752] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T17:59:15.351006] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-21T17:59:16.151002] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-21T17:59:16.208768] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T17:59:16.951000] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-21T17:59:17.233876] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T17:59:17.751056] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-21T17:59:17.809760] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T17:59:17.929192] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T17:59:18.551059] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-21T17:59:19.260968] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T17:59:19.350996] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-21T17:59:20.151030] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-21T17:59:20.366358] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T17:59:20.951052] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-21T17:59:21.340610] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-21T17:59:21.751006] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-21T17:59:21.911276] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-21T17:59:22.115869] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T17:59:22.551072] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-21T17:59:23.351046] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-21T17:59:23.489081] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T17:59:24.151096] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-21T17:59:24.254919] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T17:59:24.951034] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-21T17:59:25.063183] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T17:59:25.751003] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-21T17:59:25.878301] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T17:59:25.885701] [INFO ] [REMOTE ] CM: Full fetch complete (69823 records). [2025-10-21T17:59:25.885812] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-21T17:59:26.290468] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-21T17:59:26.290606] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-21T17:59:26.291484] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-21T17:59:26.291574] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-21T17:59:26.292925] [DEBUG] [LOCAL ] CM: Trimmed 69823 records to 48468 (keeping 200 days of data) [2025-10-21T17:59:26.551692] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-21T17:59:26.606669] [DEBUG] [LOCAL ] CM: Primary data saved (48468 records). [2025-10-21T17:59:26.606784] [INFO ] [MAIN ] CM: Full history saved. [2025-10-21T17:59:26.607133] [INFO ] [MAIN ] Update Progress: 470/2366 symbols completed. CM took 33.8s. Estimated remaining: 3h 59m 32s. Rate: 7.9 symbols/min [2025-10-21T17:59:26.783282] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:59:26.790907] [DEBUG] [LOCAL ] CMCM: Loaded 4827 existing records from primary storage. [2025-10-21T17:59:26.791118] [INFO ] [MAIN ] CMCM: Loaded 4827 existing records. [2025-10-21T17:59:26.974426] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:59:26.974753] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-21T17:59:26.974806] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-21T17:59:26.974996] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-21T17:59:26.975078] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-21T17:59:27.149959] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-21T17:59:27.201095] [INFO ] [REMOTE ] CMA: Full fetch complete (73502 records). [2025-10-21T17:59:27.240675] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-21T17:59:27.488397] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:59:27.488753] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-21T17:59:27.727399] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T17:59:27.820901] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-21T17:59:27.820982] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-21T17:59:27.821862] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-21T17:59:27.821924] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-21T17:59:27.823193] [DEBUG] [LOCAL ] CMA: Trimmed 73502 records to 50177 (keeping 200 days of data) [2025-10-21T17:59:28.125277] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-21T17:59:28.128412] [DEBUG] [LOCAL ] CMA: Primary data saved (50177 records). [2025-10-21T17:59:28.128482] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-21T17:59:28.128551] [INFO ] [MAIN ] Update Progress: 471/2366 symbols completed. CMA took 33.8s. Estimated remaining: 3h 58m 60s. Rate: 7.9 symbols/min [2025-10-21T17:59:28.159243] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-21T17:59:28.303633] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:59:28.303852] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-21T17:59:28.303907] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-21T17:59:28.304025] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-21T17:59:28.304082] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-21T17:59:28.304149] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-21T17:59:28.304184] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-21T17:59:28.642633] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T17:59:28.714536] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:59:28.821167] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T17:59:28.951057] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-21T17:59:29.610528] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-21T17:59:29.751078] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-21T17:59:30.252513] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-21T17:59:30.551044] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-21T17:59:31.351041] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-10-21T17:59:31.567804] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:59:31.568137] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-10-21T17:59:31.568231] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:59:31.568304] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-21T17:59:31.568367] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:59:31.568450] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-21T17:59:31.568513] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-21T17:59:31.568549] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-21T17:59:31.568592] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-21T17:59:31.568635] [INFO ] [MAIN ] Update Progress: 472/2366 symbols completed. CMDB took 3.4s. Estimated remaining: 3h 58m 35s. Rate: 7.9 symbols/min [2025-10-21T17:59:31.739907] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:59:31.740099] [DEBUG] [LOCAL ] CMG: No existing data file found in primary storage. [2025-10-21T17:59:31.740135] [WARN ] [MAIN ] CMG: No existing data found, performing full refresh instead. [2025-10-21T17:59:31.740240] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-21T17:59:31.740280] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-21T17:59:31.740320] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-10-21T17:59:31.740350] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-21T17:59:32.100181] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:59:32.151012] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-21T17:59:32.361293] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T17:59:32.369105] [INFO ] [REMOTE ] CMBT: Full fetch complete (33583 records). [2025-10-21T17:59:32.369207] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-21T17:59:32.645482] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-21T17:59:32.754097] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-21T17:59:32.754177] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-21T17:59:32.754757] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-21T17:59:32.754818] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-21T17:59:32.755788] [DEBUG] [LOCAL ] CMBT: Trimmed 33583 records to 27244 (keeping 200 days of data) [2025-10-21T17:59:32.920610] [DEBUG] [LOCAL ] CMBT: Primary data saved (27244 records). [2025-10-21T17:59:32.920769] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-21T17:59:32.920878] [INFO ] [MAIN ] Update Progress: 473/2366 symbols completed. CMBT took 32.8s. Estimated remaining: 3h 58m 3s. Rate: 8.0 symbols/min [2025-10-21T17:59:32.952870] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-21T17:59:33.093869] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:59:33.094052] [DEBUG] [LOCAL ] CMI: No existing data file found in primary storage. [2025-10-21T17:59:33.094139] [WARN ] [MAIN ] CMI: No existing data found, performing full refresh instead. [2025-10-21T17:59:33.094222] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-21T17:59:33.094259] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-21T17:59:33.094299] [DEBUG] [LOCAL ] CMI: No primary data file found to delete. [2025-10-21T17:59:33.094330] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-21T17:59:33.450330] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:59:33.751027] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-21T17:59:34.283868] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-21T17:59:34.506884] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T17:59:34.550987] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-21T17:59:35.351021] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-21T17:59:36.007681] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-21T17:59:36.151042] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-21T17:59:36.601882] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-21T17:59:36.871253] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T17:59:36.951060] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-21T17:59:37.751049] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-21T17:59:37.829192] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T17:59:38.551052] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-21T17:59:39.351027] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-21T17:59:39.460854] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T17:59:39.468543] [INFO ] [REMOTE ] CMC: Full fetch complete (67283 records). [2025-10-21T17:59:39.468678] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-21T17:59:39.850476] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-21T17:59:39.850588] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-21T17:59:39.851551] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-21T17:59:39.851610] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-21T17:59:39.852925] [DEBUG] [LOCAL ] CMC: Trimmed 67283 records to 45567 (keeping 200 days of data) [2025-10-21T17:59:40.115803] [DEBUG] [LOCAL ] CMC: Primary data saved (45567 records). [2025-10-21T17:59:40.115929] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-21T17:59:40.116589] [INFO ] [MAIN ] Update Progress: 474/2366 symbols completed. CMC took 31.1s. Estimated remaining: 3h 57m 54s. Rate: 8.0 symbols/min [2025-10-21T17:59:40.159138] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-21T17:59:40.292167] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:59:40.326602] [DEBUG] [LOCAL ] CMP: Loaded 35799 existing records from primary storage. [2025-10-21T17:59:40.326901] [INFO ] [MAIN ] CMP: Loaded 35799 existing records. [2025-10-21T17:59:40.502266] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:59:40.502548] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-21T17:59:40.502608] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-21T17:59:40.503159] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-21T17:59:40.503219] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-21T17:59:40.893144] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:59:40.896578] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-21T17:59:40.945279] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T17:59:40.954406] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-21T17:59:41.122546] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-21T17:59:41.124082] [INFO ] [REMOTE ] CMCM: Full fetch complete (7050 records). [2025-10-21T17:59:41.124150] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-21T17:59:41.528687] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-21T17:59:41.528775] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-21T17:59:41.529017] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-21T17:59:41.529056] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-21T17:59:41.529497] [DEBUG] [LOCAL ] CMCM: Trimmed 7050 records to 4857 (keeping 200 days of data) [2025-10-21T17:59:41.557813] [DEBUG] [LOCAL ] CMCM: Primary data saved (4857 records). [2025-10-21T17:59:41.557938] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-21T17:59:41.558021] [INFO ] [MAIN ] Update Progress: 475/2366 symbols completed. CMCM took 15.0s. Estimated remaining: 3h 57m 22s. Rate: 8.0 symbols/min [2025-10-21T17:59:41.740748] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:59:41.751041] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-21T17:59:41.779825] [DEBUG] [LOCAL ] CMPO: Loaded 38711 existing records from primary storage. [2025-10-21T17:59:41.780138] [INFO ] [MAIN ] CMPO: Loaded 38711 existing records. [2025-10-21T17:59:41.964543] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:59:41.964792] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-21T17:59:41.964874] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-21T17:59:41.965559] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-21T17:59:41.965620] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-21T17:59:42.333239] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:59:42.551063] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-21T17:59:42.838058] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-21T17:59:42.877688] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-21T17:59:43.351033] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-21T17:59:44.151016] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-21T17:59:44.222937] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T17:59:44.731011] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T17:59:44.951051] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-21T17:59:45.751085] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-21T17:59:46.300807] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T17:59:46.367262] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-21T17:59:46.551020] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-21T17:59:47.351085] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-21T17:59:47.537378] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T17:59:47.590843] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T17:59:48.151102] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-21T17:59:48.848948] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T17:59:48.951046] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-21T17:59:49.751058] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-21T17:59:50.331111] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-21T17:59:50.504567] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T17:59:50.550980] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-21T17:59:51.166438] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T17:59:51.351100] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-21T17:59:51.878922] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T17:59:52.151052] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-21T17:59:52.815770] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T17:59:52.951033] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-21T17:59:53.703909] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T17:59:53.750995] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-21T17:59:53.993320] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T17:59:54.551032] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-21T17:59:55.075042] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T17:59:55.351026] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-21T17:59:55.892336] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T17:59:56.151024] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-21T17:59:56.951010] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-21T17:59:57.026067] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T17:59:57.523091] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-21T17:59:57.751083] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-21T17:59:58.500831] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T17:59:58.551004] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-21T17:59:58.804224] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-21T17:59:59.351023] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-21T18:00:00.089971] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T18:00:00.151027] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-21T18:00:00.868288] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T18:00:00.951024] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-21T18:00:01.751033] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-21T18:00:02.189165] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-21T18:00:02.551039] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-21T18:00:02.773231] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T18:00:03.351022] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-21T18:00:04.070231] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-21T18:00:04.151166] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-21T18:00:04.598233] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-21T18:00:04.608247] [INFO ] [REMOTE ] CMI: Full fetch complete (61124 records). [2025-10-21T18:00:04.608393] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-21T18:00:04.959559] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-21T18:00:05.015736] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-21T18:00:05.015852] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-21T18:00:05.016603] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-21T18:00:05.016682] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-21T18:00:05.017978] [DEBUG] [LOCAL ] CMI: Trimmed 61124 records to 41706 (keeping 200 days of data) [2025-10-21T18:00:05.285381] [DEBUG] [LOCAL ] CMI: Primary data saved (41706 records). [2025-10-21T18:00:05.285627] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-21T18:00:05.285768] [INFO ] [MAIN ] Update Progress: 476/2366 symbols completed. CMI took 32.4s. Estimated remaining: 3h 58m 19s. Rate: 7.9 symbols/min [2025-10-21T18:00:05.393089] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-21T18:00:05.432192] [INFO ] [REMOTE ] CMPO: Full fetch complete (58204 records). [2025-10-21T18:00:05.442579] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-21T18:00:05.577815] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:00:05.840034] [DEBUG] [LOCAL ] CMRE: Loaded 35844 existing records from primary storage. [2025-10-21T18:00:05.855785] [INFO ] [MAIN ] CMRE: Loaded 35844 existing records. [2025-10-21T18:00:06.009290] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-21T18:00:06.032835] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-21T18:00:06.039057] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-21T18:00:06.047037] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-21T18:00:06.123334] [DEBUG] [LOCAL ] CMPO: Trimmed 58204 records to 38539 (keeping 200 days of data) [2025-10-21T18:00:06.165808] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:00:06.167016] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-21T18:00:06.167251] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-21T18:00:06.168169] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-21T18:00:06.168231] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-21T18:00:06.662691] [DEBUG] [LOCAL ] CMPO: Primary data saved (38539 records). [2025-10-21T18:00:06.676014] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-21T18:00:06.730186] [INFO ] [MAIN ] Update Progress: 477/2366 symbols completed. CMPO took 25.2s. Estimated remaining: 3h 57m 47s. Rate: 7.9 symbols/min [2025-10-21T18:00:06.731056] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-21T18:00:06.768992] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-21T18:00:06.821746] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:00:06.822101] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-21T18:00:07.519812] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-10-21T18:00:07.530369] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-21T18:00:08.354217] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T18:00:08.360595] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-21T18:00:08.460957] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T18:00:08.951098] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-21T18:00:09.709484] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T18:00:09.750986] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-21T18:00:10.389259] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T18:00:10.503974] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-10-21T18:00:10.550984] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-21T18:00:10.727557] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-21T18:00:11.351082] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-21T18:00:12.151075] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-21T18:00:13.211360] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T18:00:13.219875] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-21T18:00:13.641855] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (3.09 seconds). [2025-10-21T18:00:13.751054] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-21T18:00:15.000752] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (2.85 seconds). [2025-10-21T18:00:15.007508] [INFO ] [REMOTE ] CMP: Full fetch complete (51636 records). [2025-10-21T18:00:15.007994] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-21T18:00:15.164367] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T18:00:15.253568] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-21T18:00:15.460786] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-21T18:00:15.460887] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-21T18:00:15.461590] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-21T18:00:15.461634] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-21T18:00:15.462822] [DEBUG] [LOCAL ] CMP: Trimmed 51636 records to 35783 (keeping 200 days of data) [2025-10-21T18:00:15.671360] [DEBUG] [LOCAL ] CMP: Primary data saved (35783 records). [2025-10-21T18:00:15.671485] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-21T18:00:15.672145] [INFO ] [MAIN ] Update Progress: 478/2366 symbols completed. CMP took 35.6s. Estimated remaining: 3h 57m 45s. Rate: 7.9 symbols/min [2025-10-21T18:00:16.958860] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T18:00:16.968390] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-21T18:00:17.083803] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (3.33 seconds). [2025-10-21T18:00:17.095190] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-21T18:00:18.766129] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T18:00:18.774076] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-21T18:00:20.137198] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T18:00:20.145919] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-21T18:00:20.391883] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (3.30 seconds). [2025-10-21T18:00:20.399949] [INFO ] [REMOTE ] CMG: Full fetch complete (77503 records). [2025-10-21T18:00:20.400123] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-21T18:00:20.401050] [FATAL] [VALIDATOR ] CMG: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:00:20.401141] [FATAL] [MAIN ] CMG: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:00:20.401187] [WARN ] [MAIN ] CMG: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:00:20.401240] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-21T18:00:20.401343] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-10-21T18:00:20.401403] [INFO ] [LOCAL ] CMG: Starting deletion of derivative data. [2025-10-21T18:00:20.401491] [DEBUG] [LOCAL ] CMG: No derivative data file found to delete. [2025-10-21T18:00:20.401602] [INFO ] [MAIN ] Update Progress: 479/2366 symbols completed. CMG took 48.8s. Estimated remaining: 3h 57m 26s. Rate: 7.9 symbols/min [2025-10-21T18:00:21.572065] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T18:00:21.579443] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-21T18:00:24.411998] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (2.83 seconds). [2025-10-21T18:00:24.417895] [INFO ] [REMOTE ] CMRE: Full fetch complete (51030 records). [2025-10-21T18:00:24.418038] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-21T18:00:24.418922] [FATAL] [VALIDATOR ] CMRE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:00:24.419040] [FATAL] [MAIN ] CMRE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:00:24.419115] [WARN ] [MAIN ] CMRE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:00:24.419204] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-21T18:00:24.419283] [DEBUG] [LOCAL ] CMRE: No primary data file found to delete. [2025-10-21T18:00:24.419322] [INFO ] [LOCAL ] CMRE: Starting deletion of derivative data. [2025-10-21T18:00:24.419474] [DEBUG] [LOCAL ] CMRE: Deleted derivative data file. [2025-10-21T18:00:24.419567] [INFO ] [MAIN ] Update Progress: 480/2366 symbols completed. CMRE took 19.1s. Estimated remaining: 3h 57m 5s. Rate: 8.0 symbols/min [2025-10-21T18:00:25.038791] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:00:25.081667] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:00:25.093275] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:00:25.153332] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:00:25.160034] [DEBUG] [LOCAL ] CMSA: Loaded 3515 existing records from primary storage. [2025-10-21T18:00:25.161305] [INFO ] [MAIN ] CMSA: Loaded 3515 existing records. [2025-10-21T18:00:25.179458] [DEBUG] [LOCAL ] CMSC: Loaded 4847 existing records from primary storage. [2025-10-21T18:00:25.200060] [INFO ] [MAIN ] CMSC: Loaded 4847 existing records. [2025-10-21T18:00:25.259738] [DEBUG] [LOCAL ] CMSD: Loaded 7682 existing records from primary storage. [2025-10-21T18:00:25.294597] [INFO ] [MAIN ] CMSD: Loaded 7682 existing records. [2025-10-21T18:00:25.614726] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:00:25.689146] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-21T18:00:25.708210] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-21T18:00:25.772178] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-21T18:00:25.759125] [DEBUG] [LOCAL ] CMS: Loaded 52585 existing records from primary storage. [2025-10-21T18:00:25.772095] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:00:25.773093] [INFO ] [MAIN ] CMS: Loaded 52585 existing records. [2025-10-21T18:00:25.778911] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-21T18:00:25.778987] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-21T18:00:25.772303] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-21T18:00:25.802692] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-21T18:00:25.838219] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:00:25.862000] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-21T18:00:25.999264] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-21T18:00:26.013422] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-21T18:00:26.089309] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-21T18:00:26.162291] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-21T18:00:26.214504] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:00:26.255681] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-21T18:00:26.346911] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-21T18:00:26.530894] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-21T18:00:26.582347] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-21T18:00:27.117542] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:00:27.169967] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-21T18:00:27.226473] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:00:27.250630] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-21T18:00:27.417039] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:00:27.433358] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-21T18:00:27.536359] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:00:27.536693] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-21T18:00:28.287120] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-21T18:00:28.288885] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-21T18:00:28.346091] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T18:00:28.347557] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-21T18:00:28.437820] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T18:00:28.440519] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-21T18:00:28.933370] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-21T18:00:28.935233] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-21T18:00:28.976720] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-21T18:00:28.977920] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-21T18:00:29.088348] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-21T18:00:29.090038] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-21T18:00:29.473421] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-21T18:00:29.474794] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-21T18:00:29.560164] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-21T18:00:29.563192] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-21T18:00:29.573045] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-21T18:00:29.575396] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-21T18:00:29.742371] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-21T18:00:29.752468] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-21T18:00:30.072538] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-21T18:00:30.139025] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-21T18:00:30.323387] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-21T18:00:30.551087] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-21T18:00:31.258487] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T18:00:31.277847] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T18:00:31.351025] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-21T18:00:31.914133] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-21T18:00:32.151008] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-21T18:00:32.869609] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T18:00:32.951022] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-21T18:00:33.367311] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-21T18:00:33.751022] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-21T18:00:34.457560] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-21T18:00:34.551002] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-21T18:00:34.927317] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-21T18:00:35.351028] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-21T18:00:35.825864] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-21T18:00:36.151028] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-21T18:00:36.791815] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-21T18:00:36.951068] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-21T18:00:37.601914] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-21T18:00:37.751117] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-21T18:00:38.546304] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T18:00:38.551716] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-21T18:00:39.351061] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-21T18:00:40.051767] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-21T18:00:40.151042] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-21T18:00:40.546258] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T18:00:40.572032] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-21T18:00:40.951022] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-21T18:00:41.751027] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-21T18:00:42.384509] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-21T18:00:42.386064] [INFO ] [REMOTE ] CMSD: Full fetch complete (11490 records). [2025-10-21T18:00:42.386148] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-21T18:00:42.558288] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-21T18:00:42.799721] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-21T18:00:42.843210] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-21T18:00:42.843423] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-21T18:00:42.844020] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-21T18:00:42.844129] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-21T18:00:42.845091] [DEBUG] [LOCAL ] CMSD: Trimmed 11490 records to 7668 (keeping 200 days of data) [2025-10-21T18:00:42.900488] [DEBUG] [LOCAL ] CMSD: Primary data saved (7668 records). [2025-10-21T18:00:42.900678] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-21T18:00:42.900796] [INFO ] [MAIN ] Update Progress: 481/2366 symbols completed. CMSD took 18.5s. Estimated remaining: 3h 57m 40s. Rate: 7.9 symbols/min [2025-10-21T18:00:43.074905] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:00:43.075101] [DEBUG] [LOCAL ] CMTG: No existing data file found in primary storage. [2025-10-21T18:00:43.075139] [WARN ] [MAIN ] CMTG: No existing data found, performing full refresh instead. [2025-10-21T18:00:43.075250] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-21T18:00:43.075314] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-21T18:00:43.075354] [DEBUG] [LOCAL ] CMTG: No primary data file found to delete. [2025-10-21T18:00:43.075385] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-21T18:00:43.356051] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-21T18:00:43.358038] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T18:00:43.440752] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:00:44.151043] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-21T18:00:44.852432] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-21T18:00:44.951125] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-21T18:00:45.181528] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T18:00:45.604470] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-21T18:00:45.751055] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-21T18:00:46.456322] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T18:00:46.457492] [INFO ] [REMOTE ] CMSC: Full fetch complete (6954 records). [2025-10-21T18:00:46.457558] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-21T18:00:46.556192] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-21T18:00:46.809868] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-21T18:00:46.809939] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-21T18:00:46.810100] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-21T18:00:46.810137] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-21T18:00:46.810520] [DEBUG] [LOCAL ] CMSC: Trimmed 6954 records to 4835 (keeping 200 days of data) [2025-10-21T18:00:46.838601] [DEBUG] [LOCAL ] CMSC: Primary data saved (4835 records). [2025-10-21T18:00:46.838694] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-21T18:00:46.838774] [INFO ] [MAIN ] Update Progress: 482/2366 symbols completed. CMSC took 22.4s. Estimated remaining: 3h 57m 19s. Rate: 7.9 symbols/min [2025-10-21T18:00:47.013904] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:00:47.022361] [DEBUG] [LOCAL ] CMU: Loaded 6357 existing records from primary storage. [2025-10-21T18:00:47.022531] [INFO ] [MAIN ] CMU: Loaded 6357 existing records. [2025-10-21T18:00:47.207147] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:00:47.207382] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-21T18:00:47.207429] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-21T18:00:47.207606] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-21T18:00:47.207701] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-21T18:00:47.356194] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-21T18:00:47.578279] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:00:48.151088] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-21T18:00:48.210204] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T18:00:48.739068] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-21T18:00:48.740560] [INFO ] [REMOTE ] CMSA: Full fetch complete (4846 records). [2025-10-21T18:00:48.740665] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-21T18:00:48.956187] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-21T18:00:49.131933] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T18:00:49.144932] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-21T18:00:49.145539] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-21T18:00:49.145899] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-21T18:00:49.145961] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-21T18:00:49.146356] [DEBUG] [LOCAL ] CMSA: Trimmed 4846 records to 3497 (keeping 200 days of data) [2025-10-21T18:00:49.170491] [DEBUG] [LOCAL ] CMSA: Primary data saved (3497 records). [2025-10-21T18:00:49.170617] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-21T18:00:49.170729] [INFO ] [MAIN ] Update Progress: 483/2366 symbols completed. CMSA took 24.7s. Estimated remaining: 3h 56m 51s. Rate: 8.0 symbols/min [2025-10-21T18:00:49.336999] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:00:49.369056] [DEBUG] [LOCAL ] CNA: Loaded 32763 existing records from primary storage. [2025-10-21T18:00:49.369313] [INFO ] [MAIN ] CNA: Loaded 32763 existing records. [2025-10-21T18:00:49.550479] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:00:49.550762] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-21T18:00:49.550825] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-21T18:00:49.551071] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-21T18:00:49.551142] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-21T18:00:49.723958] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-21T18:00:49.757482] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-21T18:00:49.932734] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:00:50.551011] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-21T18:00:51.351055] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-21T18:00:51.711296] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-21T18:00:51.882756] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-21T18:00:51.884239] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-21T18:00:52.151027] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-21T18:00:52.950998] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-21T18:00:53.502974] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-21T18:00:53.762971] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-21T18:00:53.768412] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-21T18:00:54.527552] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-21T18:00:54.550973] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-21T18:00:55.115080] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-21T18:00:55.351046] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-21T18:00:56.151036] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-21T18:00:56.763811] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T18:00:56.951037] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-21T18:00:57.751012] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-21T18:00:57.937674] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T18:00:58.354455] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T18:00:58.551056] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-21T18:00:58.896014] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-21T18:00:59.265154] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-21T18:00:59.351032] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-21T18:01:00.151033] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-21T18:01:00.950995] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-21T18:01:01.114601] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-21T18:01:01.196016] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T18:01:01.751081] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-21T18:01:02.551017] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-21T18:01:03.256255] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-21T18:01:03.351007] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-21T18:01:03.470536] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-21T18:01:03.478234] [INFO ] [REMOTE ] CMS: Full fetch complete (75877 records). [2025-10-21T18:01:03.478395] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-21T18:01:03.479202] [FATAL] [VALIDATOR ] CMS: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:01:03.479321] [FATAL] [MAIN ] CMS: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:01:03.479397] [WARN ] [MAIN ] CMS: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:01:03.479496] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-21T18:01:03.479576] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-10-21T18:01:03.479614] [INFO ] [LOCAL ] CMS: Starting deletion of derivative data. [2025-10-21T18:01:03.479926] [DEBUG] [LOCAL ] CMS: Deleted derivative data file. [2025-10-21T18:01:03.480024] [INFO ] [MAIN ] Update Progress: 484/2366 symbols completed. CMS took 39.1s. Estimated remaining: 3h 57m 9s. Rate: 7.9 symbols/min [2025-10-21T18:01:03.655115] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:01:03.704222] [DEBUG] [LOCAL ] CNC: Loaded 53778 existing records from primary storage. [2025-10-21T18:01:03.704539] [INFO ] [MAIN ] CNC: Loaded 53778 existing records. [2025-10-21T18:01:03.901519] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-21T18:01:03.915244] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:01:03.923554] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-21T18:01:03.924023] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-21T18:01:03.924512] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-21T18:01:03.924566] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-21T18:01:04.156636] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-21T18:01:04.286107] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:01:04.811091] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-21T18:01:04.950981] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-21T18:01:05.751028] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-21T18:01:05.810790] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T18:01:06.356156] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T18:01:06.551016] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-21T18:01:07.133342] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T18:01:07.351003] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-21T18:01:07.468468] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T18:01:08.151027] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-21T18:01:08.850009] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T18:01:08.951024] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-21T18:01:09.751033] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-21T18:01:09.876592] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T18:01:10.551013] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-21T18:01:10.665303] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T18:01:11.322558] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T18:01:11.351023] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-21T18:01:12.151052] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-21T18:01:12.305692] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-21T18:01:12.855923] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-21T18:01:12.857103] [INFO ] [REMOTE ] CMU: Full fetch complete (9444 records). [2025-10-21T18:01:12.857173] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-21T18:01:12.857528] [FATAL] [VALIDATOR ] CMU: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:01:12.857611] [FATAL] [MAIN ] CMU: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:01:12.857692] [WARN ] [MAIN ] CMU: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:01:12.857778] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-21T18:01:12.857854] [DEBUG] [LOCAL ] CMU: No primary data file found to delete. [2025-10-21T18:01:12.857905] [INFO ] [LOCAL ] CMU: Starting deletion of derivative data. [2025-10-21T18:01:12.858104] [DEBUG] [LOCAL ] CMU: Deleted derivative data file. [2025-10-21T18:01:12.858212] [INFO ] [MAIN ] Update Progress: 485/2366 symbols completed. CMU took 26.0s. Estimated remaining: 3h 57m 9s. Rate: 7.9 symbols/min [2025-10-21T18:01:12.960246] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-21T18:01:13.058982] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:01:13.059575] [DEBUG] [LOCAL ] CNF: No existing data file found in primary storage. [2025-10-21T18:01:13.060891] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T18:01:13.059685] [WARN ] [MAIN ] CNF: No existing data found, performing full refresh instead. [2025-10-21T18:01:13.069527] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-21T18:01:13.069730] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-21T18:01:13.069797] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-10-21T18:01:13.070100] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-21T18:01:13.444114] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:01:13.751024] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-21T18:01:14.551021] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-21T18:01:14.902211] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T18:01:15.009370] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-21T18:01:15.351056] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-21T18:01:15.621882] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T18:01:16.151042] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-21T18:01:16.951011] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-21T18:01:17.360072] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-21T18:01:17.400475] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-21T18:01:17.632488] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-21T18:01:17.751040] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-21T18:01:18.271958] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-21T18:01:18.551041] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-21T18:01:19.351034] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-21T18:01:19.359161] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T18:01:20.150990] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-21T18:01:20.764594] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-21T18:01:20.769407] [INFO ] [REMOTE ] CMTG: Full fetch complete (53028 records). [2025-10-21T18:01:20.769503] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-21T18:01:20.957527] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-21T18:01:21.151079] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-21T18:01:21.151156] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-21T18:01:21.151816] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-21T18:01:21.151877] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-21T18:01:21.152908] [DEBUG] [LOCAL ] CMTG: Trimmed 53028 records to 35328 (keeping 200 days of data) [2025-10-21T18:01:21.351093] [DEBUG] [LOCAL ] CMTG: Primary data saved (35328 records). [2025-10-21T18:01:21.351220] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-21T18:01:21.351288] [INFO ] [MAIN ] Update Progress: 486/2366 symbols completed. CMTG took 38.5s. Estimated remaining: 3h 57m 5s. Rate: 7.9 symbols/min [2025-10-21T18:01:21.554254] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:01:21.550086] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T18:01:21.618346] [DEBUG] [LOCAL ] CNH: Loaded 53548 existing records from primary storage. [2025-10-21T18:01:21.618761] [INFO ] [MAIN ] CNH: Loaded 53548 existing records. [2025-10-21T18:01:21.756124] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-21T18:01:21.827972] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:01:21.828261] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-21T18:01:21.828317] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-21T18:01:21.828745] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-21T18:01:21.828805] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-21T18:01:22.238086] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:01:22.416916] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-21T18:01:22.550982] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-21T18:01:22.886714] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T18:01:23.351047] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-21T18:01:23.399963] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-21T18:01:24.151029] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-21T18:01:24.951018] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-21T18:01:25.751001] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-21T18:01:25.866141] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-21T18:01:26.551052] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-21T18:01:26.679458] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T18:01:26.684710] [INFO ] [REMOTE ] CNA: Full fetch complete (46126 records). [2025-10-21T18:01:26.684856] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-21T18:01:26.849532] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-21T18:01:27.089788] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-21T18:01:27.089936] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-21T18:01:27.090866] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-21T18:01:27.091044] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-21T18:01:27.124265] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-10-21T18:01:27.124424] [DEBUG] [LOCAL ] CNA: Trimmed 46126 records to 32604 (keeping 200 days of data) [2025-10-21T18:01:27.351601] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-21T18:01:27.354622] [DEBUG] [LOCAL ] CNA: Primary data saved (32604 records). [2025-10-21T18:01:27.354745] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-21T18:01:27.356344] [INFO ] [MAIN ] Update Progress: 487/2366 symbols completed. CNA took 38.2s. Estimated remaining: 3h 56m 51s. Rate: 7.9 symbols/min [2025-10-21T18:01:27.523931] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:01:27.577691] [DEBUG] [LOCAL ] CNI: Loaded 51678 existing records from primary storage. [2025-10-21T18:01:27.577992] [INFO ] [MAIN ] CNI: Loaded 51678 existing records. [2025-10-21T18:01:27.751680] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:01:27.751899] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-21T18:01:27.751949] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-21T18:01:27.752503] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-21T18:01:27.752560] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-21T18:01:28.119380] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:01:28.151523] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-21T18:01:28.159002] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-21T18:01:28.951107] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-21T18:01:29.751053] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-21T18:01:30.070830] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-21T18:01:30.147985] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-10-21T18:01:30.550993] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-21T18:01:30.623892] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-21T18:01:30.851186] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T18:01:31.351031] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-21T18:01:32.151035] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-21T18:01:32.770636] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-21T18:01:32.950990] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-21T18:01:33.003143] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T18:01:33.244940] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T18:01:33.526240] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-21T18:01:33.534521] [INFO ] [REMOTE ] CNC: Full fetch complete (77856 records). [2025-10-21T18:01:33.534636] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-21T18:01:33.756136] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-21T18:01:33.936294] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-21T18:01:33.936389] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-21T18:01:33.937292] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-21T18:01:33.937358] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-21T18:01:33.938914] [DEBUG] [LOCAL ] CNC: Trimmed 77856 records to 53779 (keeping 200 days of data) [2025-10-21T18:01:34.245227] [DEBUG] [LOCAL ] CNC: Primary data saved (53779 records). [2025-10-21T18:01:34.245363] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-21T18:01:34.245738] [INFO ] [MAIN ] Update Progress: 488/2366 symbols completed. CNC took 30.8s. Estimated remaining: 3h 56m 41s. Rate: 7.9 symbols/min [2025-10-21T18:01:34.410857] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:01:34.460346] [DEBUG] [LOCAL ] CNK: Loaded 52920 existing records from primary storage. [2025-10-21T18:01:34.460685] [INFO ] [MAIN ] CNK: Loaded 52920 existing records. [2025-10-21T18:01:34.556169] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-21T18:01:34.637198] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:01:34.637401] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-21T18:01:34.637474] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-21T18:01:34.638367] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-21T18:01:34.638426] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-21T18:01:34.988611] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:01:35.350997] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-21T18:01:35.481376] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T18:01:35.674675] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-21T18:01:36.151040] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-21T18:01:36.951005] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-21T18:01:36.992958] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-21T18:01:36.994543] [INFO ] [REMOTE ] CNF: Full fetch complete (13026 records). [2025-10-21T18:01:36.994636] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-21T18:01:37.404686] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-21T18:01:37.404936] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-21T18:01:37.405579] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-21T18:01:37.416148] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-21T18:01:37.440236] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-21T18:01:37.440707] [DEBUG] [LOCAL ] CNF: Trimmed 13026 records to 10592 (keeping 200 days of data) [2025-10-21T18:01:37.517487] [DEBUG] [LOCAL ] CNF: Primary data saved (10592 records). [2025-10-21T18:01:37.517664] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-21T18:01:37.517760] [INFO ] [MAIN ] Update Progress: 489/2366 symbols completed. CNF took 24.7s. Estimated remaining: 3h 56m 17s. Rate: 7.9 symbols/min [2025-10-21T18:01:37.720826] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:01:37.758724] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-21T18:01:37.794696] [DEBUG] [LOCAL ] CNM: Loaded 51031 existing records from primary storage. [2025-10-21T18:01:37.795178] [INFO ] [MAIN ] CNM: Loaded 51031 existing records. [2025-10-21T18:01:38.078494] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:01:38.078784] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-21T18:01:38.078845] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-21T18:01:38.079107] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-21T18:01:38.079156] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-21T18:01:38.559902] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-21T18:01:38.566994] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:01:38.630281] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T18:01:39.351044] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-21T18:01:39.400962] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T18:01:40.151031] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-21T18:01:40.321787] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T18:01:40.951089] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-21T18:01:41.175540] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T18:01:41.751075] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-21T18:01:41.983089] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T18:01:42.308143] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-21T18:01:42.551091] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-21T18:01:43.351065] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-21T18:01:43.498333] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-21T18:01:44.151040] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-21T18:01:44.213343] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T18:01:44.951069] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-21T18:01:45.078393] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T18:01:45.756160] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-21T18:01:45.773532] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T18:01:46.551072] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-21T18:01:46.612100] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T18:01:47.350990] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-21T18:01:47.571167] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-21T18:01:48.156119] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-21T18:01:48.183075] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T18:01:48.951032] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-21T18:01:49.161015] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T18:01:49.751084] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-21T18:01:49.974106] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T18:01:50.551067] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-21T18:01:50.581145] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T18:01:51.351062] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-21T18:01:51.418623] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T18:01:52.151039] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-21T18:01:52.232371] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T18:01:52.951051] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-21T18:01:53.332552] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T18:01:53.616531] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T18:01:53.751053] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-21T18:01:54.551047] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-21T18:01:54.686661] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T18:01:55.353955] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-21T18:01:55.357043] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T18:01:56.003205] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T18:01:56.151025] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-21T18:01:56.951067] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-21T18:01:57.006722] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T18:01:57.500683] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T18:01:57.751042] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-21T18:01:58.551048] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-21T18:01:58.936790] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T18:01:58.944801] [INFO ] [REMOTE ] CNI: Full fetch complete (74834 records). [2025-10-21T18:01:58.944959] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-21T18:01:59.351822] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-21T18:01:59.352090] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-21T18:01:59.351959] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-21T18:01:59.353444] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-21T18:01:59.354713] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-21T18:01:59.356383] [DEBUG] [LOCAL ] CNI: Trimmed 74834 records to 51658 (keeping 200 days of data) [2025-10-21T18:01:59.618593] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T18:01:59.727572] [DEBUG] [LOCAL ] CNI: Primary data saved (51658 records). [2025-10-21T18:01:59.727743] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-21T18:01:59.728537] [INFO ] [MAIN ] Update Progress: 490/2366 symbols completed. CNI took 32.4s. Estimated remaining: 3h 57m 6s. Rate: 7.9 symbols/min [2025-10-21T18:01:59.895070] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:01:59.895228] [DEBUG] [LOCAL ] CNMD: No existing data file found in primary storage. [2025-10-21T18:01:59.895285] [WARN ] [MAIN ] CNMD: No existing data found, performing full refresh instead. [2025-10-21T18:01:59.895392] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-21T18:01:59.895433] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-21T18:01:59.895472] [DEBUG] [LOCAL ] CNMD: No primary data file found to delete. [2025-10-21T18:01:59.895502] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-21T18:02:00.152072] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-21T18:02:00.262217] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:02:00.321974] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-21T18:02:00.330708] [INFO ] [REMOTE ] CNH: Full fetch complete (77704 records). [2025-10-21T18:02:00.330869] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-21T18:02:00.781946] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-21T18:02:00.782051] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-21T18:02:00.782927] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-21T18:02:00.782989] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-21T18:02:00.784506] [DEBUG] [LOCAL ] CNH: Trimmed 77704 records to 53547 (keeping 200 days of data) [2025-10-21T18:02:00.954994] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-21T18:02:01.107335] [DEBUG] [LOCAL ] CNH: Primary data saved (53547 records). [2025-10-21T18:02:01.107476] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-21T18:02:01.108318] [INFO ] [MAIN ] Update Progress: 491/2366 symbols completed. CNH took 39.8s. Estimated remaining: 3h 56m 34s. Rate: 7.9 symbols/min [2025-10-21T18:02:01.279117] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:02:01.279360] [DEBUG] [LOCAL ] CNNE: No existing data file found in primary storage. [2025-10-21T18:02:01.279459] [WARN ] [MAIN ] CNNE: No existing data found, performing full refresh instead. [2025-10-21T18:02:01.279571] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-21T18:02:01.279720] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-21T18:02:01.279832] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-10-21T18:02:01.279904] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-21T18:02:01.627420] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-21T18:02:01.754146] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-21T18:02:01.758428] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:02:01.815036] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T18:02:02.526059] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T18:02:02.550977] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-21T18:02:03.351015] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-21T18:02:03.624072] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T18:02:03.632335] [INFO ] [REMOTE ] CNK: Full fetch complete (76221 records). [2025-10-21T18:02:03.632469] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-21T18:02:04.045888] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-21T18:02:04.045991] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-21T18:02:04.046959] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-21T18:02:04.047042] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-21T18:02:04.078667] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-21T18:02:04.077139] [DEBUG] [LOCAL ] CNK: Trimmed 76221 records to 52908 (keeping 200 days of data) [2025-10-21T18:02:04.176563] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-21T18:02:04.403722] [DEBUG] [LOCAL ] CNK: Primary data saved (52908 records). [2025-10-21T18:02:04.403884] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-21T18:02:04.404192] [INFO ] [MAIN ] Update Progress: 492/2366 symbols completed. CNK took 30.2s. Estimated remaining: 3h 56m 11s. Rate: 7.9 symbols/min [2025-10-21T18:02:04.573723] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:02:04.611745] [DEBUG] [LOCAL ] CNO: Loaded 40510 existing records from primary storage. [2025-10-21T18:02:04.612006] [INFO ] [MAIN ] CNO: Loaded 40510 existing records. [2025-10-21T18:02:04.801926] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T18:02:04.806830] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:02:04.806982] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-21T18:02:04.812630] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-21T18:02:04.813070] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-21T18:02:04.813126] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-21T18:02:04.956235] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-21T18:02:05.167914] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:02:05.750993] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-21T18:02:05.982272] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T18:02:06.551038] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-21T18:02:07.014255] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-21T18:02:07.088930] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T18:02:07.351071] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-21T18:02:07.792985] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-21T18:02:08.151028] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-21T18:02:08.678902] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-21T18:02:08.951078] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-21T18:02:09.469131] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-21T18:02:09.751022] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-21T18:02:10.313607] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-21T18:02:10.551019] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-21T18:02:11.350999] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-21T18:02:11.500402] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T18:02:11.511817] [INFO ] [REMOTE ] CNM: Full fetch complete (73769 records). [2025-10-21T18:02:11.511995] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-21T18:02:11.937607] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-21T18:02:11.937996] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-21T18:02:11.939351] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-21T18:02:11.940051] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T18:02:11.946442] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-21T18:02:11.948094] [DEBUG] [LOCAL ] CNM: Trimmed 73769 records to 51017 (keeping 200 days of data) [2025-10-21T18:02:12.151796] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-21T18:02:12.240272] [DEBUG] [LOCAL ] CNM: Primary data saved (51017 records). [2025-10-21T18:02:12.240419] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-21T18:02:12.240511] [INFO ] [MAIN ] Update Progress: 493/2366 symbols completed. CNM took 34.7s. Estimated remaining: 3h 56m 4s. Rate: 7.9 symbols/min [2025-10-21T18:02:12.411387] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:02:12.411519] [DEBUG] [LOCAL ] CNP: No existing data file found in primary storage. [2025-10-21T18:02:12.411555] [WARN ] [MAIN ] CNP: No existing data found, performing full refresh instead. [2025-10-21T18:02:12.411682] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-21T18:02:12.411735] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-21T18:02:12.411776] [DEBUG] [LOCAL ] CNP: No primary data file found to delete. [2025-10-21T18:02:12.411806] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-21T18:02:12.763637] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:02:12.950982] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-21T18:02:13.020307] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T18:02:13.751075] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-21T18:02:13.786941] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T18:02:14.551003] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-21T18:02:14.599157] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T18:02:15.269860] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T18:02:15.351013] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-21T18:02:16.151017] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-21T18:02:16.449207] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T18:02:16.951075] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-21T18:02:17.248490] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-21T18:02:17.567330] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T18:02:17.751070] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-21T18:02:18.155702] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-21T18:02:18.551073] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-21T18:02:19.351005] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-21T18:02:19.662633] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T18:02:20.151024] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-21T18:02:20.250328] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T18:02:20.700575] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T18:02:20.951074] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-21T18:02:21.470995] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-21T18:02:21.751012] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-21T18:02:22.550995] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-21T18:02:22.845587] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T18:02:23.176697] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T18:02:23.181424] [INFO ] [REMOTE ] CNMD: Full fetch complete (47316 records). [2025-10-21T18:02:23.181509] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-21T18:02:23.354423] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-21T18:02:23.557747] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-21T18:02:23.557866] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-21T18:02:23.558499] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-21T18:02:23.558559] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-21T18:02:23.559606] [DEBUG] [LOCAL ] CNMD: Trimmed 47316 records to 32081 (keeping 200 days of data) [2025-10-21T18:02:23.749419] [DEBUG] [LOCAL ] CNMD: Primary data saved (32081 records). [2025-10-21T18:02:23.749536] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-21T18:02:23.749603] [INFO ] [MAIN ] Update Progress: 494/2366 symbols completed. CNMD took 24.0s. Estimated remaining: 3h 56m 11s. Rate: 7.9 symbols/min [2025-10-21T18:02:23.919359] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:02:23.967378] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T18:02:23.991803] [DEBUG] [LOCAL ] CNQ: Loaded 53583 existing records from primary storage. [2025-10-21T18:02:23.992105] [INFO ] [MAIN ] CNQ: Loaded 53583 existing records. [2025-10-21T18:02:24.160125] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-21T18:02:24.164586] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:02:24.165411] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-21T18:02:24.165461] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-21T18:02:24.166134] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-21T18:02:24.166190] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-21T18:02:24.519991] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:02:24.951059] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-21T18:02:25.428741] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-21T18:02:25.613596] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T18:02:25.751030] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-21T18:02:26.551081] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-21T18:02:27.337563] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-21T18:02:27.350984] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-21T18:02:27.856201] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-21T18:02:28.151073] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-21T18:02:28.951088] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-21T18:02:29.320838] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-21T18:02:29.391088] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-21T18:02:29.656240] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-21T18:02:29.751048] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-21T18:02:30.556259] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-21T18:02:30.590626] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T18:02:31.351101] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-21T18:02:31.450782] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T18:02:32.003822] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T18:02:32.151050] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-21T18:02:32.951061] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-21T18:02:33.117245] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T18:02:33.543056] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T18:02:33.751130] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-21T18:02:34.551024] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-21T18:02:34.818813] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T18:02:35.351043] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-21T18:02:35.655488] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-21T18:02:36.120449] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T18:02:36.151025] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-21T18:02:36.951031] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-21T18:02:37.055917] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T18:02:37.481144] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T18:02:37.486802] [INFO ] [REMOTE ] CNNE: Full fetch complete (50552 records). [2025-10-21T18:02:37.486899] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-21T18:02:37.756274] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-21T18:02:37.861247] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-21T18:02:37.861332] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-21T18:02:37.862000] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-21T18:02:37.862060] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-21T18:02:37.863050] [DEBUG] [LOCAL ] CNNE: Trimmed 50552 records to 35869 (keeping 200 days of data) [2025-10-21T18:02:38.073584] [DEBUG] [LOCAL ] CNNE: Primary data saved (35869 records). [2025-10-21T18:02:38.073742] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-21T18:02:38.073821] [INFO ] [MAIN ] Update Progress: 495/2366 symbols completed. CNNE took 37.0s. Estimated remaining: 3h 56m 29s. Rate: 7.9 symbols/min [2025-10-21T18:02:38.265345] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:02:38.265534] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-21T18:02:38.265573] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-21T18:02:38.265716] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-21T18:02:38.265765] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-21T18:02:38.265807] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-21T18:02:38.265840] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-21T18:02:38.553625] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-21T18:02:38.623442] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:02:38.645924] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T18:02:38.653120] [INFO ] [REMOTE ] CNO: Full fetch complete (60824 records). [2025-10-21T18:02:38.653241] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-21T18:02:39.041966] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-21T18:02:39.042067] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-21T18:02:39.042879] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-21T18:02:39.042966] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-21T18:02:39.044263] [DEBUG] [LOCAL ] CNO: Trimmed 60824 records to 40420 (keeping 200 days of data) [2025-10-21T18:02:39.291274] [DEBUG] [LOCAL ] CNO: Primary data saved (40420 records). [2025-10-21T18:02:39.291454] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-21T18:02:39.291844] [INFO ] [MAIN ] Update Progress: 496/2366 symbols completed. CNO took 34.9s. Estimated remaining: 3h 55m 58s. Rate: 7.9 symbols/min [2025-10-21T18:02:39.357201] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-10-21T18:02:39.477383] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:02:39.494847] [DEBUG] [LOCAL ] CNS: No existing data file found in primary storage. [2025-10-21T18:02:39.497369] [WARN ] [MAIN ] CNS: No existing data found, performing full refresh instead. [2025-10-21T18:02:39.499387] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-21T18:02:39.498421] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-21T18:02:39.507198] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-21T18:02:39.507391] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-21T18:02:39.507436] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-21T18:02:39.572735] [INFO ] [REMOTE ] CNP: Full fetch complete (77160 records). [2025-10-21T18:02:39.611409] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-21T18:02:39.633338] [FATAL] [VALIDATOR ] CNP: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:02:39.669913] [FATAL] [MAIN ] CNP: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:02:39.703711] [WARN ] [MAIN ] CNP: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:02:39.749941] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-21T18:02:39.758997] [DEBUG] [LOCAL ] CNP: No primary data file found to delete. [2025-10-21T18:02:39.764280] [INFO ] [LOCAL ] CNP: Starting deletion of derivative data. [2025-10-21T18:02:39.771018] [DEBUG] [LOCAL ] CNP: No derivative data file found to delete. [2025-10-21T18:02:39.781414] [INFO ] [MAIN ] Update Progress: 497/2366 symbols completed. CNP took 27.5s. Estimated remaining: 3h 55m 24s. Rate: 7.9 symbols/min [2025-10-21T18:02:39.998881] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:02:40.092207] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:02:40.092412] [DEBUG] [LOCAL ] CNX: No existing data file found in primary storage. [2025-10-21T18:02:40.092628] [WARN ] [MAIN ] CNX: No existing data found, performing full refresh instead. [2025-10-21T18:02:40.093050] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-21T18:02:40.094515] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-21T18:02:40.105813] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-21T18:02:40.106153] [DEBUG] [LOCAL ] CNX: No primary data file found to delete. [2025-10-21T18:02:40.106207] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-21T18:02:40.162355] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-21T18:02:40.487206] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:02:40.804070] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T18:02:40.951055] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-21T18:02:41.750991] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-10-21T18:02:42.106332] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-21T18:02:42.180411] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T18:02:42.551073] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-21T18:02:43.353821] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-21T18:02:43.370101] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T18:02:43.513754] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-21T18:02:44.151044] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-10-21T18:02:44.951008] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-21T18:02:45.196606] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T18:02:45.754294] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-21T18:02:45.757687] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T18:02:45.848729] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-21T18:02:46.551063] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-21T18:02:47.351078] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-10-21T18:02:47.481239] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T18:02:47.616066] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T18:02:48.151028] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-21T18:02:48.935804] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T18:02:48.950974] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-10-21T18:02:49.734465] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T18:02:49.750988] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-21T18:02:50.464552] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T18:02:50.551045] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-21T18:02:51.351036] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-21T18:02:51.758592] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-21T18:02:51.767828] [INFO ] [REMOTE ] CNQ: Full fetch complete (77740 records). [2025-10-21T18:02:51.767958] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-21T18:02:52.162491] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-10-21T18:02:52.183058] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-21T18:02:52.183321] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-21T18:02:52.184373] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-21T18:02:52.184695] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-21T18:02:52.187887] [DEBUG] [LOCAL ] CNQ: Trimmed 77740 records to 53582 (keeping 200 days of data) [2025-10-21T18:02:52.312090] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T18:02:52.341350] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T18:02:52.575861] [DEBUG] [LOCAL ] CNQ: Primary data saved (53582 records). [2025-10-21T18:02:52.575995] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-21T18:02:52.576739] [INFO ] [MAIN ] Update Progress: 498/2366 symbols completed. CNQ took 28.8s. Estimated remaining: 3h 55m 36s. Rate: 7.9 symbols/min [2025-10-21T18:02:52.744162] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:02:52.784075] [DEBUG] [LOCAL ] CODI: Loaded 41816 existing records from primary storage. [2025-10-21T18:02:52.784353] [INFO ] [MAIN ] CODI: Loaded 41816 existing records. [2025-10-21T18:02:52.958733] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:02:52.958833] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-21T18:02:52.960179] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-21T18:02:52.960258] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-21T18:02:52.961206] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-21T18:02:52.961267] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-21T18:02:53.317273] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:02:53.751032] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-21T18:02:53.885570] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T18:02:54.551046] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-21T18:02:54.712040] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T18:02:54.768840] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-21T18:02:55.351060] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-21T18:02:56.018430] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T18:02:56.151012] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-21T18:02:56.174612] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-21T18:02:56.951009] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-21T18:02:57.265491] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T18:02:57.751050] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-10-21T18:02:58.083158] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T18:02:58.551026] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-21T18:02:59.351029] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-21T18:02:59.397431] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T18:02:59.455503] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-21T18:03:00.150999] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-21T18:03:00.223630] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-21T18:03:00.951045] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-21T18:03:01.638495] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-21T18:03:01.751024] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-21T18:03:02.261891] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T18:03:02.266616] [INFO ] [REMOTE ] CNS: Full fetch complete (31041 records). [2025-10-21T18:03:02.266775] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-21T18:03:02.267289] [FATAL] [VALIDATOR ] CNS: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:03:02.267388] [FATAL] [MAIN ] CNS: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:03:02.267464] [WARN ] [MAIN ] CNS: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:03:02.267540] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-21T18:03:02.267604] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-21T18:03:02.267639] [INFO ] [LOCAL ] CNS: Starting deletion of derivative data. [2025-10-21T18:03:02.267741] [DEBUG] [LOCAL ] CNS: No derivative data file found to delete. [2025-10-21T18:03:02.267813] [INFO ] [MAIN ] Update Progress: 499/2366 symbols completed. CNS took 23.0s. Estimated remaining: 3h 55m 36s. Rate: 7.9 symbols/min [2025-10-21T18:03:02.443505] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:03:02.500435] [DEBUG] [LOCAL ] COF: Loaded 53625 existing records from primary storage. [2025-10-21T18:03:02.500778] [INFO ] [MAIN ] COF: Loaded 53625 existing records. [2025-10-21T18:03:02.563406] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-10-21T18:03:02.678038] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:03:02.678270] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-21T18:03:02.678325] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-21T18:03:02.679309] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-21T18:03:02.679367] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-21T18:03:03.041064] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:03:03.351030] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-21T18:03:03.664948] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T18:03:04.151034] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-21T18:03:04.221836] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T18:03:04.944838] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T18:03:04.955173] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-21T18:03:05.738235] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T18:03:05.750973] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-21T18:03:06.551074] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-10-21T18:03:06.661433] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T18:03:07.351055] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-21T18:03:07.671493] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-21T18:03:08.120393] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T18:03:08.150980] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-10. [2025-10-21T18:03:08.951042] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-21T18:03:09.141499] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T18:03:09.751014] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-21T18:03:09.807838] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-21T18:03:09.815145] [INFO ] [REMOTE ] CNR: Full fetch complete (62554 records). [2025-10-21T18:03:09.815259] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-10-21T18:03:10.015028] [WARN ] [VALIDATOR ] CNR: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-21T18:03:10.015665] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:03:10.015740] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:03:10.015789] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-21T18:03:10.015845] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-21T18:03:10.015888] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-21T18:03:10.015926] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-21T18:03:10.015981] [INFO ] [MAIN ] Update Progress: 500/2366 symbols completed. CNR took 31.9s. Estimated remaining: 3h 55m 29s. Rate: 7.9 symbols/min [2025-10-21T18:03:10.186279] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:03:10.186433] [DEBUG] [LOCAL ] COHR: No existing data file found in primary storage. [2025-10-21T18:03:10.186470] [WARN ] [MAIN ] COHR: No existing data found, performing full refresh instead. [2025-10-21T18:03:10.186580] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-21T18:03:10.186620] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-21T18:03:10.186696] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-21T18:03:10.186743] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-21T18:03:10.542532] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:03:10.550987] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-21T18:03:10.947877] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-21T18:03:11.034492] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T18:03:11.351093] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-21T18:03:12.151010] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-21T18:03:12.389460] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T18:03:12.951047] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-21T18:03:13.477831] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-21T18:03:13.751066] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-21T18:03:14.489250] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T18:03:14.531607] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-21T18:03:14.550985] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-21T18:03:14.930526] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T18:03:15.351064] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-21T18:03:16.150996] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-21T18:03:16.612282] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-21T18:03:16.951020] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-21T18:03:17.262903] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T18:03:17.604005] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-21T18:03:17.750996] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-21T18:03:18.551059] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-21T18:03:18.947515] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-21T18:03:19.022813] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T18:03:19.351055] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-21T18:03:20.151003] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-21T18:03:20.436988] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T18:03:20.444218] [INFO ] [REMOTE ] CODI: Full fetch complete (53564 records). [2025-10-21T18:03:20.444324] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-21T18:03:20.827503] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-21T18:03:20.827619] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-21T18:03:20.828498] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-21T18:03:20.828582] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-21T18:03:20.829791] [DEBUG] [LOCAL ] CODI: Trimmed 53564 records to 41906 (keeping 200 days of data) [2025-10-21T18:03:20.990612] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-21T18:03:21.076992] [DEBUG] [LOCAL ] CODI: Primary data saved (41906 records). [2025-10-21T18:03:21.077266] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-21T18:03:21.077991] [INFO ] [MAIN ] Update Progress: 501/2366 symbols completed. CODI took 28.5s. Estimated remaining: 3h 55m 35s. Rate: 7.9 symbols/min [2025-10-21T18:03:21.252109] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:03:21.284044] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T18:03:21.341390] [DEBUG] [LOCAL ] COLD: Loaded 52476 existing records from primary storage. [2025-10-21T18:03:21.341719] [INFO ] [MAIN ] COLD: Loaded 52476 existing records. [2025-10-21T18:03:21.517511] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:03:21.517744] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-21T18:03:21.517794] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-21T18:03:21.518637] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-21T18:03:21.518751] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-21T18:03:21.776719] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-21T18:03:21.901574] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:03:21.929285] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T18:03:22.551047] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-21T18:03:23.054863] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-21T18:03:23.311551] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T18:03:23.351030] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-21T18:03:24.151064] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-21T18:03:24.267365] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T18:03:24.276045] [INFO ] [REMOTE ] CNX: Full fetch complete (74960 records). [2025-10-21T18:03:24.276239] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-21T18:03:24.679981] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-21T18:03:24.680095] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-21T18:03:24.681269] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-21T18:03:24.681341] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-21T18:03:24.683492] [DEBUG] [LOCAL ] CNX: Trimmed 74960 records to 51346 (keeping 200 days of data) [2025-10-21T18:03:24.963816] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-21T18:03:25.010084] [DEBUG] [LOCAL ] CNX: Primary data saved (51346 records). [2025-10-21T18:03:25.010304] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-21T18:03:25.010399] [INFO ] [MAIN ] Update Progress: 502/2366 symbols completed. CNX took 45.2s. Estimated remaining: 3h 55m 14s. Rate: 7.9 symbols/min [2025-10-21T18:03:25.195233] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:03:25.249077] [DEBUG] [LOCAL ] COMP: Loaded 53404 existing records from primary storage. [2025-10-21T18:03:25.249543] [INFO ] [MAIN ] COMP: Loaded 53404 existing records. [2025-10-21T18:03:25.443839] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:03:25.444299] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-21T18:03:25.444416] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-21T18:03:25.457630] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-21T18:03:25.472445] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-21T18:03:25.550790] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-21T18:03:25.755713] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-21T18:03:25.887590] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:03:26.030853] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-21T18:03:26.556203] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-21T18:03:26.572772] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T18:03:27.350991] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-21T18:03:27.857426] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-21T18:03:28.151097] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-21T18:03:28.951022] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-21T18:03:29.068947] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-21T18:03:29.566805] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-21T18:03:29.751034] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-21T18:03:30.304491] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T18:03:30.313339] [INFO ] [REMOTE ] COF: Full fetch complete (77305 records). [2025-10-21T18:03:30.313461] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-21T18:03:30.314272] [FATAL] [VALIDATOR ] COF: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:03:30.314359] [FATAL] [MAIN ] COF: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:03:30.314402] [WARN ] [MAIN ] COF: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:03:30.314466] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-21T18:03:30.314548] [DEBUG] [LOCAL ] COF: No primary data file found to delete. [2025-10-21T18:03:30.314587] [INFO ] [LOCAL ] COF: Starting deletion of derivative data. [2025-10-21T18:03:30.314766] [DEBUG] [LOCAL ] COF: Deleted derivative data file. [2025-10-21T18:03:30.315489] [INFO ] [MAIN ] Update Progress: 503/2366 symbols completed. COF took 28.0s. Estimated remaining: 3h 54m 58s. Rate: 7.9 symbols/min [2025-10-21T18:03:30.484908] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:03:30.524011] [DEBUG] [LOCAL ] CON: Loaded 38877 existing records from primary storage. [2025-10-21T18:03:30.524286] [INFO ] [MAIN ] CON: Loaded 38877 existing records. [2025-10-21T18:03:30.555500] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-21T18:03:30.703910] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:03:30.704171] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-21T18:03:30.704266] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-21T18:03:30.714085] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-21T18:03:30.727159] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-21T18:03:30.806194] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-10-21T18:03:31.098974] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:03:31.351001] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-21T18:03:31.776518] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T18:03:32.151073] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-21T18:03:32.412977] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T18:03:32.951056] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-21T18:03:33.195138] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-21T18:03:33.751017] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-21T18:03:34.243135] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T18:03:34.543882] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T18:03:34.554321] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-21T18:03:35.351041] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-21T18:03:35.404361] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T18:03:36.110211] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T18:03:36.150997] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-21T18:03:36.951085] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-21T18:03:37.329001] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T18:03:37.751043] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-21T18:03:37.887806] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T18:03:38.379384] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-21T18:03:38.551028] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-21T18:03:39.345618] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T18:03:39.355565] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-21T18:03:40.151082] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-21T18:03:40.381197] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T18:03:40.951093] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-21T18:03:41.517303] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-21T18:03:41.751179] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-21T18:03:41.958569] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T18:03:42.266025] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T18:03:42.551088] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-21T18:03:43.266784] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T18:03:43.351087] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-21T18:03:44.151090] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-21T18:03:44.539833] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-21T18:03:44.951100] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-21T18:03:45.415100] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-21T18:03:45.751068] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-21T18:03:45.788688] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T18:03:46.551066] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-21T18:03:46.742464] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T18:03:47.351009] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-21T18:03:47.758076] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-21T18:03:48.150992] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-21T18:03:48.235757] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-21T18:03:48.343205] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T18:03:48.353250] [INFO ] [REMOTE ] COHR: Full fetch complete (77463 records). [2025-10-21T18:03:48.353564] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-21T18:03:48.778851] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-21T18:03:48.778940] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-21T18:03:48.779806] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-21T18:03:48.779871] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-21T18:03:48.781275] [DEBUG] [LOCAL ] COHR: Trimmed 77463 records to 53377 (keeping 200 days of data) [2025-10-21T18:03:48.958727] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-21T18:03:49.104571] [DEBUG] [LOCAL ] COHR: Primary data saved (53377 records). [2025-10-21T18:03:49.104734] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-21T18:03:49.104813] [INFO ] [MAIN ] Update Progress: 504/2366 symbols completed. COHR took 39.1s. Estimated remaining: 3h 55m 31s. Rate: 7.9 symbols/min [2025-10-21T18:03:49.287800] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:03:49.312134] [DEBUG] [LOCAL ] COOK: Loaded 24923 existing records from primary storage. [2025-10-21T18:03:49.312372] [INFO ] [MAIN ] COOK: Loaded 24923 existing records. [2025-10-21T18:03:49.486979] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:03:49.487161] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-21T18:03:49.487207] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-21T18:03:49.487596] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-21T18:03:49.487701] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-21T18:03:49.763128] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-21T18:03:49.859156] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:03:50.114279] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-21T18:03:50.191498] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T18:03:50.551045] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-21T18:03:51.351012] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-21T18:03:51.544048] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T18:03:52.005936] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T18:03:52.151072] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-21T18:03:52.950988] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-21T18:03:53.089826] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T18:03:53.097543] [INFO ] [REMOTE ] COLD: Full fetch complete (74426 records). [2025-10-21T18:03:53.097692] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-21T18:03:53.098501] [FATAL] [VALIDATOR ] COLD: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:03:53.098582] [FATAL] [MAIN ] COLD: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:03:53.098674] [WARN ] [MAIN ] COLD: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:03:53.098738] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-21T18:03:53.098797] [DEBUG] [LOCAL ] COLD: No primary data file found to delete. [2025-10-21T18:03:53.098830] [INFO ] [LOCAL ] COLD: Starting deletion of derivative data. [2025-10-21T18:03:53.098963] [DEBUG] [LOCAL ] COLD: Deleted derivative data file. [2025-10-21T18:03:53.099537] [INFO ] [MAIN ] Update Progress: 505/2366 symbols completed. COLD took 32.0s. Estimated remaining: 3h 55m 11s. Rate: 7.9 symbols/min [2025-10-21T18:03:53.267890] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:03:53.318869] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-21T18:03:53.319163] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-10-21T18:03:53.499735] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:03:53.500008] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-21T18:03:53.500083] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-21T18:03:53.500715] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-21T18:03:53.500773] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-21T18:03:53.756199] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-21T18:03:53.897985] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:03:53.894004] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T18:03:54.057372] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-21T18:03:54.551022] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-21T18:03:55.351059] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-21T18:03:55.373441] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T18:03:55.906384] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-21T18:03:55.914807] [INFO ] [REMOTE ] COMP: Full fetch complete (77397 records). [2025-10-21T18:03:55.914956] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-21T18:03:56.161916] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-21T18:03:56.338035] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-21T18:03:56.338161] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-21T18:03:56.339119] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-21T18:03:56.339186] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-21T18:03:56.340683] [DEBUG] [LOCAL ] COMP: Trimmed 77397 records to 53404 (keeping 200 days of data) [2025-10-21T18:03:56.648547] [DEBUG] [LOCAL ] COMP: Primary data saved (53404 records). [2025-10-21T18:03:56.648783] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-21T18:03:56.648881] [INFO ] [MAIN ] Update Progress: 506/2366 symbols completed. COMP took 31.6s. Estimated remaining: 3h 54m 48s. Rate: 7.9 symbols/min [2025-10-21T18:03:56.841156] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:03:56.850385] [DEBUG] [LOCAL ] COR: No existing data file found in primary storage. [2025-10-21T18:03:56.850501] [WARN ] [MAIN ] COR: No existing data found, performing full refresh instead. [2025-10-21T18:03:56.850667] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-21T18:03:56.850791] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-21T18:03:56.851312] [DEBUG] [LOCAL ] COR: No primary data file found to delete. [2025-10-21T18:03:56.852365] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T18:03:56.852445] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-21T18:03:56.960126] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-21T18:03:57.254060] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:03:57.373837] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T18:03:57.751056] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-21T18:03:58.551041] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-21T18:03:58.662536] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-21T18:03:58.669809] [INFO ] [REMOTE ] CON: Full fetch complete (56702 records). [2025-10-21T18:03:58.669962] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-21T18:03:58.791826] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-21T18:03:59.081800] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-21T18:03:59.081885] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-21T18:03:59.082604] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-21T18:03:59.082666] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-21T18:03:59.083989] [DEBUG] [LOCAL ] CON: Trimmed 56702 records to 38811 (keeping 200 days of data) [2025-10-21T18:03:59.316564] [DEBUG] [LOCAL ] CON: Primary data saved (38811 records). [2025-10-21T18:03:59.316755] [INFO ] [MAIN ] CON: Full history saved. [2025-10-21T18:03:59.317262] [INFO ] [MAIN ] Update Progress: 507/2366 symbols completed. CON took 29.0s. Estimated remaining: 3h 54m 23s. Rate: 7.9 symbols/min [2025-10-21T18:03:59.351215] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-21T18:03:59.500941] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:03:59.550868] [DEBUG] [LOCAL ] COTY: Loaded 53275 existing records from primary storage. [2025-10-21T18:03:59.551175] [INFO ] [MAIN ] COTY: Loaded 53275 existing records. [2025-10-21T18:03:59.726290] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:03:59.726490] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-21T18:03:59.726537] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-21T18:03:59.727406] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-21T18:03:59.727466] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-21T18:04:00.080077] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:04:00.150981] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-21T18:04:00.198997] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T18:04:00.589798] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T18:04:00.951030] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-21T18:04:01.751035] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-21T18:04:02.372354] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-21T18:04:02.551019] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-21T18:04:02.613694] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T18:04:03.351009] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-21T18:04:04.065135] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-21T18:04:04.151011] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-21T18:04:04.229515] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T18:04:04.951066] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-21T18:04:05.181445] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T18:04:05.751054] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-21T18:04:06.066189] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-21T18:04:06.395299] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T18:04:06.551039] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-21T18:04:07.356122] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-21T18:04:07.376759] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T18:04:07.691044] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-21T18:04:08.151082] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-21T18:04:08.951064] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-21T18:04:09.309453] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T18:04:09.751051] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-21T18:04:09.937697] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T18:04:10.090058] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T18:04:10.551093] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-21T18:04:11.351078] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-21T18:04:11.444189] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T18:04:11.774240] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-21T18:04:12.151038] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-21T18:04:12.951048] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-21T18:04:13.251296] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T18:04:13.258110] [INFO ] [REMOTE ] COOK: Full fetch complete (33129 records). [2025-10-21T18:04:13.258269] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-21T18:04:13.467576] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-21T18:04:13.680132] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-21T18:04:13.680210] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-21T18:04:13.680779] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-21T18:04:13.680844] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-21T18:04:13.681601] [DEBUG] [LOCAL ] COOK: Trimmed 33129 records to 24899 (keeping 200 days of data) [2025-10-21T18:04:13.759528] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-21T18:04:13.820271] [DEBUG] [LOCAL ] COOK: Primary data saved (24899 records). [2025-10-21T18:04:13.820406] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-21T18:04:13.820485] [INFO ] [MAIN ] Update Progress: 508/2366 symbols completed. COOK took 24.7s. Estimated remaining: 3h 54m 40s. Rate: 7.9 symbols/min [2025-10-21T18:04:13.993504] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:04:14.043072] [DEBUG] [LOCAL ] COUR: Loaded 49404 existing records from primary storage. [2025-10-21T18:04:14.043387] [INFO ] [MAIN ] COUR: Loaded 49404 existing records. [2025-10-21T18:04:14.224627] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:04:14.224923] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-21T18:04:14.224976] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-21T18:04:14.225878] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-21T18:04:14.225935] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-21T18:04:14.554984] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-21T18:04:14.577889] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:04:15.049791] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-21T18:04:15.351025] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-21T18:04:15.429070] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T18:04:16.141947] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T18:04:16.153071] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-21T18:04:16.951003] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-21T18:04:17.309232] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-21T18:04:17.751042] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-21T18:04:18.028155] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T18:04:18.551067] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-21T18:04:18.997616] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-21T18:04:19.351066] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-21T18:04:19.628486] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T18:04:19.765262] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T18:04:20.151075] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-21T18:04:20.951025] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-21T18:04:21.463584] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-21T18:04:21.751053] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-21T18:04:22.049000] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T18:04:22.551045] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-21T18:04:22.624024] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T18:04:23.351050] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-21T18:04:23.763731] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-21T18:04:24.139965] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T18:04:24.151098] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-21T18:04:24.797226] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T18:04:24.804039] [INFO ] [REMOTE ] COR: Full fetch complete (68528 records). [2025-10-21T18:04:24.804187] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-21T18:04:24.959327] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-21T18:04:25.210468] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-21T18:04:25.210537] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-21T18:04:25.211402] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-21T18:04:25.211469] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-21T18:04:25.212748] [DEBUG] [LOCAL ] COR: Trimmed 68528 records to 46340 (keeping 200 days of data) [2025-10-21T18:04:25.501110] [DEBUG] [LOCAL ] COR: Primary data saved (46340 records). [2025-10-21T18:04:25.501233] [INFO ] [MAIN ] COR: Full history saved. [2025-10-21T18:04:25.501298] [INFO ] [MAIN ] Update Progress: 509/2366 symbols completed. COR took 28.9s. Estimated remaining: 3h 54m 48s. Rate: 7.9 symbols/min [2025-10-21T18:04:25.670492] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:04:25.670834] [DEBUG] [LOCAL ] CP: No existing data file found in primary storage. [2025-10-21T18:04:25.670905] [WARN ] [MAIN ] CP: No existing data found, performing full refresh instead. [2025-10-21T18:04:25.671122] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-21T18:04:25.671192] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-21T18:04:25.671311] [DEBUG] [LOCAL ] CP: No primary data file found to delete. [2025-10-21T18:04:25.671404] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-21T18:04:25.761282] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-21T18:04:25.979822] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T18:04:26.065609] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:04:26.551068] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-21T18:04:27.351006] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-21T18:04:27.437773] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-21T18:04:28.156122] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-21T18:04:28.177468] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-21T18:04:28.950999] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-21T18:04:29.142841] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-21T18:04:29.511776] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-21T18:04:29.751072] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-21T18:04:30.551090] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-21T18:04:30.662773] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-21T18:04:30.751185] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-21T18:04:31.351055] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-21T18:04:31.596859] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T18:04:31.933419] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T18:04:32.151005] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-21T18:04:32.951003] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-21T18:04:33.215015] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-21T18:04:33.223885] [INFO ] [REMOTE ] COTY: Full fetch complete (76908 records). [2025-10-21T18:04:33.224019] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-21T18:04:33.224965] [FATAL] [VALIDATOR ] COTY: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:04:33.225053] [FATAL] [MAIN ] COTY: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:04:33.225096] [WARN ] [MAIN ] COTY: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:04:33.225134] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-21T18:04:33.225190] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-10-21T18:04:33.225230] [INFO ] [LOCAL ] COTY: Starting deletion of derivative data. [2025-10-21T18:04:33.225433] [DEBUG] [LOCAL ] COTY: Deleted derivative data file. [2025-10-21T18:04:33.225942] [INFO ] [MAIN ] Update Progress: 510/2366 symbols completed. COTY took 33.9s. Estimated remaining: 3h 54m 41s. Rate: 7.9 symbols/min [2025-10-21T18:04:33.422526] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:04:33.452177] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T18:04:33.491102] [DEBUG] [LOCAL ] CPA: Loaded 28158 existing records from primary storage. [2025-10-21T18:04:33.491385] [INFO ] [MAIN ] CPA: Loaded 28158 existing records. [2025-10-21T18:04:33.675812] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:04:33.676021] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-21T18:04:33.676066] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-21T18:04:33.676455] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-21T18:04:33.676511] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-21T18:04:33.756111] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-21T18:04:34.051314] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:04:34.551114] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-21T18:04:34.691694] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T18:04:34.743272] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T18:04:34.758027] [INFO ] [REMOTE ] COP: Full fetch complete (77906 records). [2025-10-21T18:04:34.758352] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-21T18:04:35.307304] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-21T18:04:35.307404] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-21T18:04:35.308395] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-21T18:04:35.308464] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-21T18:04:35.310207] [DEBUG] [LOCAL ] COP: Trimmed 77906 records to 53727 (keeping 200 days of data) [2025-10-21T18:04:35.371763] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-21T18:04:35.654341] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-10-21T18:04:35.654485] [INFO ] [MAIN ] COP: Full history saved. [2025-10-21T18:04:35.655216] [INFO ] [MAIN ] Update Progress: 511/2366 symbols completed. COP took 42.6s. Estimated remaining: 3h 54m 14s. Rate: 7.9 symbols/min [2025-10-21T18:04:35.821129] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:04:35.821314] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-21T18:04:35.821350] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-21T18:04:35.821455] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-21T18:04:35.821495] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-21T18:04:35.821534] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-21T18:04:35.821564] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-21T18:04:36.164039] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-21T18:04:36.168630] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:04:36.465583] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-21T18:04:36.742946] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T18:04:36.951087] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-21T18:04:37.528214] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-21T18:04:37.751017] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-21T18:04:37.928396] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T18:04:38.043807] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-21T18:04:38.551025] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-21T18:04:39.351038] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-21T18:04:39.791942] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-21T18:04:40.151107] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-21T18:04:40.951072] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-21T18:04:41.288833] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-21T18:04:41.508066] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T18:04:41.751036] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-21T18:04:41.858427] [DEBUG] [REMOTE ] CPA: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-21T18:04:41.858775] [WARN ] [REMOTE ] CPA: No data returned for month 2025-04 [2025-10-21T18:04:41.858948] [FATAL] [REMOTE ] CPA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:04:41.859037] [FATAL] [MAIN ] CPA: Failed to fetch primary data. [2025-10-21T18:04:41.859082] [WARN ] [MAIN ] CPA: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:04:41.859122] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-21T18:04:41.859177] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-10-21T18:04:41.859212] [INFO ] [LOCAL ] CPA: Starting deletion of derivative data. [2025-10-21T18:04:41.859413] [DEBUG] [LOCAL ] CPA: Deleted derivative data file. [2025-10-21T18:04:41.859499] [INFO ] [MAIN ] Update Progress: 512/2366 symbols completed. CPA took 8.6s. Estimated remaining: 3h 54m 2s. Rate: 7.9 symbols/min [2025-10-21T18:04:42.036857] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:04:42.069845] [DEBUG] [LOCAL ] CPAY: Loaded 30345 existing records from primary storage. [2025-10-21T18:04:42.070131] [INFO ] [MAIN ] CPAY: Loaded 30345 existing records. [2025-10-21T18:04:42.248316] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:04:42.248506] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-21T18:04:42.248552] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-21T18:04:42.249195] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-21T18:04:42.249252] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-21T18:04:42.556138] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-21T18:04:42.609224] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:04:42.974722] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-21T18:04:43.351017] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-21T18:04:44.129596] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T18:04:44.151000] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-21T18:04:44.381388] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T18:04:44.506885] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-21T18:04:44.951032] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-21T18:04:45.751017] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-21T18:04:46.107097] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-21T18:04:46.551050] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-21T18:04:46.951393] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-21T18:04:46.959020] [INFO ] [REMOTE ] COUR: Full fetch complete (70743 records). [2025-10-21T18:04:46.959156] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-21T18:04:46.959952] [FATAL] [VALIDATOR ] COUR: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:04:46.960047] [FATAL] [MAIN ] COUR: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:04:46.960089] [WARN ] [MAIN ] COUR: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:04:46.960126] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-21T18:04:46.960180] [DEBUG] [LOCAL ] COUR: No primary data file found to delete. [2025-10-21T18:04:46.960214] [INFO ] [LOCAL ] COUR: Starting deletion of derivative data. [2025-10-21T18:04:46.960352] [DEBUG] [LOCAL ] COUR: Deleted derivative data file. [2025-10-21T18:04:46.961119] [INFO ] [MAIN ] Update Progress: 513/2366 symbols completed. COUR took 33.1s. Estimated remaining: 3h 53m 45s. Rate: 7.9 symbols/min [2025-10-21T18:04:47.137234] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:04:47.156359] [DEBUG] [LOCAL ] CPF: Loaded 15307 existing records from primary storage. [2025-10-21T18:04:47.156604] [INFO ] [MAIN ] CPF: Loaded 15307 existing records. [2025-10-21T18:04:47.345146] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:04:47.345391] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-21T18:04:47.345446] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-21T18:04:47.345635] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-21T18:04:47.345730] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-21T18:04:47.351044] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-21T18:04:47.713846] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:04:47.888518] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-21T18:04:47.970264] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T18:04:48.151029] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-21T18:04:48.951014] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-21T18:04:49.333689] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T18:04:49.751052] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-21T18:04:50.120550] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-21T18:04:50.413148] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-21T18:04:50.551031] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-21T18:04:51.351031] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-21T18:04:51.989904] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T18:04:52.151028] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-21T18:04:52.334358] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T18:04:52.427888] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-21T18:04:52.951023] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-21T18:04:53.751006] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-21T18:04:54.016713] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-21T18:04:54.551017] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-21T18:04:55.251945] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T18:04:55.270251] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-21T18:04:55.350993] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-21T18:04:56.151053] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-21T18:04:56.327637] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-21T18:04:56.951027] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-21T18:04:57.457553] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T18:04:57.751032] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-21T18:04:58.191869] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-21T18:04:58.551031] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-21T18:04:58.833731] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T18:04:59.002943] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-21T18:04:59.351029] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-21T18:04:59.845419] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-21T18:04:59.846550] [INFO ] [REMOTE ] CPAC: Full fetch complete (1790 records). [2025-10-21T18:04:59.846627] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-21T18:05:00.030620] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T18:05:00.030817] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:05:00.030883] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:05:00.030954] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-21T18:05:00.031014] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-21T18:05:00.031049] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-21T18:05:00.031088] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-21T18:05:00.031144] [INFO ] [MAIN ] Update Progress: 514/2366 symbols completed. CPAC took 24.4s. Estimated remaining: 3h 53m 58s. Rate: 7.9 symbols/min [2025-10-21T18:05:00.156087] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-21T18:05:00.202885] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:05:00.223501] [DEBUG] [LOCAL ] CPK: Loaded 14051 existing records from primary storage. [2025-10-21T18:05:00.223744] [INFO ] [MAIN ] CPK: Loaded 14051 existing records. [2025-10-21T18:05:00.396246] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:05:00.396434] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-21T18:05:00.396481] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-21T18:05:00.396789] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-21T18:05:00.396852] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-21T18:05:00.741725] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:05:00.950983] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-21T18:05:01.371216] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T18:05:01.754669] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-21T18:05:01.756594] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-21T18:05:02.551022] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-21T18:05:03.352766] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-21T18:05:03.353848] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-21T18:05:03.624027] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T18:05:04.151026] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-21T18:05:04.767286] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-21T18:05:04.781769] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-21T18:05:04.951066] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-21T18:05:05.751027] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-21T18:05:06.551024] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-21T18:05:06.785035] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-21T18:05:06.851452] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T18:05:07.351053] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-21T18:05:07.700305] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-21T18:05:08.151076] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-21T18:05:08.961454] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-21T18:05:08.985531] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T18:05:09.022685] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-21T18:05:09.751002] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-21T18:05:10.383108] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T18:05:10.551001] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-21T18:05:10.635026] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-21T18:05:11.351042] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-21T18:05:12.151013] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-21T18:05:12.433790] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T18:05:12.444248] [INFO ] [REMOTE ] CP: Full fetch complete (77303 records). [2025-10-21T18:05:12.444507] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-21T18:05:12.905450] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-21T18:05:12.905297] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-21T18:05:12.905736] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-21T18:05:12.913473] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-21T18:05:12.913823] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-21T18:05:12.916833] [DEBUG] [LOCAL ] CP: Trimmed 77303 records to 53233 (keeping 200 days of data) [2025-10-21T18:05:12.970518] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-21T18:05:13.157769] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-21T18:05:13.278964] [DEBUG] [LOCAL ] CP: Primary data saved (53233 records). [2025-10-21T18:05:13.279109] [INFO ] [MAIN ] CP: Full history saved. [2025-10-21T18:05:13.279185] [INFO ] [MAIN ] Update Progress: 515/2366 symbols completed. CP took 47.8s. Estimated remaining: 3h 54m 10s. Rate: 7.9 symbols/min [2025-10-21T18:05:13.478410] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:05:13.530354] [DEBUG] [LOCAL ] CPNG: Loaded 53680 existing records from primary storage. [2025-10-21T18:05:13.530701] [INFO ] [MAIN ] CPNG: Loaded 53680 existing records. [2025-10-21T18:05:13.715697] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:05:13.715927] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-21T18:05:13.715973] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-21T18:05:13.716793] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-21T18:05:13.716852] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-21T18:05:13.751237] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-21T18:05:14.041835] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T18:05:14.110009] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:05:14.551071] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-21T18:05:15.156816] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-21T18:05:15.161364] [INFO ] [REMOTE ] CPAY: Full fetch complete (44855 records). [2025-10-21T18:05:15.161449] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-21T18:05:15.360327] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-21T18:05:15.561679] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-21T18:05:15.582403] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-21T18:05:15.582909] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-21T18:05:15.584032] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-21T18:05:15.584119] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-21T18:05:15.585509] [DEBUG] [LOCAL ] CPAY: Trimmed 44855 records to 30239 (keeping 200 days of data) [2025-10-21T18:05:15.763921] [DEBUG] [LOCAL ] CPAY: Primary data saved (30239 records). [2025-10-21T18:05:15.764019] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-21T18:05:15.764097] [INFO ] [MAIN ] Update Progress: 516/2366 symbols completed. CPAY took 33.9s. Estimated remaining: 3h 53m 45s. Rate: 7.9 symbols/min [2025-10-21T18:05:15.939734] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:05:15.989729] [DEBUG] [LOCAL ] CPRI: Loaded 52442 existing records from primary storage. [2025-10-21T18:05:15.990045] [INFO ] [MAIN ] CPRI: Loaded 52442 existing records. [2025-10-21T18:05:16.157733] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-21T18:05:16.162359] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:05:16.163436] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-21T18:05:16.163510] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-21T18:05:16.164412] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-21T18:05:16.164473] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-21T18:05:16.508953] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:05:16.951020] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-21T18:05:17.034200] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-21T18:05:17.710123] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-21T18:05:17.750988] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-21T18:05:18.551009] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-21T18:05:18.707538] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T18:05:18.712377] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-21T18:05:19.351044] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-21T18:05:19.697555] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-21T18:05:19.700411] [INFO ] [REMOTE ] CPF: Full fetch complete (23335 records). [2025-10-21T18:05:19.700482] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-21T18:05:19.701148] [FATAL] [VALIDATOR ] CPF: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:05:19.701235] [FATAL] [MAIN ] CPF: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:05:19.701283] [WARN ] [MAIN ] CPF: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:05:19.701351] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-21T18:05:19.701412] [DEBUG] [LOCAL ] CPF: No primary data file found to delete. [2025-10-21T18:05:19.701447] [INFO ] [LOCAL ] CPF: Starting deletion of derivative data. [2025-10-21T18:05:19.701596] [DEBUG] [LOCAL ] CPF: Deleted derivative data file. [2025-10-21T18:05:19.701704] [INFO ] [MAIN ] Update Progress: 517/2366 symbols completed. CPF took 32.7s. Estimated remaining: 3h 53m 24s. Rate: 7.9 symbols/min [2025-10-21T18:05:20.151026] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-21T18:05:20.960563] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-21T18:05:20.966240] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T18:05:21.751002] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-21T18:05:22.230494] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-21T18:05:22.272827] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T18:05:22.276145] [INFO ] [REMOTE ] CPK: Full fetch complete (18684 records). [2025-10-21T18:05:22.276222] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-21T18:05:22.557250] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-21T18:05:22.638235] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-21T18:05:22.638310] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-21T18:05:22.638755] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-21T18:05:22.638816] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-21T18:05:22.639365] [DEBUG] [LOCAL ] CPK: Trimmed 18684 records to 13991 (keeping 200 days of data) [2025-10-21T18:05:22.725695] [DEBUG] [LOCAL ] CPK: Primary data saved (13991 records). [2025-10-21T18:05:22.725833] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-21T18:05:22.725909] [INFO ] [MAIN ] Update Progress: 518/2366 symbols completed. CPK took 22.7s. Estimated remaining: 3h 53m 0s. Rate: 7.9 symbols/min [2025-10-21T18:05:23.447547] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T18:05:23.458510] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-21T18:05:24.483791] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-21T18:05:24.495201] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-21T18:05:25.213978] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T18:05:25.225633] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-21T18:05:26.675471] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-21T18:05:26.687379] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-21T18:05:26.880944] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T18:05:26.892815] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-21T18:05:28.667141] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T18:05:28.677633] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-21T18:05:29.136625] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-21T18:05:29.147957] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-21T18:05:30.525393] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-21T18:05:30.536493] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-21T18:05:31.320275] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-21T18:05:31.331973] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-21T18:05:32.265971] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T18:05:32.276835] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-21T18:05:33.658021] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-21T18:05:33.669885] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-21T18:05:33.739117] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T18:05:33.750317] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-21T18:05:35.577491] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T18:05:35.585987] [INFO ] [REMOTE ] CPRI: Full fetch complete (76222 records). [2025-10-21T18:05:35.586245] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-21T18:05:35.771682] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-21T18:05:35.812021] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-21T18:05:36.025061] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-21T18:05:36.025134] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-21T18:05:36.025982] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-21T18:05:36.026045] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-21T18:05:36.027336] [DEBUG] [LOCAL ] CPRI: Trimmed 76222 records to 52438 (keeping 200 days of data) [2025-10-21T18:05:36.328341] [DEBUG] [LOCAL ] CPRI: Primary data saved (52438 records). [2025-10-21T18:05:36.328536] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-21T18:05:36.329018] [INFO ] [MAIN ] Update Progress: 519/2366 symbols completed. CPRI took 20.6s. Estimated remaining: 3h 53m 14s. Rate: 7.9 symbols/min [2025-10-21T18:05:38.210878] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-21T18:05:38.222147] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-21T18:05:41.047601] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.83 seconds). [2025-10-21T18:05:41.059682] [INFO ] [REMOTE ] CPNG: Full fetch complete (77788 records). [2025-10-21T18:05:41.059877] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-21T18:05:41.474287] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-21T18:05:41.474373] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-21T18:05:41.475370] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-21T18:05:41.475437] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-21T18:05:41.476911] [DEBUG] [LOCAL ] CPNG: Trimmed 77788 records to 53679 (keeping 200 days of data) [2025-10-21T18:05:41.783567] [DEBUG] [LOCAL ] CPNG: Primary data saved (53679 records). [2025-10-21T18:05:41.783725] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-21T18:05:41.783811] [INFO ] [MAIN ] Update Progress: 520/2366 symbols completed. CPNG took 28.5s. Estimated remaining: 3h 52m 59s. Rate: 7.9 symbols/min [2025-10-21T18:05:42.483044] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:05:42.475767] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:05:42.539851] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:05:42.541544] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:05:42.543232] [DEBUG] [LOCAL ] CQP: No existing data file found in primary storage. [2025-10-21T18:05:42.543389] [WARN ] [MAIN ] CQP: No existing data found, performing full refresh instead. [2025-10-21T18:05:42.543522] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-21T18:05:42.543582] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-21T18:05:42.543689] [DEBUG] [LOCAL ] CQP: No primary data file found to delete. [2025-10-21T18:05:42.543762] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-21T18:05:42.740110] [DEBUG] [LOCAL ] CPS: Loaded 25047 existing records from primary storage. [2025-10-21T18:05:42.758604] [INFO ] [MAIN ] CPS: Loaded 25047 existing records. [2025-10-21T18:05:42.800247] [DEBUG] [LOCAL ] CR: Loaded 24066 existing records from primary storage. [2025-10-21T18:05:42.955882] [DEBUG] [LOCAL ] CPT: Loaded 44551 existing records from primary storage. [2025-10-21T18:05:42.992447] [INFO ] [MAIN ] CR: Loaded 24066 existing records. [2025-10-21T18:05:43.001812] [INFO ] [MAIN ] CPT: Loaded 44551 existing records. [2025-10-21T18:05:43.236224] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:05:43.269912] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-21T18:05:43.286714] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-21T18:05:43.346194] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:05:43.367055] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-21T18:05:43.366639] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-21T18:05:43.391601] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-21T18:05:43.551292] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:05:43.617691] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-21T18:05:43.628112] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-21T18:05:43.622831] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:05:43.645916] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-21T18:05:43.649012] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-21T18:05:43.646026] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-21T18:05:43.659927] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-21T18:05:43.769878] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-21T18:05:43.790663] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-21T18:05:44.306082] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:05:44.358237] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-21T18:05:44.542848] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:05:44.548724] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-21T18:05:44.626551] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:05:44.626860] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-21T18:05:44.760306] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T18:05:44.766021] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-21T18:05:45.525822] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T18:05:45.530512] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-21T18:05:45.657620] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T18:05:45.662922] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-21T18:05:45.912256] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-21T18:05:45.919485] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-21T18:05:46.484868] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-21T18:05:46.493743] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-21T18:05:46.717618] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-21T18:05:46.724636] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-21T18:05:46.838608] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-21T18:05:46.845861] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-21T18:05:47.022818] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T18:05:47.027296] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-21T18:05:47.637567] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T18:05:47.641752] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-21T18:05:47.746753] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-21T18:05:47.753964] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-21T18:05:48.097691] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T18:05:48.106483] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-21T18:05:48.165836] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-21T18:05:48.171586] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-21T18:05:48.776913] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T18:05:48.781904] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-21T18:05:48.929147] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T18:05:48.936287] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-21T18:05:49.536527] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-21T18:05:49.543187] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-21T18:05:49.664433] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-21T18:05:49.750759] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T18:05:49.753990] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-21T18:05:49.896348] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T18:05:50.550997] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-21T18:05:50.635260] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-21T18:05:50.714192] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-21T18:05:51.351083] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-21T18:05:51.964997] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T18:05:52.150991] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-21T18:05:52.395518] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T18:05:52.951068] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-21T18:05:53.660669] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T18:05:53.750983] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-21T18:05:53.800404] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-21T18:05:54.551076] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-21T18:05:55.040477] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T18:05:55.351022] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-21T18:05:55.739101] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-21T18:05:56.151076] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-21T18:05:56.910360] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T18:05:56.951012] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-21T18:05:57.351892] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-21T18:05:57.751025] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-21T18:05:58.551036] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-21T18:05:58.614537] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T18:05:59.005225] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T18:05:59.319915] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T18:05:59.350975] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-21T18:06:00.151022] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-21T18:06:00.191191] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-21T18:06:00.951038] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-21T18:06:01.539942] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T18:06:01.751026] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-21T18:06:02.166638] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T18:06:02.169511] [INFO ] [REMOTE ] CQP: Full fetch complete (29756 records). [2025-10-21T18:06:02.169638] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-21T18:06:02.552734] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-21T18:06:02.552431] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-21T18:06:02.553932] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-21T18:06:02.554466] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-21T18:06:02.554510] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-21T18:06:02.555370] [DEBUG] [LOCAL ] CQP: Trimmed 29756 records to 18719 (keeping 200 days of data) [2025-10-21T18:06:02.665519] [DEBUG] [LOCAL ] CQP: Primary data saved (18719 records). [2025-10-21T18:06:02.665681] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-21T18:06:02.665769] [INFO ] [MAIN ] Update Progress: 521/2366 symbols completed. CQP took 20.9s. Estimated remaining: 3h 53m 39s. Rate: 7.9 symbols/min [2025-10-21T18:06:02.833433] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:06:02.843220] [DEBUG] [LOCAL ] CRBD: Loaded 8858 existing records from primary storage. [2025-10-21T18:06:02.843431] [INFO ] [MAIN ] CRBD: Loaded 8858 existing records. [2025-10-21T18:06:03.020047] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:06:03.020269] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-21T18:06:03.020326] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-21T18:06:03.020588] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-21T18:06:03.020671] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-21T18:06:03.357175] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-21T18:06:03.388859] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:06:03.430269] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T18:06:03.684295] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T18:06:04.151043] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-21T18:06:04.500136] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T18:06:04.504211] [INFO ] [REMOTE ] CPS: Full fetch complete (36502 records). [2025-10-21T18:06:04.504346] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-21T18:06:04.905521] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-21T18:06:04.905665] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-21T18:06:04.906294] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-21T18:06:04.906357] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-21T18:06:04.907392] [DEBUG] [LOCAL ] CPS: Trimmed 36502 records to 24974 (keeping 200 days of data) [2025-10-21T18:06:04.954417] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-21T18:06:05.057496] [DEBUG] [LOCAL ] CPS: Primary data saved (24974 records). [2025-10-21T18:06:05.057632] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-21T18:06:05.057763] [INFO ] [MAIN ] Update Progress: 522/2366 symbols completed. CPS took 23.3s. Estimated remaining: 3h 53m 13s. Rate: 7.9 symbols/min [2025-10-21T18:06:05.242260] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:06:05.317118] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T18:06:05.325431] [DEBUG] [LOCAL ] CRBG: Loaded 52602 existing records from primary storage. [2025-10-21T18:06:05.326175] [INFO ] [MAIN ] CRBG: Loaded 52602 existing records. [2025-10-21T18:06:05.518204] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:06:05.518433] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-21T18:06:05.518482] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-21T18:06:05.519374] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-21T18:06:05.519439] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-21T18:06:05.757395] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-21T18:06:05.883198] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:06:06.551055] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-21T18:06:06.704883] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T18:06:06.711912] [INFO ] [REMOTE ] CPT: Full fetch complete (64630 records). [2025-10-21T18:06:06.712050] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-21T18:06:07.034358] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T18:06:07.051685] [INFO ] [REMOTE ] CR: Full fetch complete (34781 records). [2025-10-21T18:06:07.062395] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-21T18:06:07.234292] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-21T18:06:07.245481] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-21T18:06:07.254936] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-21T18:06:07.257736] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-21T18:06:07.312162] [DEBUG] [LOCAL ] CPT: Trimmed 64630 records to 44521 (keeping 200 days of data) [2025-10-21T18:06:07.357270] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-21T18:06:07.697346] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-21T18:06:07.699595] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-21T18:06:07.704335] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-21T18:06:07.704426] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-21T18:06:07.710449] [DEBUG] [LOCAL ] CR: Trimmed 34781 records to 23996 (keeping 200 days of data) [2025-10-21T18:06:07.980772] [DEBUG] [LOCAL ] CR: Primary data saved (23996 records). [2025-10-21T18:06:07.982020] [INFO ] [MAIN ] CR: Full history saved. [2025-10-21T18:06:07.982566] [INFO ] [MAIN ] Update Progress: 523/2366 symbols completed. CR took 26.2s. Estimated remaining: 3h 52m 49s. Rate: 7.9 symbols/min [2025-10-21T18:06:08.189561] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:06:08.260462] [DEBUG] [LOCAL ] CPT: Primary data saved (44521 records). [2025-10-21T18:06:08.263280] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T18:06:08.261092] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-21T18:06:08.274864] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-21T18:06:08.274001] [INFO ] [MAIN ] Update Progress: 524/2366 symbols completed. CPT took 26.5s. Estimated remaining: 3h 52m 15s. Rate: 7.9 symbols/min [2025-10-21T18:06:08.418711] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T18:06:08.517465] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:06:08.519059] [DEBUG] [LOCAL ] CRC: Loaded 44124 existing records from primary storage. [2025-10-21T18:06:08.519324] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-21T18:06:08.519740] [INFO ] [MAIN ] CRC: Loaded 44124 existing records. [2025-10-21T18:06:08.519558] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-21T18:06:08.588629] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-21T18:06:08.594576] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-21T18:06:08.620367] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-21T18:06:08.620497] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-21T18:06:08.857114] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:06:08.902009] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-21T18:06:08.929612] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-21T18:06:08.967204] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-21T18:06:08.974666] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-21T18:06:08.991450] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-21T18:06:09.208372] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:06:09.462937] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:06:09.750993] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-21T18:06:09.829104] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T18:06:10.120408] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-21T18:06:10.551074] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-21T18:06:10.875238] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-21T18:06:11.351081] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-21T18:06:12.031229] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T18:06:12.151023] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-21T18:06:12.933043] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-21T18:06:12.951032] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-21T18:06:13.124798] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-21T18:06:13.701882] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-21T18:06:13.751094] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-21T18:06:14.503728] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-21T18:06:14.551045] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-21T18:06:15.347130] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-21T18:06:15.350982] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-21T18:06:15.995871] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-21T18:06:16.151027] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-21T18:06:16.951038] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-21T18:06:17.751058] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-10-21T18:06:17.826213] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T18:06:17.947341] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T18:06:17.947743] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-10-21T18:06:17.947829] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:06:17.947885] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-21T18:06:17.947955] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:06:17.948067] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-21T18:06:17.948165] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-21T18:06:17.948242] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-21T18:06:17.948322] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-21T18:06:17.948378] [INFO ] [MAIN ] Update Progress: 525/2366 symbols completed. CRCL took 9.7s. Estimated remaining: 3h 52m 15s. Rate: 7.9 symbols/min [2025-10-21T18:06:18.118940] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:06:18.167134] [DEBUG] [LOCAL ] CRGY: Loaded 52514 existing records from primary storage. [2025-10-21T18:06:18.167431] [INFO ] [MAIN ] CRGY: Loaded 52514 existing records. [2025-10-21T18:06:18.350016] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:06:18.350296] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-21T18:06:18.350347] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-21T18:06:18.350522] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-21T18:06:18.350573] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-21T18:06:18.561305] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-21T18:06:18.715753] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:06:18.747336] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T18:06:19.351025] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-21T18:06:20.054024] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-21T18:06:20.151002] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-21T18:06:20.812378] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-21T18:06:20.907789] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T18:06:20.951085] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-21T18:06:21.751072] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-21T18:06:22.550999] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-21T18:06:22.567544] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-21T18:06:22.599323] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T18:06:23.351081] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-21T18:06:23.958194] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T18:06:24.151056] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-21T18:06:24.737452] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-21T18:06:24.739062] [INFO ] [REMOTE ] CRBD: Full fetch complete (12973 records). [2025-10-21T18:06:24.739128] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-21T18:06:24.739488] [FATAL] [VALIDATOR ] CRBD: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:06:24.739567] [FATAL] [MAIN ] CRBD: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:06:24.739608] [WARN ] [MAIN ] CRBD: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:06:24.739695] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-21T18:06:24.739761] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-10-21T18:06:24.739796] [INFO ] [LOCAL ] CRBD: Starting deletion of derivative data. [2025-10-21T18:06:24.739945] [DEBUG] [LOCAL ] CRBD: Deleted derivative data file. [2025-10-21T18:06:24.740027] [INFO ] [MAIN ] Update Progress: 526/2366 symbols completed. CRBD took 22.1s. Estimated remaining: 3h 52m 5s. Rate: 7.9 symbols/min [2025-10-21T18:06:24.918080] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:06:24.951276] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-21T18:06:24.968418] [DEBUG] [LOCAL ] CRH: Loaded 53439 existing records from primary storage. [2025-10-21T18:06:24.968856] [INFO ] [MAIN ] CRH: Loaded 53439 existing records. [2025-10-21T18:06:25.152603] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:06:25.152961] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-21T18:06:25.153033] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-21T18:06:25.153561] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-21T18:06:25.168533] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-21T18:06:25.262551] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T18:06:25.565899] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:06:25.751046] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-21T18:06:26.550995] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-21T18:06:26.672730] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T18:06:26.836759] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T18:06:27.351039] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-21T18:06:28.151038] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-21T18:06:28.574412] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-21T18:06:28.844379] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T18:06:28.951062] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-21T18:06:29.751011] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-21T18:06:30.020408] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T18:06:30.551002] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-21T18:06:30.751931] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T18:06:31.317887] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-21T18:06:31.351024] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-21T18:06:31.900170] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T18:06:32.151046] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-21T18:06:32.950981] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-21T18:06:33.398319] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-21T18:06:33.657398] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-21T18:06:33.751013] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-21T18:06:34.551105] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-21T18:06:34.840027] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T18:06:35.082568] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T18:06:35.351043] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-21T18:06:35.824998] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-21T18:06:36.151040] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-21T18:06:36.951926] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T18:06:36.952036] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-21T18:06:37.751064] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-21T18:06:37.819175] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T18:06:38.551045] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-21T18:06:38.809504] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-21T18:06:38.817747] [INFO ] [REMOTE ] CRBG: Full fetch complete (76042 records). [2025-10-21T18:06:38.817864] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-21T18:06:39.201010] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-21T18:06:39.201170] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-21T18:06:39.202097] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-21T18:06:39.202159] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-21T18:06:39.203491] [DEBUG] [LOCAL ] CRBG: Trimmed 76042 records to 52602 (keeping 200 days of data) [2025-10-21T18:06:39.375800] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-21T18:06:39.532555] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T18:06:39.563754] [DEBUG] [LOCAL ] CRBG: Primary data saved (52602 records). [2025-10-21T18:06:39.563867] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-21T18:06:39.564569] [INFO ] [MAIN ] Update Progress: 527/2366 symbols completed. CRBG took 34.5s. Estimated remaining: 3h 52m 23s. Rate: 7.9 symbols/min [2025-10-21T18:06:39.732405] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:06:39.776680] [DEBUG] [LOCAL ] CRI: Loaded 49604 existing records from primary storage. [2025-10-21T18:06:39.776968] [INFO ] [MAIN ] CRI: Loaded 49604 existing records. [2025-10-21T18:06:39.950233] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:06:39.950415] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-21T18:06:39.950460] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-21T18:06:39.950920] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-21T18:06:39.950975] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-21T18:06:40.159612] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-21T18:06:40.312817] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:06:40.464236] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T18:06:40.879399] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-21T18:06:40.886279] [INFO ] [REMOTE ] CRC: Full fetch complete (62937 records). [2025-10-21T18:06:40.886394] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-21T18:06:40.959804] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-21T18:06:41.268576] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-21T18:06:41.268694] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-21T18:06:41.269469] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-21T18:06:41.269510] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-21T18:06:41.270769] [DEBUG] [LOCAL ] CRC: Trimmed 62937 records to 44159 (keeping 200 days of data) [2025-10-21T18:06:41.531573] [DEBUG] [LOCAL ] CRC: Primary data saved (44159 records). [2025-10-21T18:06:41.531715] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-21T18:06:41.531799] [INFO ] [MAIN ] Update Progress: 528/2366 symbols completed. CRC took 33.5s. Estimated remaining: 3h 51m 55s. Rate: 7.9 symbols/min [2025-10-21T18:06:41.697940] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:06:41.748468] [DEBUG] [LOCAL ] CRK: Loaded 52250 existing records from primary storage. [2025-10-21T18:06:41.748819] [INFO ] [MAIN ] CRK: Loaded 52250 existing records. [2025-10-21T18:06:41.764680] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-21T18:06:41.961950] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:06:41.962204] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-21T18:06:41.962277] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-21T18:06:41.963167] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-21T18:06:41.963225] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-21T18:06:42.284851] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-21T18:06:42.400007] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:06:42.551031] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-21T18:06:42.812674] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-21T18:06:43.351000] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-21T18:06:43.524617] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T18:06:44.151067] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-21T18:06:44.326195] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T18:06:44.951025] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-21T18:06:45.206025] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-21T18:06:45.751010] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-21T18:06:45.884882] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T18:06:46.527880] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T18:06:46.551022] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-21T18:06:47.088083] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T18:06:47.351069] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-21T18:06:48.150998] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-21T18:06:48.189363] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T18:06:48.951073] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-21T18:06:49.115902] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-21T18:06:49.423411] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-21T18:06:49.751059] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-21T18:06:50.269054] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T18:06:50.551056] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-21T18:06:51.351102] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-21T18:06:51.649862] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T18:06:51.658252] [INFO ] [REMOTE ] CRGY: Full fetch complete (76149 records). [2025-10-21T18:06:51.658364] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-21T18:06:52.053285] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-21T18:06:52.053424] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-21T18:06:52.054305] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-21T18:06:52.054368] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-21T18:06:52.055765] [DEBUG] [LOCAL ] CRGY: Trimmed 76149 records to 52503 (keeping 200 days of data) [2025-10-21T18:06:52.152702] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-21T18:06:52.374999] [DEBUG] [LOCAL ] CRGY: Primary data saved (52503 records). [2025-10-21T18:06:52.375188] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-21T18:06:52.376032] [INFO ] [MAIN ] Update Progress: 529/2366 symbols completed. CRGY took 34.4s. Estimated remaining: 3h 51m 59s. Rate: 7.9 symbols/min [2025-10-21T18:06:52.559404] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:06:52.589562] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-21T18:06:52.641792] [DEBUG] [LOCAL ] CRL: Loaded 42666 existing records from primary storage. [2025-10-21T18:06:52.642113] [INFO ] [MAIN ] CRL: Loaded 42666 existing records. [2025-10-21T18:06:52.831789] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:06:52.832083] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-21T18:06:52.832133] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-21T18:06:52.832790] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-21T18:06:52.832850] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-21T18:06:52.956138] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-21T18:06:53.205740] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:06:53.238752] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T18:06:53.751077] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-21T18:06:53.917192] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-21T18:06:54.550987] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-21T18:06:54.652109] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T18:06:55.350995] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-21T18:06:55.640159] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T18:06:56.161531] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-21T18:06:56.167185] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T18:06:56.917400] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T18:06:56.950980] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-21T18:06:57.751000] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-21T18:06:57.908631] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T18:06:58.550996] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-21T18:06:58.654958] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T18:06:59.351094] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-21T18:06:59.723612] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-21T18:06:59.736111] [INFO ] [REMOTE ] CRH: Full fetch complete (77549 records). [2025-10-21T18:06:59.736317] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-21T18:07:00.166498] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-21T18:07:00.193726] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-21T18:07:00.195604] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T18:07:00.194440] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-21T18:07:00.208067] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-21T18:07:00.208682] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-21T18:07:00.210418] [DEBUG] [LOCAL ] CRH: Trimmed 77549 records to 53435 (keeping 200 days of data) [2025-10-21T18:07:00.539592] [DEBUG] [LOCAL ] CRH: Primary data saved (53435 records). [2025-10-21T18:07:00.539758] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-21T18:07:00.540301] [INFO ] [MAIN ] Update Progress: 530/2366 symbols completed. CRH took 35.8s. Estimated remaining: 3h 51m 54s. Rate: 7.9 symbols/min [2025-10-21T18:07:00.706371] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:07:00.763607] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-21T18:07:00.764496] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-10-21T18:07:00.942054] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:07:00.942440] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-21T18:07:00.942629] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-21T18:07:00.943991] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-21T18:07:00.944055] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-21T18:07:00.973990] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-21T18:07:01.335636] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:07:01.339071] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-21T18:07:01.751011] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-21T18:07:01.915035] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T18:07:02.551005] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-21T18:07:02.655812] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T18:07:03.100512] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T18:07:03.351021] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-21T18:07:04.151054] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-21T18:07:04.334686] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T18:07:04.883624] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T18:07:04.891314] [INFO ] [REMOTE ] CRI: Full fetch complete (70916 records). [2025-10-21T18:07:04.891456] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-21T18:07:04.960283] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-21T18:07:05.327584] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-21T18:07:05.327705] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-21T18:07:05.328695] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-21T18:07:05.328758] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-21T18:07:05.330314] [DEBUG] [LOCAL ] CRI: Trimmed 70916 records to 49512 (keeping 200 days of data) [2025-10-21T18:07:05.674066] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T18:07:05.697728] [DEBUG] [LOCAL ] CRI: Primary data saved (49512 records). [2025-10-21T18:07:05.697847] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-21T18:07:05.698792] [INFO ] [MAIN ] Update Progress: 531/2366 symbols completed. CRI took 26.1s. Estimated remaining: 3h 51m 38s. Rate: 7.9 symbols/min [2025-10-21T18:07:05.759984] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-21T18:07:05.887373] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:07:05.932514] [DEBUG] [LOCAL ] CRS: Loaded 43124 existing records from primary storage. [2025-10-21T18:07:05.932870] [INFO ] [MAIN ] CRS: Loaded 43124 existing records. [2025-10-21T18:07:06.138107] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:07:06.138345] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-21T18:07:06.138395] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-21T18:07:06.138906] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-21T18:07:06.138965] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-21T18:07:06.534476] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:07:06.550990] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-21T18:07:07.350995] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-21T18:07:07.599890] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-10-21T18:07:07.710159] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-21T18:07:07.718446] [INFO ] [REMOTE ] CRK: Full fetch complete (75824 records). [2025-10-21T18:07:07.718573] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-21T18:07:08.105681] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-21T18:07:08.105828] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-21T18:07:08.107039] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-21T18:07:08.107145] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-21T18:07:08.108874] [DEBUG] [LOCAL ] CRK: Trimmed 75824 records to 52233 (keeping 200 days of data) [2025-10-21T18:07:08.155730] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-21T18:07:08.352205] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T18:07:08.453587] [DEBUG] [LOCAL ] CRK: Primary data saved (52233 records). [2025-10-21T18:07:08.453752] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-21T18:07:08.453840] [INFO ] [MAIN ] Update Progress: 532/2366 symbols completed. CRK took 26.9s. Estimated remaining: 3h 51m 14s. Rate: 7.9 symbols/min [2025-10-21T18:07:08.620390] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:07:08.626460] [DEBUG] [LOCAL ] CRT: Loaded 4802 existing records from primary storage. [2025-10-21T18:07:08.626677] [INFO ] [MAIN ] CRT: Loaded 4802 existing records. [2025-10-21T18:07:08.810683] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:07:08.811165] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-21T18:07:08.811245] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-21T18:07:08.811487] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-21T18:07:08.811553] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-21T18:07:08.954328] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-21T18:07:09.206418] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:07:09.208339] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T18:07:09.751051] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-21T18:07:10.551409] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-21T18:07:10.577184] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T18:07:10.642594] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-21T18:07:11.017171] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-21T18:07:11.166315] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-21T18:07:11.351039] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-21T18:07:12.151038] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-21T18:07:12.951036] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-21T18:07:13.013465] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T18:07:13.241211] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T18:07:13.751035] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-21T18:07:14.551021] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-21T18:07:15.126398] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T18:07:15.351000] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-21T18:07:15.420779] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-21T18:07:15.876351] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-21T18:07:16.150992] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-21T18:07:16.452999] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T18:07:16.951032] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-21T18:07:17.653061] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T18:07:17.750994] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-21T18:07:18.551076] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-21T18:07:18.979944] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-21T18:07:19.351057] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-21T18:07:19.579912] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T18:07:20.151032] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-21T18:07:20.762623] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T18:07:20.901012] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-21T18:07:20.950989] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-21T18:07:21.142992] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-21T18:07:21.495906] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-21T18:07:21.751072] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-21T18:07:22.278775] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-21T18:07:22.551064] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-21T18:07:23.351074] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-21T18:07:24.151028] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-21T18:07:24.922280] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-21T18:07:24.949751] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-21T18:07:24.957887] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-21T18:07:25.038015] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-21T18:07:25.751002] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-21T18:07:26.184262] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-21T18:07:26.548790] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T18:07:26.557265] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-21T18:07:27.351052] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-21T18:07:28.151028] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-21T18:07:28.813586] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T18:07:28.853981] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-21T18:07:28.951058] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-21T18:07:29.013676] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-21T18:07:29.686900] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-21T18:07:29.688255] [INFO ] [REMOTE ] CRT: Full fetch complete (7334 records). [2025-10-21T18:07:29.688338] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-21T18:07:29.756159] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-21T18:07:30.058509] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-21T18:07:30.058608] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-21T18:07:30.058873] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-21T18:07:30.058930] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-21T18:07:30.059315] [DEBUG] [LOCAL ] CRT: Trimmed 7334 records to 4791 (keeping 200 days of data) [2025-10-21T18:07:30.087626] [DEBUG] [LOCAL ] CRT: Primary data saved (4791 records). [2025-10-21T18:07:30.087787] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-21T18:07:30.087869] [INFO ] [MAIN ] Update Progress: 533/2366 symbols completed. CRT took 21.6s. Estimated remaining: 3h 51m 54s. Rate: 7.9 symbols/min [2025-10-21T18:07:30.268537] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:07:30.311689] [DEBUG] [LOCAL ] CSAN: Loaded 42287 existing records from primary storage. [2025-10-21T18:07:30.311986] [INFO ] [MAIN ] CSAN: Loaded 42287 existing records. [2025-10-21T18:07:30.521496] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:07:30.521802] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-21T18:07:30.521857] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-21T18:07:30.522244] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-21T18:07:30.522302] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-21T18:07:30.563253] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-21T18:07:31.036700] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:07:31.351077] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-21T18:07:31.866824] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-21T18:07:32.151019] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-21T18:07:32.424710] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T18:07:32.513194] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-21T18:07:32.520084] [INFO ] [REMOTE ] CRL: Full fetch complete (63564 records). [2025-10-21T18:07:32.520220] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-21T18:07:32.901564] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-21T18:07:32.901635] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-21T18:07:32.902399] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-21T18:07:32.902444] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-21T18:07:32.903591] [DEBUG] [LOCAL ] CRL: Trimmed 63564 records to 42659 (keeping 200 days of data) [2025-10-21T18:07:32.953759] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-21T18:07:33.159374] [DEBUG] [LOCAL ] CRL: Primary data saved (42659 records). [2025-10-21T18:07:33.159508] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-21T18:07:33.160041] [INFO ] [MAIN ] Update Progress: 534/2366 symbols completed. CRL took 40.8s. Estimated remaining: 3h 51m 31s. Rate: 7.9 symbols/min [2025-10-21T18:07:33.330061] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:07:33.363135] [DEBUG] [LOCAL ] CSL: Loaded 31310 existing records from primary storage. [2025-10-21T18:07:33.363392] [INFO ] [MAIN ] CSL: Loaded 31310 existing records. [2025-10-21T18:07:33.537786] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:07:33.537977] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-21T18:07:33.538053] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-21T18:07:33.538375] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-21T18:07:33.538442] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-21T18:07:33.756569] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-21T18:07:33.892577] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:07:34.444675] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-21T18:07:34.497829] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T18:07:34.550982] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-21T18:07:35.351068] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-21T18:07:35.590719] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-21T18:07:35.796391] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T18:07:36.151028] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-21T18:07:36.667572] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T18:07:36.951022] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-21T18:07:37.681206] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T18:07:37.751006] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-21T18:07:38.551079] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-21T18:07:39.351060] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-21T18:07:39.529358] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T18:07:39.535767] [INFO ] [REMOTE ] CRS: Full fetch complete (62543 records). [2025-10-21T18:07:39.535891] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-21T18:07:39.968249] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-21T18:07:39.968443] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-21T18:07:39.964750] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (3.01 seconds). [2025-10-21T18:07:39.969800] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-21T18:07:39.980357] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-21T18:07:39.982913] [DEBUG] [LOCAL ] CRS: Trimmed 62543 records to 43115 (keeping 200 days of data) [2025-10-21T18:07:40.100195] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T18:07:40.197015] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-21T18:07:40.291057] [DEBUG] [LOCAL ] CRS: Primary data saved (43115 records). [2025-10-21T18:07:40.291185] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-21T18:07:40.291281] [INFO ] [MAIN ] Update Progress: 535/2366 symbols completed. CRS took 34.6s. Estimated remaining: 3h 51m 22s. Rate: 7.9 symbols/min [2025-10-21T18:07:40.461731] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:07:40.486409] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-21T18:07:40.497589] [DEBUG] [LOCAL ] CSR: Loaded 13476 existing records from primary storage. [2025-10-21T18:07:40.498452] [INFO ] [MAIN ] CSR: Loaded 13476 existing records. [2025-10-21T18:07:40.672085] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:07:40.672294] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-21T18:07:40.672340] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-21T18:07:40.672503] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-21T18:07:40.672558] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-21T18:07:40.961261] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-21T18:07:41.050857] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:07:41.189340] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T18:07:41.197849] [INFO ] [REMOTE ] CRM: Full fetch complete (77946 records). [2025-10-21T18:07:41.198050] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-21T18:07:41.626330] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-21T18:07:41.626408] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-21T18:07:41.627273] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-21T18:07:41.627335] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-21T18:07:41.628707] [DEBUG] [LOCAL ] CRM: Trimmed 77946 records to 53770 (keeping 200 days of data) [2025-10-21T18:07:41.751673] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-21T18:07:41.967785] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-10-21T18:07:41.967903] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-21T18:07:41.968848] [INFO ] [MAIN ] Update Progress: 536/2366 symbols completed. CRM took 41.4s. Estimated remaining: 3h 50m 54s. Rate: 7.9 symbols/min [2025-10-21T18:07:42.144454] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:07:42.190170] [DEBUG] [LOCAL ] CSTM: Loaded 47473 existing records from primary storage. [2025-10-21T18:07:42.190448] [INFO ] [MAIN ] CSTM: Loaded 47473 existing records. [2025-10-21T18:07:42.374819] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:07:42.375159] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-21T18:07:42.375263] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-21T18:07:42.375879] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-21T18:07:42.375941] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-21T18:07:42.555953] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T18:07:42.556020] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-21T18:07:42.753570] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T18:07:42.795459] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:07:43.351025] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-21T18:07:44.151021] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-21T18:07:44.402111] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T18:07:44.845143] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T18:07:44.950989] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-21T18:07:45.751080] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-21T18:07:45.942599] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T18:07:46.444344] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-21T18:07:46.551066] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-21T18:07:47.353230] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-21T18:07:47.358225] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T18:07:47.781291] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-21T18:07:48.151052] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-21T18:07:48.888108] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-21T18:07:48.950988] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-21T18:07:49.469870] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-21T18:07:49.751033] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-21T18:07:50.164422] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T18:07:50.550998] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-21T18:07:50.869814] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-21T18:07:51.351017] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-21T18:07:52.137549] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T18:07:52.150985] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-21T18:07:52.879708] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T18:07:52.885777] [INFO ] [REMOTE ] CSAN: Full fetch complete (60273 records). [2025-10-21T18:07:52.885891] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-21T18:07:52.956112] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-21T18:07:53.282326] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-21T18:07:53.282457] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-21T18:07:53.283249] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-21T18:07:53.283344] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-21T18:07:53.284554] [DEBUG] [LOCAL ] CSAN: Trimmed 60273 records to 42270 (keeping 200 days of data) [2025-10-21T18:07:53.539868] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T18:07:53.567447] [DEBUG] [LOCAL ] CSAN: Primary data saved (42270 records). [2025-10-21T18:07:53.567596] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-21T18:07:53.568069] [INFO ] [MAIN ] Update Progress: 537/2366 symbols completed. CSAN took 23.5s. Estimated remaining: 3h 51m 1s. Rate: 7.9 symbols/min [2025-10-21T18:07:53.738456] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:07:53.751510] [DEBUG] [LOCAL ] CSV: Loaded 12576 existing records from primary storage. [2025-10-21T18:07:53.751782] [INFO ] [MAIN ] CSV: Loaded 12576 existing records. [2025-10-21T18:07:53.751189] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-21T18:07:53.929060] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:07:53.929265] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-21T18:07:53.929312] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-21T18:07:53.929460] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-21T18:07:53.929498] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-21T18:07:54.289202] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:07:54.501440] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T18:07:54.550988] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-21T18:07:55.305069] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T18:07:55.351000] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-21T18:07:55.928785] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T18:07:56.151014] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-21T18:07:56.769556] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-21T18:07:56.951025] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-21T18:07:57.139472] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T18:07:57.751024] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-21T18:07:57.943442] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-21T18:07:58.551025] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-21T18:07:58.854756] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-21T18:07:59.351054] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-21T18:07:59.489225] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-21T18:08:00.151059] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-21T18:08:00.777268] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T18:08:00.782410] [INFO ] [REMOTE ] CSL: Full fetch complete (45652 records). [2025-10-21T18:08:00.782506] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-21T18:08:00.966057] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-21T18:08:01.023548] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-21T18:08:01.186028] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-21T18:08:01.186118] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-21T18:08:01.186789] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-21T18:08:01.186855] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-21T18:08:01.187997] [DEBUG] [LOCAL ] CSL: Trimmed 45652 records to 31256 (keeping 200 days of data) [2025-10-21T18:08:01.384420] [DEBUG] [LOCAL ] CSL: Primary data saved (31256 records). [2025-10-21T18:08:01.384567] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-21T18:08:01.385372] [INFO ] [MAIN ] Update Progress: 538/2366 symbols completed. CSL took 28.2s. Estimated remaining: 3h 50m 54s. Rate: 7.9 symbols/min [2025-10-21T18:08:01.562986] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:08:01.563150] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-21T18:08:01.563188] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-21T18:08:01.563300] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-21T18:08:01.563342] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-21T18:08:01.563382] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-21T18:08:01.563414] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-21T18:08:01.756389] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-21T18:08:01.957552] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:08:02.550984] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-21T18:08:02.714731] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T18:08:02.913011] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-21T18:08:03.269002] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-21T18:08:03.351034] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-21T18:08:04.151055] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-10-21T18:08:04.339312] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T18:08:04.339598] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-10-21T18:08:04.339715] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:08:04.339813] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-21T18:08:04.339880] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:08:04.339950] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-21T18:08:04.340013] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-21T18:08:04.340049] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-21T18:08:04.340086] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-21T18:08:04.340132] [INFO ] [MAIN ] Update Progress: 539/2366 symbols completed. CSW took 3.0s. Estimated remaining: 3h 50m 31s. Rate: 7.9 symbols/min [2025-10-21T18:08:04.517536] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:08:04.526669] [DEBUG] [LOCAL ] CTBB: Loaded 6573 existing records from primary storage. [2025-10-21T18:08:04.526887] [INFO ] [MAIN ] CTBB: Loaded 6573 existing records. [2025-10-21T18:08:04.709115] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:08:04.709551] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-21T18:08:04.709628] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-21T18:08:04.709980] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-21T18:08:04.710044] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-21T18:08:04.956111] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-21T18:08:04.984401] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T18:08:05.125603] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:08:05.750998] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-21T18:08:05.900241] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T18:08:06.476847] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-21T18:08:06.551020] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-21T18:08:07.149081] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-21T18:08:07.351084] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-21T18:08:08.150994] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-21T18:08:08.529741] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T18:08:08.951043] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-21T18:08:09.162282] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-21T18:08:09.547848] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-21T18:08:09.751075] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-21T18:08:10.539041] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-21T18:08:10.550980] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-21T18:08:11.351009] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-21T18:08:11.484944] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-21T18:08:11.919892] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-21T18:08:12.151043] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-21T18:08:12.803230] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-21T18:08:12.951026] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-21T18:08:13.440332] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-21T18:08:13.751023] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-21T18:08:14.551075] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-21T18:08:14.670250] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-21T18:08:15.351008] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-21T18:08:15.476809] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-21T18:08:15.981766] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-21T18:08:16.151075] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-21T18:08:16.950983] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-21T18:08:17.182110] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-21T18:08:17.524029] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-21T18:08:17.751041] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-21T18:08:18.551062] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-21T18:08:18.812320] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-21T18:08:18.815228] [INFO ] [REMOTE ] CSR: Full fetch complete (17945 records). [2025-10-21T18:08:18.815310] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-21T18:08:19.203453] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-21T18:08:19.203533] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-21T18:08:19.203972] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-21T18:08:19.204042] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-21T18:08:19.204617] [DEBUG] [LOCAL ] CSR: Trimmed 17945 records to 13477 (keeping 200 days of data) [2025-10-21T18:08:19.303305] [DEBUG] [LOCAL ] CSR: Primary data saved (13477 records). [2025-10-21T18:08:19.303476] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-21T18:08:19.303573] [INFO ] [MAIN ] Update Progress: 540/2366 symbols completed. CSR took 39.0s. Estimated remaining: 3h 50m 48s. Rate: 7.9 symbols/min [2025-10-21T18:08:19.357271] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-21T18:08:19.474930] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:08:19.483823] [DEBUG] [LOCAL ] CTDD: Loaded 5284 existing records from primary storage. [2025-10-21T18:08:19.484044] [INFO ] [MAIN ] CTDD: Loaded 5284 existing records. [2025-10-21T18:08:19.658236] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:08:19.658476] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-21T18:08:19.658525] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-21T18:08:19.658744] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-21T18:08:19.658803] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-21T18:08:20.017104] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:08:20.119079] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-21T18:08:20.121236] [INFO ] [REMOTE ] CSV: Full fetch complete (19065 records). [2025-10-21T18:08:20.121319] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-21T18:08:20.156120] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-21T18:08:20.427306] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T18:08:20.473523] [INFO ] [REMOTE ] CSTM: Full fetch complete (69534 records). [2025-10-21T18:08:20.484518] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-21T18:08:20.651565] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-21T18:08:20.657141] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-21T18:08:20.669086] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-21T18:08:20.669216] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-21T18:08:20.686024] [DEBUG] [LOCAL ] CSV: Trimmed 19065 records to 12501 (keeping 200 days of data) [2025-10-21T18:08:20.954342] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-21T18:08:20.978545] [DEBUG] [LOCAL ] CSV: Primary data saved (12501 records). [2025-10-21T18:08:20.979815] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-21T18:08:20.980048] [INFO ] [MAIN ] Update Progress: 541/2366 symbols completed. CSV took 27.4s. Estimated remaining: 3h 50m 21s. Rate: 7.9 symbols/min [2025-10-21T18:08:21.034534] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-21T18:08:21.174608] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-21T18:08:21.174764] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-21T18:08:21.176040] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-21T18:08:21.176127] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-21T18:08:21.247190] [DEBUG] [LOCAL ] CSTM: Trimmed 69534 records to 47446 (keeping 200 days of data) [2025-10-21T18:08:21.250232] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:08:21.250547] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-21T18:08:21.250918] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-21T18:08:21.251317] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-21T18:08:21.251369] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-21T18:08:21.251412] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-21T18:08:21.251443] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-21T18:08:21.756114] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-21T18:08:21.786555] [DEBUG] [LOCAL ] CSTM: Primary data saved (47446 records). [2025-10-21T18:08:21.792584] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-21T18:08:21.808560] [INFO ] [MAIN ] Update Progress: 542/2366 symbols completed. CSTM took 39.8s. Estimated remaining: 3h 49m 50s. Rate: 7.9 symbols/min [2025-10-21T18:08:21.980980] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T18:08:22.029338] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:08:22.096095] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:08:22.096305] [DEBUG] [LOCAL ] CTO: No existing data file found in primary storage. [2025-10-21T18:08:22.096343] [WARN ] [MAIN ] CTO: No existing data found, performing full refresh instead. [2025-10-21T18:08:22.096457] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-21T18:08:22.096499] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-21T18:08:22.096538] [DEBUG] [LOCAL ] CTO: No primary data file found to delete. [2025-10-21T18:08:22.096569] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-21T18:08:22.452119] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-21T18:08:22.480613] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:08:22.551063] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-21T18:08:23.351080] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-21T18:08:23.615579] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T18:08:24.124546] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-21T18:08:24.151079] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-21T18:08:24.925818] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-21T18:08:24.950982] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-21T18:08:25.404639] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-21T18:08:25.751032] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-21T18:08:26.551038] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-21T18:08:27.023506] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-21T18:08:27.024276] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T18:08:27.351120] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-21T18:08:28.151064] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-21T18:08:28.522556] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-21T18:08:28.951050] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-21T18:08:29.018234] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T18:08:29.658602] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-21T18:08:29.751001] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-21T18:08:30.398663] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-21T18:08:30.551014] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-21T18:08:31.179183] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-21T18:08:31.350990] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-21T18:08:32.151045] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-21T18:08:32.549856] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-21T18:08:32.871488] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T18:08:32.951081] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-21T18:08:33.751034] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-10-21T18:08:33.950323] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T18:08:33.950623] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-10-21T18:08:33.950754] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:08:33.950803] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-21T18:08:33.950834] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:08:33.950898] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-21T18:08:33.950959] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-21T18:08:33.950993] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-21T18:08:33.951031] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-21T18:08:33.951076] [INFO ] [MAIN ] Update Progress: 543/2366 symbols completed. CTEV took 13.0s. Estimated remaining: 3h 49m 58s. Rate: 7.9 symbols/min [2025-10-21T18:08:34.119137] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:08:34.138374] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T18:08:34.169584] [DEBUG] [LOCAL ] CTOS: Loaded 37326 existing records from primary storage. [2025-10-21T18:08:34.169881] [INFO ] [MAIN ] CTOS: Loaded 37326 existing records. [2025-10-21T18:08:34.346945] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:08:34.347181] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-21T18:08:34.347234] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-21T18:08:34.347861] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-21T18:08:34.347917] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-21T18:08:34.556183] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-21T18:08:34.700416] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:08:35.087119] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-21T18:08:35.351035] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-21T18:08:35.943874] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-21T18:08:35.945595] [INFO ] [REMOTE ] CTDD: Full fetch complete (7924 records). [2025-10-21T18:08:35.945763] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-21T18:08:36.156881] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-21T18:08:36.305455] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-21T18:08:36.305529] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-21T18:08:36.305801] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-21T18:08:36.305861] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-21T18:08:36.306233] [DEBUG] [LOCAL ] CTDD: Trimmed 7924 records to 5258 (keeping 200 days of data) [2025-10-21T18:08:36.336570] [DEBUG] [LOCAL ] CTDD: Primary data saved (5258 records). [2025-10-21T18:08:36.336637] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-21T18:08:36.336745] [INFO ] [MAIN ] Update Progress: 544/2366 symbols completed. CTDD took 17.0s. Estimated remaining: 3h 49m 33s. Rate: 7.9 symbols/min [2025-10-21T18:08:36.504245] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:08:36.504419] [DEBUG] [LOCAL ] CTRA: No existing data file found in primary storage. [2025-10-21T18:08:36.504456] [WARN ] [MAIN ] CTRA: No existing data found, performing full refresh instead. [2025-10-21T18:08:36.504557] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-21T18:08:36.504597] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-21T18:08:36.504636] [DEBUG] [LOCAL ] CTRA: No primary data file found to delete. [2025-10-21T18:08:36.504708] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-21T18:08:36.848982] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:08:36.950983] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-21T18:08:37.092509] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T18:08:37.094707] [INFO ] [REMOTE ] CTBB: Full fetch complete (10066 records). [2025-10-21T18:08:37.094882] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-21T18:08:37.479028] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-21T18:08:37.479108] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-21T18:08:37.479340] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-21T18:08:37.479379] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-21T18:08:37.479820] [DEBUG] [LOCAL ] CTBB: Trimmed 10066 records to 6539 (keeping 200 days of data) [2025-10-21T18:08:37.518370] [DEBUG] [LOCAL ] CTBB: Primary data saved (6539 records). [2025-10-21T18:08:37.518489] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-21T18:08:37.518573] [INFO ] [MAIN ] Update Progress: 545/2366 symbols completed. CTBB took 33.2s. Estimated remaining: 3h 49m 4s. Rate: 7.9 symbols/min [2025-10-21T18:08:37.682603] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:08:37.727183] [DEBUG] [LOCAL ] CTRE: Loaded 49507 existing records from primary storage. [2025-10-21T18:08:37.727480] [INFO ] [MAIN ] CTRE: Loaded 49507 existing records. [2025-10-21T18:08:37.757463] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-21T18:08:37.925121] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:08:37.925318] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-21T18:08:37.925364] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-21T18:08:37.926123] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-21T18:08:37.926181] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-21T18:08:38.277948] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:08:38.551033] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-21T18:08:38.993181] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-21T18:08:39.057441] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T18:08:39.351037] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-21T18:08:39.929062] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T18:08:40.151032] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-21T18:08:40.433407] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T18:08:40.951073] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-21T18:08:41.751011] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-21T18:08:41.888687] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T18:08:42.126844] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T18:08:42.551012] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-21T18:08:43.351072] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-21T18:08:43.445489] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T18:08:44.151004] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-21T18:08:44.721210] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-21T18:08:44.885849] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T18:08:44.951070] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-21T18:08:45.054324] [DEBUG] [REMOTE ] CTOS: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-21T18:08:45.054797] [WARN ] [REMOTE ] CTOS: No data returned for month 2025-04 [2025-10-21T18:08:45.054929] [FATAL] [REMOTE ] CTOS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:08:45.055025] [FATAL] [MAIN ] CTOS: Failed to fetch primary data. [2025-10-21T18:08:45.055089] [WARN ] [MAIN ] CTOS: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:08:45.055169] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-21T18:08:45.055244] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-21T18:08:45.055283] [INFO ] [LOCAL ] CTOS: Starting deletion of derivative data. [2025-10-21T18:08:45.055543] [DEBUG] [LOCAL ] CTOS: Deleted derivative data file. [2025-10-21T18:08:45.055663] [INFO ] [MAIN ] Update Progress: 546/2366 symbols completed. CTOS took 11.1s. Estimated remaining: 3h 48m 57s. Rate: 7.9 symbols/min [2025-10-21T18:08:45.226796] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:08:45.263846] [DEBUG] [LOCAL ] CTRI: Loaded 40518 existing records from primary storage. [2025-10-21T18:08:45.264118] [INFO ] [MAIN ] CTRI: Loaded 40518 existing records. [2025-10-21T18:08:45.464345] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-21T18:08:45.496340] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:08:45.497478] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-21T18:08:45.498098] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-21T18:08:45.498599] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-21T18:08:45.498701] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-21T18:08:45.756259] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-21T18:08:45.854294] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:08:46.551070] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-21T18:08:47.062340] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-21T18:08:47.351000] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-21T18:08:47.549405] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T18:08:48.151062] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-21T18:08:48.951096] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-21T18:08:49.318805] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-21T18:08:49.492744] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-21T18:08:49.758353] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-21T18:08:49.762505] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-21T18:08:50.551022] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-21T18:08:51.133331] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T18:08:51.138405] [INFO ] [REMOTE ] CTO: Full fetch complete (41356 records). [2025-10-21T18:08:51.138512] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-21T18:08:51.356266] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-21T18:08:51.512670] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-21T18:08:51.512756] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-21T18:08:51.513330] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-21T18:08:51.513371] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-21T18:08:51.514202] [DEBUG] [LOCAL ] CTO: Trimmed 41356 records to 27425 (keeping 200 days of data) [2025-10-21T18:08:51.673870] [DEBUG] [LOCAL ] CTO: Primary data saved (27425 records). [2025-10-21T18:08:51.673988] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-21T18:08:51.674057] [INFO ] [MAIN ] Update Progress: 547/2366 symbols completed. CTO took 29.9s. Estimated remaining: 3h 48m 46s. Rate: 8.0 symbols/min [2025-10-21T18:08:51.845597] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:08:51.845877] [DEBUG] [LOCAL ] CTS: No existing data file found in primary storage. [2025-10-21T18:08:51.845950] [WARN ] [MAIN ] CTS: No existing data found, performing full refresh instead. [2025-10-21T18:08:51.846185] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-21T18:08:51.846252] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-21T18:08:51.846393] [DEBUG] [LOCAL ] CTS: No primary data file found to delete. [2025-10-21T18:08:51.846443] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-21T18:08:51.964098] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-21T18:08:52.153056] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-21T18:08:52.232592] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:08:52.950995] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-21T18:08:53.107592] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-21T18:08:53.175884] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-21T18:08:53.751060] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-21T18:08:54.551043] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-21T18:08:54.895466] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T18:08:55.351089] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-21T18:08:55.600484] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T18:08:55.641772] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T18:08:56.151076] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-21T18:08:56.888520] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T18:08:56.950980] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-21T18:08:57.751066] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-21T18:08:57.910721] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T18:08:58.403811] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T18:08:58.551037] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-21T18:08:59.351070] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-21T18:08:59.489687] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T18:08:59.600400] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T18:09:00.151041] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-21T18:09:00.951033] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-21T18:09:01.759156] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-21T18:09:01.765985] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-21T18:09:01.855904] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T18:09:02.468008] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T18:09:02.550997] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-21T18:09:02.740204] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T18:09:03.351026] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-21T18:09:04.151049] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-21T18:09:04.665890] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-21T18:09:04.951065] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-21T18:09:05.177327] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T18:09:05.313360] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-21T18:09:05.751040] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-21T18:09:06.544756] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-21T18:09:06.555901] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-21T18:09:07.069452] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T18:09:07.351014] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-21T18:09:08.151031] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-21T18:09:08.420431] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T18:09:08.951033] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-21T18:09:09.399500] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-21T18:09:09.408241] [INFO ] [REMOTE ] CTRA: Full fetch complete (77820 records). [2025-10-21T18:09:09.408379] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-21T18:09:09.758712] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-21T18:09:09.820897] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-21T18:09:09.821053] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-21T18:09:09.822070] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-21T18:09:09.822144] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-21T18:09:09.823761] [DEBUG] [LOCAL ] CTRA: Trimmed 77820 records to 53647 (keeping 200 days of data) [2025-10-21T18:09:10.156203] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-21T18:09:10.186965] [DEBUG] [LOCAL ] CTRA: Primary data saved (53647 records). [2025-10-21T18:09:10.187099] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-21T18:09:10.187175] [INFO ] [MAIN ] Update Progress: 548/2366 symbols completed. CTRA took 33.9s. Estimated remaining: 3h 49m 15s. Rate: 7.9 symbols/min [2025-10-21T18:09:10.386701] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:09:10.400170] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T18:09:10.458592] [DEBUG] [LOCAL ] CTVA: Loaded 53302 existing records from primary storage. [2025-10-21T18:09:10.458930] [INFO ] [MAIN ] CTVA: Loaded 53302 existing records. [2025-10-21T18:09:10.556300] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-21T18:09:10.642516] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:09:10.642738] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-21T18:09:10.642790] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-21T18:09:10.643707] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-21T18:09:10.643765] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-21T18:09:10.997630] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:09:11.009505] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T18:09:11.351029] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-21T18:09:12.151054] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-21T18:09:12.216598] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-21T18:09:12.498947] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-21T18:09:12.507076] [INFO ] [REMOTE ] CTRE: Full fetch complete (71341 records). [2025-10-21T18:09:12.507222] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-21T18:09:12.897131] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-21T18:09:12.897231] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-21T18:09:12.898159] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-21T18:09:12.898243] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-21T18:09:12.899601] [DEBUG] [LOCAL ] CTRE: Trimmed 71341 records to 49466 (keeping 200 days of data) [2025-10-21T18:09:12.953498] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-21T18:09:13.200414] [DEBUG] [LOCAL ] CTRE: Primary data saved (49466 records). [2025-10-21T18:09:13.200543] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-21T18:09:13.201353] [INFO ] [MAIN ] Update Progress: 549/2366 symbols completed. CTRE took 35.7s. Estimated remaining: 3h 48m 52s. Rate: 7.9 symbols/min [2025-10-21T18:09:13.387432] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:09:13.387614] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-21T18:09:13.387689] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-21T18:09:13.387813] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-21T18:09:13.387866] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-21T18:09:13.387908] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-21T18:09:13.387939] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-21T18:09:13.747613] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:09:13.750977] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-21T18:09:13.961365] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T18:09:13.969123] [INFO ] [REMOTE ] CTRI: Full fetch complete (54096 records). [2025-10-21T18:09:13.969234] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-21T18:09:14.245357] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-21T18:09:14.376614] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-21T18:09:14.376793] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-21T18:09:14.376952] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-21T18:09:14.382633] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-21T18:09:14.383018] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-21T18:09:14.384110] [DEBUG] [LOCAL ] CTRI: Trimmed 54096 records to 40676 (keeping 200 days of data) [2025-10-21T18:09:14.551059] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-21T18:09:14.626611] [DEBUG] [LOCAL ] CTRI: Primary data saved (40676 records). [2025-10-21T18:09:14.626787] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-21T18:09:14.626877] [INFO ] [MAIN ] Update Progress: 550/2366 symbols completed. CTRI took 29.6s. Estimated remaining: 3h 48m 24s. Rate: 8.0 symbols/min [2025-10-21T18:09:14.798272] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:09:14.845105] [DEBUG] [LOCAL ] CUBE: Loaded 50888 existing records from primary storage. [2025-10-21T18:09:14.845422] [INFO ] [MAIN ] CUBE: Loaded 50888 existing records. [2025-10-21T18:09:15.020204] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:09:15.020401] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-21T18:09:15.020471] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-21T18:09:15.021414] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-21T18:09:15.021471] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-21T18:09:15.371295] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-21T18:09:15.376355] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:09:15.633540] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-21T18:09:15.650063] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-21T18:09:16.151017] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-21T18:09:16.951022] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-21T18:09:17.751080] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-21T18:09:18.141787] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T18:09:18.183907] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-21T18:09:18.551039] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-21T18:09:19.325459] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T18:09:19.351054] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-21T18:09:19.718741] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-21T18:09:20.151058] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-21T18:09:20.556548] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T18:09:20.561824] [INFO ] [REMOTE ] CTS: Full fetch complete (27244 records). [2025-10-21T18:09:20.561934] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-21T18:09:20.954357] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-21T18:09:20.954721] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-21T18:09:20.954845] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-21T18:09:20.956152] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-21T18:09:20.956221] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-21T18:09:20.958304] [DEBUG] [LOCAL ] CTS: Trimmed 27244 records to 19552 (keeping 200 days of data) [2025-10-21T18:09:21.077769] [DEBUG] [LOCAL ] CTS: Primary data saved (19552 records). [2025-10-21T18:09:21.077910] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-21T18:09:21.077981] [INFO ] [MAIN ] Update Progress: 551/2366 symbols completed. CTS took 29.4s. Estimated remaining: 3h 48m 13s. Rate: 8.0 symbols/min [2025-10-21T18:09:21.251159] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:09:21.277267] [DEBUG] [LOCAL ] CUBI: Loaded 27276 existing records from primary storage. [2025-10-21T18:09:21.277517] [INFO ] [MAIN ] CUBI: Loaded 27276 existing records. [2025-10-21T18:09:21.349762] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-21T18:09:21.470267] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:09:21.470541] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-21T18:09:21.470630] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-21T18:09:21.470856] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-21T18:09:21.470915] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-21T18:09:21.753804] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-21T18:09:21.863757] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:09:21.866587] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-21T18:09:22.120329] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-21T18:09:22.551024] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-21T18:09:22.935392] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-21T18:09:23.351022] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-21T18:09:24.151017] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-21T18:09:24.951005] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-21T18:09:25.090128] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T18:09:25.556186] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T18:09:25.751031] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-21T18:09:26.334721] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T18:09:26.551010] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-21T18:09:26.599166] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-21T18:09:27.351039] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-21T18:09:27.670579] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-21T18:09:28.151020] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-21T18:09:28.506925] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-21T18:09:28.951025] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-21T18:09:29.751012] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-21T18:09:30.084167] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T18:09:30.553389] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-21T18:09:30.556145] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T18:09:30.642629] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-21T18:09:31.351057] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-21T18:09:32.151027] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-21T18:09:32.440943] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T18:09:32.807620] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T18:09:32.950998] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-21T18:09:33.715498] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T18:09:33.750985] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-21T18:09:33.996776] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-21T18:09:34.551020] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-21T18:09:34.805751] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-21T18:09:35.239697] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T18:09:35.351011] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-21T18:09:36.151027] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-21T18:09:36.446725] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-21T18:09:36.580464] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T18:09:36.951033] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-21T18:09:37.309488] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-21T18:09:37.751019] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-21T18:09:38.233717] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-21T18:09:38.234410] [INFO ] [REMOTE ] CUBB: Full fetch complete (952 records). [2025-10-21T18:09:38.234481] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-21T18:09:38.408501] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-21T18:09:38.408751] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:09:38.408822] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:09:38.408891] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-21T18:09:38.408952] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-21T18:09:38.408997] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-21T18:09:38.409080] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-21T18:09:38.409144] [INFO ] [MAIN ] Update Progress: 552/2366 symbols completed. CUBB took 25.2s. Estimated remaining: 3h 48m 38s. Rate: 7.9 symbols/min [2025-10-21T18:09:38.555270] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-21T18:09:38.577260] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:09:38.625978] [DEBUG] [LOCAL ] CUK: Loaded 51072 existing records from primary storage. [2025-10-21T18:09:38.626304] [INFO ] [MAIN ] CUK: Loaded 51072 existing records. [2025-10-21T18:09:38.798865] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:09:38.799064] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-21T18:09:38.799165] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-21T18:09:38.800048] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-21T18:09:38.800105] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-21T18:09:39.143025] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:09:39.350996] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-21T18:09:39.970055] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-21T18:09:40.151077] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-21T18:09:40.836189] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T18:09:40.951030] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-21T18:09:40.971417] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T18:09:41.751000] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-21T18:09:42.550995] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-21T18:09:42.739117] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T18:09:43.350997] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-21T18:09:43.459129] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T18:09:44.151000] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-21T18:09:44.483617] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-21T18:09:44.590909] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-21T18:09:44.951036] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-21T18:09:45.751012] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-21T18:09:45.972588] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-21T18:09:46.551000] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-21T18:09:46.969886] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-21T18:09:46.996818] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T18:09:47.001119] [INFO ] [REMOTE ] CUBI: Full fetch complete (39130 records). [2025-10-21T18:09:47.001196] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-21T18:09:47.353906] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-21T18:09:47.388732] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-21T18:09:47.388818] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-21T18:09:47.389465] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-21T18:09:47.389615] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-21T18:09:47.390505] [DEBUG] [LOCAL ] CUBI: Trimmed 39130 records to 27119 (keeping 200 days of data) [2025-10-21T18:09:47.548941] [DEBUG] [LOCAL ] CUBI: Primary data saved (27119 records). [2025-10-21T18:09:47.549070] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-21T18:09:47.549147] [INFO ] [MAIN ] Update Progress: 553/2366 symbols completed. CUBI took 26.5s. Estimated remaining: 3h 48m 36s. Rate: 7.9 symbols/min [2025-10-21T18:09:47.743285] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:09:47.747616] [DEBUG] [LOCAL ] CULP: Loaded 2882 existing records from primary storage. [2025-10-21T18:09:47.747808] [INFO ] [MAIN ] CULP: Loaded 2882 existing records. [2025-10-21T18:09:47.921683] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:09:47.921884] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-21T18:09:47.921932] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-21T18:09:47.922056] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-21T18:09:47.922092] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-21T18:09:48.169623] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-21T18:09:48.287098] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:09:48.437250] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-21T18:09:48.951028] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-21T18:09:49.110340] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T18:09:49.749422] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-21T18:09:49.750969] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-21T18:09:50.173108] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-21T18:09:50.317936] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T18:09:50.551016] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-21T18:09:51.351074] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-21T18:09:51.862116] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-21T18:09:52.034808] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T18:09:52.151007] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-21T18:09:52.756439] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-21T18:09:52.951014] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-21T18:09:53.243120] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-21T18:09:53.751051] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-21T18:09:54.551031] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-21T18:09:55.319864] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T18:09:55.350985] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-21T18:09:55.844037] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-21T18:09:56.151008] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-21T18:09:56.348116] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T18:09:56.355479] [INFO ] [REMOTE ] CUBE: Full fetch complete (72955 records). [2025-10-21T18:09:56.355590] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-21T18:09:56.356384] [FATAL] [VALIDATOR ] CUBE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:09:56.356478] [FATAL] [MAIN ] CUBE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:09:56.356523] [WARN ] [MAIN ] CUBE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:09:56.356601] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-21T18:09:56.356714] [DEBUG] [LOCAL ] CUBE: No primary data file found to delete. [2025-10-21T18:09:56.356776] [INFO ] [LOCAL ] CUBE: Starting deletion of derivative data. [2025-10-21T18:09:56.356983] [DEBUG] [LOCAL ] CUBE: Deleted derivative data file. [2025-10-21T18:09:56.357089] [INFO ] [MAIN ] Update Progress: 554/2366 symbols completed. CUBE took 41.7s. Estimated remaining: 3h 48m 32s. Rate: 7.9 symbols/min [2025-10-21T18:09:56.561726] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:09:56.561947] [DEBUG] [LOCAL ] CURB: No existing data file found in primary storage. [2025-10-21T18:09:56.562043] [WARN ] [MAIN ] CURB: No existing data found, performing full refresh instead. [2025-10-21T18:09:56.562145] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-21T18:09:56.562192] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-21T18:09:56.562245] [DEBUG] [LOCAL ] CURB: No primary data file found to delete. [2025-10-21T18:09:56.562287] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-21T18:09:56.924526] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:09:56.950984] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-21T18:09:57.751052] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-21T18:09:58.165255] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-21T18:09:58.373909] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-21T18:09:58.428739] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-21T18:09:58.551016] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-21T18:09:59.351023] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-21T18:09:59.809213] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T18:10:00.151027] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-21T18:10:00.797749] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-21T18:10:00.951033] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-21T18:10:01.604687] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-21T18:10:01.615108] [INFO ] [REMOTE ] CTVA: Full fetch complete (77223 records). [2025-10-21T18:10:01.615354] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-21T18:10:01.756227] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-21T18:10:02.057114] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-21T18:10:02.057210] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-21T18:10:02.058180] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-21T18:10:02.058248] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-21T18:10:02.059796] [DEBUG] [LOCAL ] CTVA: Trimmed 77223 records to 53305 (keeping 200 days of data) [2025-10-21T18:10:02.363091] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-21T18:10:02.478565] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T18:10:02.503154] [DEBUG] [LOCAL ] CTVA: Primary data saved (53305 records). [2025-10-21T18:10:02.503618] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-21T18:10:02.504497] [INFO ] [MAIN ] Update Progress: 555/2366 symbols completed. CTVA took 52.3s. Estimated remaining: 3h 48m 20s. Rate: 7.9 symbols/min [2025-10-21T18:10:02.556287] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-21T18:10:02.702965] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:10:02.734388] [DEBUG] [LOCAL ] CURV: Loaded 27263 existing records from primary storage. [2025-10-21T18:10:02.734714] [INFO ] [MAIN ] CURV: Loaded 27263 existing records. [2025-10-21T18:10:02.915791] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:10:02.916020] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-21T18:10:02.916078] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-21T18:10:02.916518] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-21T18:10:02.916574] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-21T18:10:03.262965] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:10:03.350980] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-21T18:10:04.151044] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-21T18:10:04.698082] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T18:10:04.801261] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-21T18:10:04.889543] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-21T18:10:04.890509] [INFO ] [REMOTE ] CULP: Full fetch complete (4520 records). [2025-10-21T18:10:04.890575] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-21T18:10:04.890949] [FATAL] [VALIDATOR ] CULP: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:10:04.891032] [FATAL] [MAIN ] CULP: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:10:04.891074] [WARN ] [MAIN ] CULP: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:10:04.891138] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-21T18:10:04.891197] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-10-21T18:10:04.891231] [INFO ] [LOCAL ] CULP: Starting deletion of derivative data. [2025-10-21T18:10:04.891373] [DEBUG] [LOCAL ] CULP: Deleted derivative data file. [2025-10-21T18:10:04.891453] [INFO ] [MAIN ] Update Progress: 556/2366 symbols completed. CULP took 17.3s. Estimated remaining: 3h 47m 55s. Rate: 7.9 symbols/min [2025-10-21T18:10:04.956680] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-21T18:10:05.069108] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:10:05.113070] [DEBUG] [LOCAL ] CUZ: Loaded 49575 existing records from primary storage. [2025-10-21T18:10:05.113400] [INFO ] [MAIN ] CUZ: Loaded 49575 existing records. [2025-10-21T18:10:05.290543] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:10:05.290767] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-21T18:10:05.290835] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-21T18:10:05.291488] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-21T18:10:05.291544] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-21T18:10:05.647184] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:10:05.751041] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-21T18:10:06.550999] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-21T18:10:06.745242] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T18:10:06.991716] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T18:10:07.270562] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-21T18:10:07.351028] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-21T18:10:08.151024] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-21T18:10:08.534435] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T18:10:08.951006] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-21T18:10:09.751089] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-21T18:10:09.891805] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T18:10:10.551047] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-21T18:10:10.975793] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-21T18:10:11.093076] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-21T18:10:11.351067] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-21T18:10:11.792022] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T18:10:12.151023] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-21T18:10:12.663694] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T18:10:12.951094] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-21T18:10:13.615598] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-21T18:10:13.751027] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-21T18:10:14.022280] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T18:10:14.551069] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-21T18:10:15.081031] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T18:10:15.351080] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-21T18:10:16.151004] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-21T18:10:16.536381] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T18:10:16.544316] [INFO ] [REMOTE ] CUK: Full fetch complete (74356 records). [2025-10-21T18:10:16.544426] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-21T18:10:16.956241] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-21T18:10:16.960162] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-21T18:10:16.961081] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-21T18:10:16.962146] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-21T18:10:16.962443] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-21T18:10:16.996270] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T18:10:16.994533] [DEBUG] [LOCAL ] CUK: Trimmed 74356 records to 51065 (keeping 200 days of data) [2025-10-21T18:10:17.298084] [DEBUG] [LOCAL ] CUK: Primary data saved (51065 records). [2025-10-21T18:10:17.298213] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-21T18:10:17.299218] [INFO ] [MAIN ] Update Progress: 557/2366 symbols completed. CUK took 38.9s. Estimated remaining: 3h 48m 4s. Rate: 7.9 symbols/min [2025-10-21T18:10:17.751007] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-21T18:10:18.557958] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T18:10:18.567256] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-21T18:10:19.140593] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (2.99 seconds). [2025-10-21T18:10:19.351035] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-21T18:10:20.030967] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T18:10:20.151086] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-21T18:10:20.492095] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T18:10:20.951000] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-21T18:10:21.518324] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T18:10:21.524142] [INFO ] [REMOTE ] CURB: Full fetch complete (47444 records). [2025-10-21T18:10:21.524231] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-21T18:10:21.906752] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-21T18:10:21.906827] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-21T18:10:21.907433] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-21T18:10:21.907472] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-21T18:10:21.908398] [DEBUG] [LOCAL ] CURB: Trimmed 47444 records to 32813 (keeping 200 days of data) [2025-10-21T18:10:22.105600] [DEBUG] [LOCAL ] CURB: Primary data saved (32813 records). [2025-10-21T18:10:22.105778] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-21T18:10:22.105856] [INFO ] [MAIN ] Update Progress: 558/2366 symbols completed. CURB took 25.7s. Estimated remaining: 3h 47m 47s. Rate: 7.9 symbols/min [2025-10-21T18:10:22.209157] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (4.46 seconds). [2025-10-21T18:10:22.219610] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-21T18:10:22.270150] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-21T18:10:22.551005] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-21T18:10:23.766128] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-21T18:10:23.772581] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-21T18:10:23.906259] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T18:10:24.151055] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-21T18:10:25.249861] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T18:10:25.257456] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-21T18:10:25.659910] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T18:10:25.751007] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-21T18:10:26.599763] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T18:10:26.604951] [INFO ] [REMOTE ] CURV: Full fetch complete (38899 records). [2025-10-21T18:10:26.605032] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-21T18:10:26.973567] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-21T18:10:26.973707] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-21T18:10:26.974447] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-21T18:10:26.974508] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-21T18:10:26.975408] [DEBUG] [LOCAL ] CURV: Trimmed 38899 records to 27190 (keeping 200 days of data) [2025-10-21T18:10:27.122727] [DEBUG] [LOCAL ] CURV: Primary data saved (27190 records). [2025-10-21T18:10:27.122905] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-21T18:10:27.123036] [INFO ] [MAIN ] Update Progress: 559/2366 symbols completed. CURV took 24.6s. Estimated remaining: 3h 47m 31s. Rate: 7.9 symbols/min [2025-10-21T18:10:27.204447] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T18:10:27.214731] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-21T18:10:28.887006] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-21T18:10:28.897792] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-21T18:10:30.584701] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T18:10:30.591762] [INFO ] [REMOTE ] CUZ: Full fetch complete (70528 records). [2025-10-21T18:10:30.591865] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-21T18:10:30.592572] [FATAL] [VALIDATOR ] CUZ: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:10:30.592699] [FATAL] [MAIN ] CUZ: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:10:30.592750] [WARN ] [MAIN ] CUZ: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:10:30.592811] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-21T18:10:30.592873] [DEBUG] [LOCAL ] CUZ: No primary data file found to delete. [2025-10-21T18:10:30.592947] [INFO ] [LOCAL ] CUZ: Starting deletion of derivative data. [2025-10-21T18:10:30.593105] [DEBUG] [LOCAL ] CUZ: Deleted derivative data file. [2025-10-21T18:10:30.593479] [INFO ] [MAIN ] Update Progress: 560/2366 symbols completed. CUZ took 25.7s. Estimated remaining: 3h 47m 11s. Rate: 7.9 symbols/min [2025-10-21T18:10:31.223320] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:10:31.304597] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:10:31.309625] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:10:31.313032] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:10:31.335044] [DEBUG] [LOCAL ] CVEO: Loaded 15328 existing records from primary storage. [2025-10-21T18:10:31.335327] [INFO ] [MAIN ] CVEO: Loaded 15328 existing records. [2025-10-21T18:10:31.399619] [DEBUG] [LOCAL ] CVLG: Loaded 15478 existing records from primary storage. [2025-10-21T18:10:31.431500] [INFO ] [MAIN ] CVLG: Loaded 15478 existing records. [2025-10-21T18:10:31.700635] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:10:31.693234] [DEBUG] [LOCAL ] CVI: Loaded 46745 existing records from primary storage. [2025-10-21T18:10:31.701285] [INFO ] [MAIN ] CVI: Loaded 46745 existing records. [2025-10-21T18:10:31.717463] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-21T18:10:31.730302] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-21T18:10:31.759822] [DEBUG] [LOCAL ] CVE: Loaded 53567 existing records from primary storage. [2025-10-21T18:10:31.797588] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-21T18:10:31.818632] [INFO ] [MAIN ] CVE: Loaded 53567 existing records. [2025-10-21T18:10:31.818884] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-21T18:10:32.037259] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:10:32.137972] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-21T18:10:32.176172] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-21T18:10:32.199713] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-21T18:10:32.204321] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:10:32.235417] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-21T18:10:32.240663] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-21T18:10:32.296403] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-21T18:10:32.371767] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:10:32.437622] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-21T18:10:32.448032] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-21T18:10:32.425543] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-21T18:10:32.475526] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-21T18:10:32.500853] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-21T18:10:32.572479] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-21T18:10:33.280607] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:10:33.404497] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-21T18:10:33.567530] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:10:33.623297] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-21T18:10:33.725018] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:10:33.727602] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-21T18:10:33.747764] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:10:33.748072] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-21T18:10:34.465185] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T18:10:34.467356] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-21T18:10:34.857010] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T18:10:34.862487] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-21T18:10:35.216594] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T18:10:35.227564] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-21T18:10:35.255375] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T18:10:35.265152] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-21T18:10:35.294973] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-21T18:10:35.299617] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-21T18:10:35.321510] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-21T18:10:35.351029] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-21T18:10:35.960961] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-21T18:10:36.151002] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-21T18:10:36.317161] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-21T18:10:36.516150] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T18:10:36.880786] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T18:10:36.957367] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-21T18:10:36.961069] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-21T18:10:37.751024] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-21T18:10:38.550996] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-21T18:10:38.938500] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-21T18:10:39.203228] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-21T18:10:39.350999] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-21T18:10:39.420206] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T18:10:40.151010] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-21T18:10:40.301695] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-21T18:10:40.951059] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-21T18:10:41.751033] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-21T18:10:41.983760] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T18:10:42.025132] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-21T18:10:42.551057] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-21T18:10:42.793990] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T18:10:43.351059] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-21T18:10:44.125316] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T18:10:44.150983] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-21T18:10:44.293334] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-21T18:10:44.951021] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-21T18:10:45.750993] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-21T18:10:45.999841] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T18:10:46.045809] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-21T18:10:46.551031] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-21T18:10:46.829328] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T18:10:47.351042] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-21T18:10:47.896693] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T18:10:47.914435] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T18:10:48.151023] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-21T18:10:48.951112] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-21T18:10:49.751115] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-21T18:10:49.807995] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T18:10:49.948131] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T18:10:50.551037] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-21T18:10:51.351030] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-21T18:10:51.716975] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-21T18:10:51.738747] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T18:10:51.741887] [INFO ] [REMOTE ] CVEO: Full fetch complete (20882 records). [2025-10-21T18:10:51.741978] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-21T18:10:52.112531] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-21T18:10:52.112617] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-21T18:10:52.113068] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-21T18:10:52.113121] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-21T18:10:52.113697] [DEBUG] [LOCAL ] CVEO: Trimmed 20882 records to 15250 (keeping 200 days of data) [2025-10-21T18:10:52.155110] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-21T18:10:52.200632] [DEBUG] [LOCAL ] CVEO: Primary data saved (15250 records). [2025-10-21T18:10:52.200753] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-21T18:10:52.200826] [INFO ] [MAIN ] Update Progress: 561/2366 symbols completed. CVEO took 21.6s. Estimated remaining: 3h 47m 48s. Rate: 7.9 symbols/min [2025-10-21T18:10:52.371527] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:10:52.421289] [DEBUG] [LOCAL ] CVNA: Loaded 52842 existing records from primary storage. [2025-10-21T18:10:52.421583] [INFO ] [MAIN ] CVNA: Loaded 52842 existing records. [2025-10-21T18:10:52.596252] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:10:52.596499] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-21T18:10:52.596545] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-21T18:10:52.597176] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-21T18:10:52.597234] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-21T18:10:52.958683] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-21T18:10:52.979112] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:10:52.981581] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-21T18:10:53.016762] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T18:10:53.751041] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-21T18:10:54.523000] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T18:10:54.550990] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-21T18:10:55.351018] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-21T18:10:56.017135] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-21T18:10:56.047733] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-21T18:10:56.151003] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-21T18:10:56.235549] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T18:10:56.951022] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-21T18:10:57.751020] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-21T18:10:57.915214] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-21T18:10:58.044636] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-21T18:10:58.046976] [INFO ] [REMOTE ] CVLG: Full fetch complete (21317 records). [2025-10-21T18:10:58.047045] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-21T18:10:58.404853] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-21T18:10:58.404942] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-21T18:10:58.405378] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-21T18:10:58.405427] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-21T18:10:58.406007] [DEBUG] [LOCAL ] CVLG: Trimmed 21317 records to 15331 (keeping 200 days of data) [2025-10-21T18:10:58.495396] [DEBUG] [LOCAL ] CVLG: Primary data saved (15331 records). [2025-10-21T18:10:58.495525] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-21T18:10:58.495605] [INFO ] [MAIN ] Update Progress: 562/2366 symbols completed. CVLG took 27.9s. Estimated remaining: 3h 47m 37s. Rate: 7.9 symbols/min [2025-10-21T18:10:58.557410] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-21T18:10:58.663164] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:10:58.712704] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-21T18:10:58.713059] [INFO ] [MAIN ] CVS: Loaded 53694 existing records. [2025-10-21T18:10:58.890660] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:10:58.890895] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-21T18:10:58.890949] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-21T18:10:58.891737] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-21T18:10:58.891797] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-21T18:10:59.248535] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:10:59.350976] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-21T18:10:59.544506] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T18:11:00.151003] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-21T18:11:00.401751] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T18:11:00.409526] [INFO ] [REMOTE ] CVI: Full fetch complete (67204 records). [2025-10-21T18:11:00.409722] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-21T18:11:00.809976] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-21T18:11:00.810057] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-21T18:11:00.810889] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-21T18:11:00.810954] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-21T18:11:00.812381] [DEBUG] [LOCAL ] CVI: Trimmed 67204 records to 46730 (keeping 200 days of data) [2025-10-21T18:11:00.978079] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-21T18:11:01.087840] [DEBUG] [LOCAL ] CVI: Primary data saved (46730 records). [2025-10-21T18:11:01.087965] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-21T18:11:01.088065] [INFO ] [MAIN ] Update Progress: 563/2366 symbols completed. CVI took 30.5s. Estimated remaining: 3h 47m 13s. Rate: 7.9 symbols/min [2025-10-21T18:11:01.258358] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:11:01.314906] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-21T18:11:01.315273] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-10-21T18:11:01.498570] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:11:01.498788] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-21T18:11:01.498834] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-21T18:11:01.499740] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-21T18:11:01.499798] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-21T18:11:01.916277] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:11:01.916846] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-21T18:11:01.953332] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-21T18:11:02.343850] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-21T18:11:02.551008] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-21T18:11:02.988090] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-21T18:11:03.351005] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-21T18:11:04.151052] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-21T18:11:04.289190] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-21T18:11:04.361425] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T18:11:04.951002] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-21T18:11:05.429835] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-21T18:11:05.438203] [INFO ] [REMOTE ] CVE: Full fetch complete (77718 records). [2025-10-21T18:11:05.438344] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-21T18:11:05.756119] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-21T18:11:05.832839] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-21T18:11:05.832915] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-21T18:11:05.833801] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-21T18:11:05.833864] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-21T18:11:05.835292] [DEBUG] [LOCAL ] CVE: Trimmed 77718 records to 53567 (keeping 200 days of data) [2025-10-21T18:11:06.177621] [DEBUG] [LOCAL ] CVE: Primary data saved (53567 records). [2025-10-21T18:11:06.192694] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-21T18:11:06.196724] [INFO ] [MAIN ] Update Progress: 564/2366 symbols completed. CVE took 35.6s. Estimated remaining: 3h 46m 58s. Rate: 7.9 symbols/min [2025-10-21T18:11:06.242534] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-21T18:11:06.382402] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:11:06.404520] [DEBUG] [LOCAL ] CW: Loaded 22034 existing records from primary storage. [2025-10-21T18:11:06.404792] [INFO ] [MAIN ] CW: Loaded 22034 existing records. [2025-10-21T18:11:06.559918] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-21T18:11:06.581017] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:11:06.581300] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-21T18:11:06.581346] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-21T18:11:06.581850] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-21T18:11:06.581906] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-21T18:11:06.927340] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:11:07.220569] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-21T18:11:07.351025] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-21T18:11:07.968209] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-21T18:11:08.151053] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-21T18:11:08.623905] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-21T18:11:08.806194] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-21T18:11:08.951042] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-21T18:11:09.751023] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-21T18:11:10.270002] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-21T18:11:10.451741] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-21T18:11:10.550985] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-21T18:11:11.351052] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-21T18:11:12.155459] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-21T18:11:12.158711] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-21T18:11:12.951046] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-21T18:11:13.161531] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-21T18:11:13.265059] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T18:11:13.290283] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-21T18:11:13.751087] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-21T18:11:14.551090] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-21T18:11:15.164570] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-21T18:11:15.351007] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-21T18:11:15.754318] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-21T18:11:15.978863] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-21T18:11:16.151001] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-21T18:11:16.951041] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-21T18:11:17.469373] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-21T18:11:17.751064] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-21T18:11:17.874096] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-21T18:11:18.551048] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-21T18:11:19.351007] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-21T18:11:19.609750] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-10-21T18:11:19.650082] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-21T18:11:19.873048] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T18:11:20.151061] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-21T18:11:20.951054] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-21T18:11:21.277625] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-21T18:11:21.751028] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-21T18:11:22.013834] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T18:11:22.039086] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-21T18:11:22.551034] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-21T18:11:23.351040] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-21T18:11:24.150998] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-21T18:11:24.209186] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-21T18:11:24.935317] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-21T18:11:24.950979] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-21T18:11:25.086566] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-21T18:11:25.467739] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-21T18:11:25.751027] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-21T18:11:26.551077] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-21T18:11:26.593892] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-21T18:11:26.772566] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T18:11:27.351124] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-21T18:11:28.151059] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-21T18:11:28.450959] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T18:11:28.454480] [INFO ] [REMOTE ] CW: Full fetch complete (33056 records). [2025-10-21T18:11:28.454677] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-21T18:11:28.836130] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-21T18:11:28.836228] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-21T18:11:28.836622] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-21T18:11:28.836904] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-21T18:11:28.859508] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-21T18:11:28.859628] [DEBUG] [LOCAL ] CW: Trimmed 33056 records to 21993 (keeping 200 days of data) [2025-10-21T18:11:28.868315] [INFO ] [REMOTE ] CVNA: Full fetch complete (76744 records). [2025-10-21T18:11:28.868421] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-21T18:11:28.955986] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-21T18:11:29.412876] [DEBUG] [LOCAL ] CW: Primary data saved (21993 records). [2025-10-21T18:11:29.432693] [INFO ] [MAIN ] CW: Full history saved. [2025-10-21T18:11:29.432905] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-21T18:11:29.433054] [INFO ] [MAIN ] Update Progress: 565/2366 symbols completed. CW took 23.2s. Estimated remaining: 3h 47m 40s. Rate: 7.9 symbols/min [2025-10-21T18:11:29.433287] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-21T18:11:29.445942] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-21T18:11:29.466985] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-21T18:11:29.555728] [DEBUG] [LOCAL ] CVNA: Trimmed 76744 records to 52839 (keeping 200 days of data) [2025-10-21T18:11:29.619156] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:11:29.908726] [DEBUG] [LOCAL ] CWAN: Loaded 52668 existing records from primary storage. [2025-10-21T18:11:29.982471] [INFO ] [MAIN ] CWAN: Loaded 52668 existing records. [2025-10-21T18:11:30.127928] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T18:11:30.231195] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:11:30.231880] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-21T18:11:30.231973] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-21T18:11:30.235315] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-21T18:11:30.242423] [DEBUG] [LOCAL ] CVNA: Primary data saved (52839 records). [2025-10-21T18:11:30.242484] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-21T18:11:30.242709] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-21T18:11:30.242616] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-21T18:11:30.248004] [INFO ] [MAIN ] Update Progress: 566/2366 symbols completed. CVNA took 38.0s. Estimated remaining: 3h 47m 11s. Rate: 7.9 symbols/min [2025-10-21T18:11:30.655249] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:11:30.835960] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:11:30.846519] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-21T18:11:30.868140] [DEBUG] [LOCAL ] CWEN: Loaded 45314 existing records from primary storage. [2025-10-21T18:11:30.868481] [INFO ] [MAIN ] CWEN: Loaded 45314 existing records. [2025-10-21T18:11:31.046847] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:11:31.047098] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-21T18:11:31.047174] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-21T18:11:31.048146] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-21T18:11:31.048205] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-21T18:11:31.410912] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:11:31.411550] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-21T18:11:31.445286] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T18:11:31.472707] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-10-21T18:11:31.473607] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-21T18:11:31.473914] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-21T18:11:31.910633] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-21T18:11:31.910753] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-21T18:11:31.911700] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-21T18:11:31.911762] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-21T18:11:31.913118] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 53694 (keeping 200 days of data) [2025-10-21T18:11:32.157084] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-21T18:11:32.239969] [DEBUG] [LOCAL ] CVS: Primary data saved (53694 records). [2025-10-21T18:11:32.240121] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-21T18:11:32.240482] [INFO ] [MAIN ] Update Progress: 567/2366 symbols completed. CVS took 33.7s. Estimated remaining: 3h 46m 46s. Rate: 7.9 symbols/min [2025-10-21T18:11:32.449137] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:11:32.451888] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T18:11:32.511805] [DEBUG] [LOCAL ] CWH: Loaded 51314 existing records from primary storage. [2025-10-21T18:11:32.512130] [INFO ] [MAIN ] CWH: Loaded 51314 existing records. [2025-10-21T18:11:32.702297] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:11:32.702545] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-21T18:11:32.702594] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-21T18:11:32.702907] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-21T18:11:32.702963] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-21T18:11:32.958449] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-21T18:11:33.083549] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:11:33.108040] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T18:11:33.751032] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-21T18:11:34.399977] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-21T18:11:34.466360] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T18:11:34.550993] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-21T18:11:35.327138] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T18:11:35.351023] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-21T18:11:35.526027] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T18:11:35.534361] [INFO ] [REMOTE ] CVX: Full fetch complete (77940 records). [2025-10-21T18:11:35.534491] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-21T18:11:35.918803] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-21T18:11:35.918881] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-21T18:11:35.919766] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-21T18:11:35.919829] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-21T18:11:35.921233] [DEBUG] [LOCAL ] CVX: Trimmed 77940 records to 53760 (keeping 200 days of data) [2025-10-21T18:11:36.151100] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-21T18:11:36.261591] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-10-21T18:11:36.261767] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-21T18:11:36.262768] [INFO ] [MAIN ] Update Progress: 568/2366 symbols completed. CVX took 35.2s. Estimated remaining: 3h 46m 27s. Rate: 7.9 symbols/min [2025-10-21T18:11:36.439348] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:11:36.491869] [DEBUG] [LOCAL ] CWK: Loaded 49668 existing records from primary storage. [2025-10-21T18:11:36.492188] [INFO ] [MAIN ] CWK: Loaded 49668 existing records. [2025-10-21T18:11:36.670069] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:11:36.670264] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-21T18:11:36.670312] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-21T18:11:36.671118] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-21T18:11:36.671176] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-21T18:11:36.958429] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-21T18:11:37.045141] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:11:37.074207] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T18:11:37.751038] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-21T18:11:37.840596] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T18:11:38.551050] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-21T18:11:38.666822] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T18:11:39.245840] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T18:11:39.351019] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-21T18:11:40.063757] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T18:11:40.151043] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-21T18:11:40.689482] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T18:11:40.951035] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-21T18:11:41.715276] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T18:11:41.750987] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-21T18:11:42.551016] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-21T18:11:42.667712] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T18:11:43.351145] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-21T18:11:43.424957] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T18:11:43.857365] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T18:11:44.151037] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-21T18:11:44.679869] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-21T18:11:44.951110] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-21T18:11:45.751011] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-21T18:11:45.882941] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T18:11:46.400986] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T18:11:46.551016] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-21T18:11:46.658223] [DEBUG] [REMOTE ] CWH: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-21T18:11:46.658525] [WARN ] [REMOTE ] CWH: No data returned for month 2025-04 [2025-10-21T18:11:46.658614] [FATAL] [REMOTE ] CWH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:11:46.658731] [FATAL] [MAIN ] CWH: Failed to fetch primary data. [2025-10-21T18:11:46.658812] [WARN ] [MAIN ] CWH: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:11:46.658891] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-21T18:11:46.658951] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-10-21T18:11:46.658986] [INFO ] [LOCAL ] CWH: Starting deletion of derivative data. [2025-10-21T18:11:46.659133] [DEBUG] [LOCAL ] CWH: Deleted derivative data file. [2025-10-21T18:11:46.659540] [INFO ] [MAIN ] Update Progress: 569/2366 symbols completed. CWH took 14.4s. Estimated remaining: 3h 46m 28s. Rate: 7.9 symbols/min [2025-10-21T18:11:46.829910] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:11:46.830106] [DEBUG] [LOCAL ] CWT: No existing data file found in primary storage. [2025-10-21T18:11:46.830146] [WARN ] [MAIN ] CWT: No existing data found, performing full refresh instead. [2025-10-21T18:11:46.830255] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-21T18:11:46.830296] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-21T18:11:46.830335] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-10-21T18:11:46.830366] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-21T18:11:47.193788] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:11:47.351005] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-21T18:11:47.706102] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-21T18:11:48.151039] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-21T18:11:48.328693] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-21T18:11:48.951037] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-21T18:11:49.677489] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T18:11:49.751012] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-21T18:11:50.237626] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T18:11:50.551022] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-21T18:11:51.351023] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-21T18:11:51.466251] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T18:11:52.129103] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T18:11:52.151000] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-21T18:11:52.314731] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-21T18:11:52.951083] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-21T18:11:53.751037] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-21T18:11:53.890224] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T18:11:54.551008] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-21T18:11:54.797751] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-21T18:11:55.360193] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-21T18:11:55.365470] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T18:11:55.842830] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T18:11:56.151018] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-21T18:11:56.951008] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-21T18:11:57.059777] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T18:11:57.751013] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-21T18:11:57.879526] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T18:11:58.551027] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-21T18:11:58.660984] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T18:11:58.668343] [INFO ] [REMOTE ] CWEN: Full fetch complete (65560 records). [2025-10-21T18:11:58.668462] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-21T18:11:59.069449] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-21T18:11:59.069629] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-21T18:11:59.070499] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-21T18:11:59.070611] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-21T18:11:59.089814] [DEBUG] [LOCAL ] CWEN: Trimmed 65560 records to 45297 (keeping 200 days of data) [2025-10-21T18:11:59.091445] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-21T18:11:59.351487] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-21T18:11:59.371205] [DEBUG] [LOCAL ] CWEN: Primary data saved (45297 records). [2025-10-21T18:11:59.371294] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-21T18:11:59.371371] [INFO ] [MAIN ] Update Progress: 570/2366 symbols completed. CWEN took 29.1s. Estimated remaining: 3h 46m 37s. Rate: 7.9 symbols/min [2025-10-21T18:11:59.546184] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:11:59.596076] [DEBUG] [LOCAL ] CX: Loaded 52835 existing records from primary storage. [2025-10-21T18:11:59.596398] [INFO ] [MAIN ] CX: Loaded 52835 existing records. [2025-10-21T18:11:59.773502] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:11:59.773785] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-21T18:11:59.773838] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-21T18:11:59.774889] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-21T18:11:59.774946] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-21T18:12:00.123539] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:12:00.153383] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-21T18:12:00.156365] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T18:12:00.404002] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-21T18:12:00.951018] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-21T18:12:01.751038] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-21T18:12:02.102193] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-21T18:12:02.551022] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-21T18:12:03.093898] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-21T18:12:03.356166] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-21T18:12:03.368928] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-21T18:12:04.151075] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-21T18:12:04.274992] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T18:12:04.283340] [INFO ] [REMOTE ] CWAN: Full fetch complete (75569 records). [2025-10-21T18:12:04.283456] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-21T18:12:04.671248] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-21T18:12:04.671336] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-21T18:12:04.672215] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-21T18:12:04.672280] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-21T18:12:04.673775] [DEBUG] [LOCAL ] CWAN: Trimmed 75569 records to 52682 (keeping 200 days of data) [2025-10-21T18:12:04.953742] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-21T18:12:04.976877] [DEBUG] [LOCAL ] CWAN: Primary data saved (52682 records). [2025-10-21T18:12:04.977027] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-21T18:12:04.977131] [INFO ] [MAIN ] Update Progress: 571/2366 symbols completed. CWAN took 35.5s. Estimated remaining: 3h 46m 23s. Rate: 7.9 symbols/min [2025-10-21T18:12:05.159592] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:12:05.177184] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T18:12:05.193064] [DEBUG] [LOCAL ] CXE: Loaded 6342 existing records from primary storage. [2025-10-21T18:12:05.193250] [INFO ] [MAIN ] CXE: Loaded 6342 existing records. [2025-10-21T18:12:05.382079] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:12:05.382494] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-21T18:12:05.382719] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-21T18:12:05.383117] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-21T18:12:05.383173] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-21T18:12:05.645229] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T18:12:05.756811] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-21T18:12:05.756751] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:12:06.551022] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-21T18:12:06.606630] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T18:12:06.614530] [INFO ] [REMOTE ] CWK: Full fetch complete (71320 records). [2025-10-21T18:12:06.614721] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-21T18:12:07.009256] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-21T18:12:07.009376] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-21T18:12:07.010262] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-21T18:12:07.010461] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-21T18:12:07.033168] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T18:12:07.039922] [DEBUG] [LOCAL ] CWK: Trimmed 71320 records to 49650 (keeping 200 days of data) [2025-10-21T18:12:07.338608] [DEBUG] [LOCAL ] CWK: Primary data saved (49650 records). [2025-10-21T18:12:07.338775] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-21T18:12:07.339845] [INFO ] [MAIN ] Update Progress: 572/2366 symbols completed. CWK took 31.1s. Estimated remaining: 3h 45m 59s. Rate: 7.9 symbols/min [2025-10-21T18:12:07.360414] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-21T18:12:07.513438] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:12:07.521564] [DEBUG] [LOCAL ] CXH: Loaded 4421 existing records from primary storage. [2025-10-21T18:12:07.521802] [INFO ] [MAIN ] CXH: Loaded 4421 existing records. [2025-10-21T18:12:07.699265] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:12:07.699481] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-21T18:12:07.699530] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-21T18:12:07.699739] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-21T18:12:07.699796] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-21T18:12:08.054124] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:12:08.150981] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-21T18:12:08.529570] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-21T18:12:08.653969] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T18:12:08.748310] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-21T18:12:08.951016] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-21T18:12:09.751042] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-21T18:12:10.550985] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-21T18:12:10.687165] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T18:12:10.716732] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-21T18:12:11.310040] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-21T18:12:11.350997] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-21T18:12:12.151060] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-21T18:12:12.946782] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-21T18:12:12.950982] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-21T18:12:13.058212] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T18:12:13.751081] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-21T18:12:13.781251] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-21T18:12:14.551023] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-21T18:12:14.871209] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-21T18:12:14.876230] [INFO ] [REMOTE ] CWT: Full fetch complete (41062 records). [2025-10-21T18:12:14.876350] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-21T18:12:14.876953] [FATAL] [VALIDATOR ] CWT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:12:14.877035] [FATAL] [MAIN ] CWT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:12:14.877077] [WARN ] [MAIN ] CWT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:12:14.877116] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-21T18:12:14.877186] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-10-21T18:12:14.877223] [INFO ] [LOCAL ] CWT: Starting deletion of derivative data. [2025-10-21T18:12:14.877261] [DEBUG] [LOCAL ] CWT: No derivative data file found to delete. [2025-10-21T18:12:14.877317] [INFO ] [MAIN ] Update Progress: 573/2366 symbols completed. CWT took 28.2s. Estimated remaining: 3h 45m 52s. Rate: 7.9 symbols/min [2025-10-21T18:12:15.038558] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-21T18:12:15.078815] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:12:15.122955] [DEBUG] [LOCAL ] CXM: Loaded 47532 existing records from primary storage. [2025-10-21T18:12:15.123284] [INFO ] [MAIN ] CXM: Loaded 47532 existing records. [2025-10-21T18:12:15.315491] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:12:15.315774] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-21T18:12:15.315863] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-21T18:12:15.316540] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-21T18:12:15.316597] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-21T18:12:15.356191] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-21T18:12:15.667172] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:12:16.151044] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-21T18:12:16.643931] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-21T18:12:16.951030] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-21T18:12:17.166514] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T18:12:17.308210] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-21T18:12:17.751037] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-21T18:12:18.551067] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-21T18:12:19.314445] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T18:12:19.351108] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-21T18:12:19.367445] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T18:12:19.933085] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-21T18:12:20.151036] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-21T18:12:20.762149] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-21T18:12:20.951097] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-21T18:12:21.537891] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-21T18:12:21.751093] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-21T18:12:22.386479] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-21T18:12:22.550993] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-21T18:12:23.112338] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-21T18:12:23.351024] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-21T18:12:23.937166] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-21T18:12:24.151062] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-21T18:12:24.951010] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-21T18:12:24.961860] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T18:12:25.751029] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-21T18:12:25.809476] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T18:12:26.551082] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-21T18:12:27.350995] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-21T18:12:27.824735] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-21T18:12:27.897034] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T18:12:28.151002] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-21T18:12:28.228317] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T18:12:28.229863] [INFO ] [REMOTE ] CXE: Full fetch complete (11494 records). [2025-10-21T18:12:28.229930] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-21T18:12:28.583886] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-21T18:12:28.583961] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-21T18:12:28.584215] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-21T18:12:28.584253] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-21T18:12:28.584681] [DEBUG] [LOCAL ] CXE: Trimmed 11494 records to 6372 (keeping 200 days of data) [2025-10-21T18:12:28.620701] [DEBUG] [LOCAL ] CXE: Primary data saved (6372 records). [2025-10-21T18:12:28.620822] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-21T18:12:28.620899] [INFO ] [MAIN ] Update Progress: 574/2366 symbols completed. CXE took 23.6s. Estimated remaining: 3h 46m 4s. Rate: 7.9 symbols/min [2025-10-21T18:12:28.785126] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:12:28.814430] [DEBUG] [LOCAL ] CXT: Loaded 30937 existing records from primary storage. [2025-10-21T18:12:28.814737] [INFO ] [MAIN ] CXT: Loaded 30937 existing records. [2025-10-21T18:12:28.958288] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-21T18:12:29.001114] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:12:29.001308] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-21T18:12:29.001354] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-21T18:12:29.002046] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-21T18:12:29.002104] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-21T18:12:29.382248] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:12:29.586998] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-21T18:12:29.751183] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-21T18:12:29.897027] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T18:12:30.206246] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-21T18:12:30.551057] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-21T18:12:31.351074] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-21T18:12:32.151061] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-21T18:12:32.329553] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T18:12:32.614348] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-21T18:12:32.615235] [INFO ] [REMOTE ] CXH: Full fetch complete (5301 records). [2025-10-21T18:12:32.615301] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-21T18:12:32.922287] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T18:12:32.962078] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-21T18:12:33.002558] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-21T18:12:33.002638] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-21T18:12:33.002840] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-21T18:12:33.002881] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-21T18:12:33.003234] [DEBUG] [LOCAL ] CXH: Trimmed 5301 records to 4418 (keeping 200 days of data) [2025-10-21T18:12:33.028693] [DEBUG] [LOCAL ] CXH: Primary data saved (4418 records). [2025-10-21T18:12:33.028774] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-21T18:12:33.028848] [INFO ] [MAIN ] Update Progress: 575/2366 symbols completed. CXH took 25.7s. Estimated remaining: 3h 45m 46s. Rate: 7.9 symbols/min [2025-10-21T18:12:33.192116] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:12:33.233668] [DEBUG] [LOCAL ] CXW: Loaded 43775 existing records from primary storage. [2025-10-21T18:12:33.234045] [INFO ] [MAIN ] CXW: Loaded 43775 existing records. [2025-10-21T18:12:33.406124] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:12:33.406283] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-21T18:12:33.406328] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-21T18:12:33.407045] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-21T18:12:33.407101] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-21T18:12:33.751717] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-21T18:12:33.771740] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:12:34.315142] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T18:12:34.551020] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-21T18:12:35.351073] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-21T18:12:35.470243] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T18:12:35.887894] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T18:12:36.151046] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-21T18:12:36.951028] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-21T18:12:37.014035] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T18:12:37.751043] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-21T18:12:37.967590] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T18:12:38.305533] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-21T18:12:38.550998] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-21T18:12:39.351010] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-21T18:12:39.382298] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T18:12:40.150999] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-21T18:12:40.250608] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-21T18:12:40.493381] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-21T18:12:40.501914] [INFO ] [REMOTE ] CX: Full fetch complete (76585 records). [2025-10-21T18:12:40.502062] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-21T18:12:40.885206] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-21T18:12:40.885285] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-21T18:12:40.886152] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-21T18:12:40.886281] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-21T18:12:40.887743] [DEBUG] [LOCAL ] CX: Trimmed 76585 records to 52833 (keeping 200 days of data) [2025-10-21T18:12:40.969498] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-21T18:12:41.192202] [DEBUG] [LOCAL ] CX: Primary data saved (52833 records). [2025-10-21T18:12:41.192335] [INFO ] [MAIN ] CX: Full history saved. [2025-10-21T18:12:41.192411] [INFO ] [MAIN ] Update Progress: 576/2366 symbols completed. CX took 41.8s. Estimated remaining: 3h 45m 40s. Rate: 7.9 symbols/min [2025-10-21T18:12:41.364248] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:12:41.390804] [DEBUG] [LOCAL ] CYD: Loaded 27167 existing records from primary storage. [2025-10-21T18:12:41.391056] [INFO ] [MAIN ] CYD: Loaded 27167 existing records. [2025-10-21T18:12:41.566403] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:12:41.566618] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-21T18:12:41.566693] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-21T18:12:41.567180] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-21T18:12:41.567236] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-21T18:12:41.756779] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-21T18:12:41.964699] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:12:41.960460] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T18:12:42.525384] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T18:12:42.550988] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-21T18:12:43.236746] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T18:12:43.351094] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-21T18:12:44.143110] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T18:12:44.156331] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-21T18:12:44.156406] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-21T18:12:44.951039] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-21T18:12:45.512525] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T18:12:45.751006] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-21T18:12:46.068071] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T18:12:46.551031] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-21T18:12:47.351005] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-21T18:12:47.395908] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T18:12:47.972984] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-21T18:12:48.151051] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-21T18:12:48.916465] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T18:12:48.950987] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-21T18:12:49.527883] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T18:12:49.751029] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-21T18:12:50.143690] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T18:12:50.551055] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-21T18:12:51.135049] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T18:12:51.350999] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-21T18:12:52.150994] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-21T18:12:52.189077] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T18:12:52.567377] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-21T18:12:52.951037] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-21T18:12:53.751009] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-21T18:12:53.818433] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T18:12:54.397790] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T18:12:54.551027] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-21T18:12:54.972958] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T18:12:55.351007] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-21T18:12:56.164625] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-21T18:12:56.167917] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-21T18:12:56.734093] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T18:12:56.739101] [INFO ] [REMOTE ] CXT: Full fetch complete (45676 records). [2025-10-21T18:12:56.739190] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-21T18:12:56.963275] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-21T18:12:57.146411] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-21T18:12:57.146493] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-21T18:12:57.147182] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-21T18:12:57.147245] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-21T18:12:57.148209] [DEBUG] [LOCAL ] CXT: Trimmed 45676 records to 30841 (keeping 200 days of data) [2025-10-21T18:12:57.331818] [DEBUG] [LOCAL ] CXT: Primary data saved (30841 records). [2025-10-21T18:12:57.331944] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-21T18:12:57.332698] [INFO ] [MAIN ] Update Progress: 577/2366 symbols completed. CXT took 28.7s. Estimated remaining: 3h 45m 59s. Rate: 7.9 symbols/min [2025-10-21T18:12:57.505676] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:12:57.549963] [DEBUG] [LOCAL ] CYH: Loaded 47742 existing records from primary storage. [2025-10-21T18:12:57.550278] [INFO ] [MAIN ] CYH: Loaded 47742 existing records. [2025-10-21T18:12:57.727505] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:12:57.727786] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-21T18:12:57.727857] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-21T18:12:57.728713] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-21T18:12:57.728773] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-21T18:12:57.759774] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-21T18:12:58.100456] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T18:12:58.121380] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:12:58.551048] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-21T18:12:58.676486] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T18:12:58.684318] [INFO ] [REMOTE ] CXM: Full fetch complete (68693 records). [2025-10-21T18:12:58.684493] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-21T18:12:58.868359] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T18:12:59.117355] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-21T18:12:59.117461] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-21T18:12:59.118573] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-21T18:12:59.118638] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-21T18:12:59.120182] [DEBUG] [LOCAL ] CXM: Trimmed 68693 records to 47468 (keeping 200 days of data) [2025-10-21T18:12:59.352215] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-21T18:12:59.378345] [DEBUG] [LOCAL ] CXM: Primary data saved (47468 records). [2025-10-21T18:12:59.378436] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-21T18:12:59.378899] [INFO ] [MAIN ] Update Progress: 578/2366 symbols completed. CXM took 44.5s. Estimated remaining: 3h 45m 35s. Rate: 7.9 symbols/min [2025-10-21T18:12:59.544487] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:12:59.594702] [DEBUG] [LOCAL ] D: Loaded 53649 existing records from primary storage. [2025-10-21T18:12:59.594998] [INFO ] [MAIN ] D: Loaded 53649 existing records. [2025-10-21T18:12:59.770019] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:12:59.770235] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-21T18:12:59.770281] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-21T18:12:59.770456] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-21T18:12:59.770493] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-21T18:13:00.126911] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:13:00.151373] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-21T18:13:00.153749] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T18:13:00.951062] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-21T18:13:00.953774] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T18:13:01.751061] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-21T18:13:01.797232] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T18:13:02.551020] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-21T18:13:02.587289] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T18:13:02.910977] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-21T18:13:03.351085] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-21T18:13:04.150993] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-21T18:13:04.271899] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-21T18:13:04.951101] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-21T18:13:05.078567] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T18:13:05.484704] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T18:13:05.751270] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-21T18:13:06.510561] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T18:13:06.551121] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-21T18:13:07.350995] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-21T18:13:07.498170] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T18:13:08.151010] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-21T18:13:08.195671] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-21T18:13:08.202270] [INFO ] [REMOTE ] CXW: Full fetch complete (64788 records). [2025-10-21T18:13:08.202393] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-21T18:13:08.582632] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-21T18:13:08.582749] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-21T18:13:08.583513] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-21T18:13:08.583555] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-21T18:13:08.584972] [DEBUG] [LOCAL ] CXW: Trimmed 64788 records to 43650 (keeping 200 days of data) [2025-10-21T18:13:08.839587] [DEBUG] [LOCAL ] CXW: Primary data saved (43650 records). [2025-10-21T18:13:08.839756] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-21T18:13:08.839848] [INFO ] [MAIN ] Update Progress: 579/2366 symbols completed. CXW took 35.8s. Estimated remaining: 3h 45m 33s. Rate: 7.9 symbols/min [2025-10-21T18:13:08.956236] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-21T18:13:09.015543] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:13:09.029688] [DEBUG] [LOCAL ] DAC: Loaded 12590 existing records from primary storage. [2025-10-21T18:13:09.029922] [INFO ] [MAIN ] DAC: Loaded 12590 existing records. [2025-10-21T18:13:09.227523] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:13:09.227885] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-21T18:13:09.228707] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-21T18:13:09.229031] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-21T18:13:09.229089] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-21T18:13:09.563114] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-21T18:13:09.696964] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:13:09.751009] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-21T18:13:09.943428] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T18:13:10.328797] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T18:13:10.333746] [INFO ] [REMOTE ] CYD: Full fetch complete (35579 records). [2025-10-21T18:13:10.333830] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-21T18:13:10.334392] [FATAL] [VALIDATOR ] CYD: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:13:10.334488] [FATAL] [MAIN ] CYD: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:13:10.334549] [WARN ] [MAIN ] CYD: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:13:10.334618] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-21T18:13:10.334717] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-10-21T18:13:10.334764] [INFO ] [LOCAL ] CYD: Starting deletion of derivative data. [2025-10-21T18:13:10.334940] [DEBUG] [LOCAL ] CYD: Deleted derivative data file. [2025-10-21T18:13:10.335027] [INFO ] [MAIN ] Update Progress: 580/2366 symbols completed. CYD took 29.1s. Estimated remaining: 3h 45m 7s. Rate: 7.9 symbols/min [2025-10-21T18:13:10.521666] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:13:10.551079] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-21T18:13:10.572947] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-21T18:13:10.573269] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-10-21T18:13:10.774042] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:13:10.774456] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-21T18:13:10.774637] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-21T18:13:10.784157] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T18:13:10.788764] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-21T18:13:10.788836] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-21T18:13:11.180014] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:13:11.351008] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-21T18:13:12.151023] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-21T18:13:12.264004] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T18:13:12.951051] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-21T18:13:13.060181] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T18:13:13.140273] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-21T18:13:13.751048] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-21T18:13:14.551017] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-21T18:13:14.712897] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T18:13:15.351035] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-21T18:13:15.693000] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-21T18:13:16.150998] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-21T18:13:16.456545] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T18:13:16.951060] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-21T18:13:17.011881] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T18:13:17.751027] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-21T18:13:18.153908] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-21T18:13:18.551030] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-21T18:13:18.969447] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-21T18:13:19.103635] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T18:13:19.126148] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-21T18:13:19.351007] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-21T18:13:20.151018] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-21T18:13:20.392883] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-21T18:13:20.951114] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-21T18:13:21.751067] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-21T18:13:21.822086] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T18:13:21.829789] [INFO ] [REMOTE ] CYH: Full fetch complete (69831 records). [2025-10-21T18:13:21.829938] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-21T18:13:22.218191] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-21T18:13:22.218267] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-21T18:13:22.219092] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-21T18:13:22.219156] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-21T18:13:22.220409] [DEBUG] [LOCAL ] CYH: Trimmed 69831 records to 47712 (keeping 200 days of data) [2025-10-21T18:13:22.475534] [DEBUG] [LOCAL ] CYH: Primary data saved (47712 records). [2025-10-21T18:13:22.475678] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-21T18:13:22.476437] [INFO ] [MAIN ] Update Progress: 581/2366 symbols completed. CYH took 25.1s. Estimated remaining: 3h 45m 13s. Rate: 7.9 symbols/min [2025-10-21T18:13:22.556097] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-21T18:13:22.649369] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:13:22.693948] [DEBUG] [LOCAL ] DAN: Loaded 49407 existing records from primary storage. [2025-10-21T18:13:22.694246] [INFO ] [MAIN ] DAN: Loaded 49407 existing records. [2025-10-21T18:13:22.868108] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:13:22.868330] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-21T18:13:22.868390] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-21T18:13:22.868855] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-21T18:13:22.868911] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-21T18:13:23.224639] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:13:23.350988] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-21T18:13:23.365757] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T18:13:23.465115] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-21T18:13:23.659138] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T18:13:24.151065] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-21T18:13:24.951084] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-21T18:13:25.041977] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-21T18:13:25.227968] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T18:13:25.751094] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-21T18:13:26.551054] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-21T18:13:26.899627] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-21T18:13:27.119998] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T18:13:27.351015] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-21T18:13:27.435557] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-21T18:13:28.151062] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-21T18:13:28.951033] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-21T18:13:29.643327] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-21T18:13:29.753213] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-21T18:13:29.758582] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T18:13:30.539864] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T18:13:30.550971] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-21T18:13:30.785329] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T18:13:31.315798] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-21T18:13:31.350987] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-21T18:13:32.151053] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-21T18:13:32.522960] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T18:13:32.525369] [INFO ] [REMOTE ] DAC: Full fetch complete (19192 records). [2025-10-21T18:13:32.525439] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-21T18:13:32.894735] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-21T18:13:32.894821] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-21T18:13:32.895201] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-21T18:13:32.895239] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-21T18:13:32.895841] [DEBUG] [LOCAL ] DAC: Trimmed 19192 records to 12508 (keeping 200 days of data) [2025-10-21T18:13:32.952685] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-21T18:13:32.975033] [DEBUG] [LOCAL ] DAC: Primary data saved (12508 records). [2025-10-21T18:13:32.975154] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-21T18:13:32.975234] [INFO ] [MAIN ] Update Progress: 582/2366 symbols completed. DAC took 24.1s. Estimated remaining: 3h 45m 15s. Rate: 7.9 symbols/min [2025-10-21T18:13:33.162536] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:13:33.181506] [DEBUG] [LOCAL ] DAO: Loaded 19694 existing records from primary storage. [2025-10-21T18:13:33.181771] [INFO ] [MAIN ] DAO: Loaded 19694 existing records. [2025-10-21T18:13:33.362907] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:13:33.363099] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-21T18:13:33.363147] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-21T18:13:33.363577] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-21T18:13:33.363635] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-21T18:13:33.730282] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:13:33.750974] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-21T18:13:33.912452] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T18:13:34.551014] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-21T18:13:35.178322] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-21T18:13:35.351008] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-21T18:13:35.487322] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-21T18:13:35.521573] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T18:13:36.151023] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-21T18:13:36.951059] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-21T18:13:37.252016] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T18:13:37.260621] [INFO ] [REMOTE ] D: Full fetch complete (77812 records). [2025-10-21T18:13:37.260788] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-21T18:13:37.659330] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-21T18:13:37.659442] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-21T18:13:37.660359] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-21T18:13:37.660453] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-21T18:13:37.661923] [DEBUG] [LOCAL ] D: Trimmed 77812 records to 53649 (keeping 200 days of data) [2025-10-21T18:13:37.777110] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-21T18:13:37.783765] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-21T18:13:38.022923] [DEBUG] [LOCAL ] D: Primary data saved (53649 records). [2025-10-21T18:13:38.023229] [INFO ] [MAIN ] D: Full history saved. [2025-10-21T18:13:38.023739] [INFO ] [MAIN ] Update Progress: 583/2366 symbols completed. D took 38.6s. Estimated remaining: 3h 44m 59s. Rate: 7.9 symbols/min [2025-10-21T18:13:38.192152] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:13:38.243636] [DEBUG] [LOCAL ] DAR: Loaded 51998 existing records from primary storage. [2025-10-21T18:13:38.244002] [INFO ] [MAIN ] DAR: Loaded 51998 existing records. [2025-10-21T18:13:38.364414] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T18:13:38.447272] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:13:38.447490] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-21T18:13:38.447539] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-21T18:13:38.447926] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-21T18:13:38.447983] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-21T18:13:38.556199] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-21T18:13:38.803214] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:13:39.325595] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T18:13:39.350998] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-21T18:13:40.151035] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-21T18:13:40.737270] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-21T18:13:40.950998] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-21T18:13:41.045779] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T18:13:41.139206] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T18:13:41.751074] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-21T18:13:42.551030] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-21T18:13:43.069078] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-21T18:13:43.095993] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-21T18:13:43.351031] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-21T18:13:44.151038] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-21T18:13:44.280794] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T18:13:44.377859] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T18:13:44.951038] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-21T18:13:45.751082] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-21T18:13:46.018943] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T18:13:46.170671] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T18:13:46.551020] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-21T18:13:47.351031] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-21T18:13:47.464437] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T18:13:47.542789] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T18:13:48.151079] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-21T18:13:48.813209] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T18:13:48.951015] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-21T18:13:49.011755] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T18:13:49.751066] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-21T18:13:50.551046] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-21T18:13:50.647995] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T18:13:50.800479] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T18:13:51.351077] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-21T18:13:52.150988] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-21T18:13:52.414469] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T18:13:52.951069] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-21T18:13:52.980510] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T18:13:52.989280] [INFO ] [REMOTE ] DAL: Full fetch complete (77931 records). [2025-10-21T18:13:52.989421] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-21T18:13:53.415110] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-21T18:13:53.415232] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-21T18:13:53.416126] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-21T18:13:53.416217] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-21T18:13:53.418819] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-21T18:13:53.430245] [DEBUG] [LOCAL ] DAL: Trimmed 77931 records to 53753 (keeping 200 days of data) [2025-10-21T18:13:53.749553] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-10-21T18:13:53.749693] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-21T18:13:53.749778] [INFO ] [MAIN ] Update Progress: 584/2366 symbols completed. DAL took 43.4s. Estimated remaining: 3h 45m 17s. Rate: 7.9 symbols/min [2025-10-21T18:13:53.760715] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-21T18:13:53.922520] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:13:53.960598] [DEBUG] [LOCAL ] DAVA: Loaded 41996 existing records from primary storage. [2025-10-21T18:13:53.960940] [INFO ] [MAIN ] DAVA: Loaded 41996 existing records. [2025-10-21T18:13:54.142835] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T18:13:54.147945] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:13:54.148212] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-21T18:13:54.151190] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-21T18:13:54.151838] [INFO ] [REMOTE ] DAO: Full fetch complete (32550 records). [2025-10-21T18:13:54.151908] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-21T18:13:54.183562] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-21T18:13:54.215257] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-21T18:13:54.559273] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-21T18:13:54.859798] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-21T18:13:54.874156] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-21T18:13:54.878926] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-21T18:13:54.879007] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-21T18:13:54.878348] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:13:54.879879] [DEBUG] [LOCAL ] DAO: Trimmed 32550 records to 19753 (keeping 200 days of data) [2025-10-21T18:13:54.985605] [DEBUG] [LOCAL ] DAO: Primary data saved (19753 records). [2025-10-21T18:13:54.985816] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-21T18:13:54.985946] [INFO ] [MAIN ] Update Progress: 585/2366 symbols completed. DAO took 22.0s. Estimated remaining: 3h 44m 50s. Rate: 7.9 symbols/min [2025-10-21T18:13:55.152098] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:13:55.195619] [DEBUG] [LOCAL ] DAY: Loaded 49167 existing records from primary storage. [2025-10-21T18:13:55.195933] [INFO ] [MAIN ] DAY: Loaded 49167 existing records. [2025-10-21T18:13:55.356483] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-21T18:13:55.378878] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:13:55.379077] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-21T18:13:55.379131] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-21T18:13:55.379968] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-21T18:13:55.380026] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-21T18:13:55.690079] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-21T18:13:55.748176] [INFO ] [REMOTE ] DAN: Full fetch complete (71355 records). [2025-10-21T18:13:55.774096] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-21T18:13:55.777209] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:13:56.154897] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-21T18:13:56.155442] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-21T18:13:56.156263] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-21T18:13:56.157144] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-21T18:13:56.157207] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-21T18:13:56.158768] [DEBUG] [LOCAL ] DAN: Trimmed 71355 records to 49394 (keeping 200 days of data) [2025-10-21T18:13:56.451919] [DEBUG] [LOCAL ] DAN: Primary data saved (49394 records). [2025-10-21T18:13:56.452049] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-21T18:13:56.452787] [INFO ] [MAIN ] Update Progress: 586/2366 symbols completed. DAN took 34.0s. Estimated remaining: 3h 44m 24s. Rate: 7.9 symbols/min [2025-10-21T18:13:56.624733] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:13:56.675610] [DEBUG] [LOCAL ] DB: Loaded 52484 existing records from primary storage. [2025-10-21T18:13:56.676020] [INFO ] [MAIN ] DB: Loaded 52484 existing records. [2025-10-21T18:13:56.902854] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:13:56.906623] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-21T18:13:56.904570] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-21T18:13:56.907249] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-21T18:13:56.924850] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-21T18:13:56.926867] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-21T18:13:56.926950] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-21T18:13:56.958769] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-21T18:13:57.292924] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:13:57.690074] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T18:13:57.750988] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-21T18:13:58.556150] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-21T18:13:58.576783] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T18:13:58.731210] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T18:13:59.351043] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-21T18:14:00.151052] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-21T18:14:00.362387] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T18:14:00.951065] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-21T18:14:01.440375] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T18:14:01.473150] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-21T18:14:01.751062] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-21T18:14:02.541999] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T18:14:02.552591] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-21T18:14:03.351063] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-21T18:14:03.461152] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T18:14:04.097328] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T18:14:04.150988] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-21T18:14:04.951042] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-21T18:14:05.025757] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T18:14:05.557574] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T18:14:05.750999] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-21T18:14:06.551012] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-21T18:14:06.604419] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T18:14:07.351014] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-21T18:14:07.579901] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T18:14:08.151002] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-21T18:14:08.407911] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T18:14:08.951017] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-21T18:14:09.264750] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T18:14:09.589131] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T18:14:09.751021] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-21T18:14:10.551065] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-21T18:14:11.245443] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T18:14:11.293081] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-21T18:14:11.351017] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-21T18:14:11.636287] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-21T18:14:12.151060] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-21T18:14:12.951072] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-21T18:14:13.417234] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-21T18:14:13.750999] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-21T18:14:14.121005] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-21T18:14:14.129059] [INFO ] [REMOTE ] DAR: Full fetch complete (75059 records). [2025-10-21T18:14:14.129188] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-21T18:14:14.528215] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T18:14:14.555569] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-21T18:14:14.551705] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-21T18:14:14.562041] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-21T18:14:14.564010] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-21T18:14:14.564763] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-21T18:14:14.567098] [DEBUG] [LOCAL ] DAR: Trimmed 75059 records to 52006 (keeping 200 days of data) [2025-10-21T18:14:14.864865] [DEBUG] [LOCAL ] DAR: Primary data saved (52006 records). [2025-10-21T18:14:14.865000] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-21T18:14:14.865359] [INFO ] [MAIN ] Update Progress: 587/2366 symbols completed. DAR took 36.8s. Estimated remaining: 3h 44m 49s. Rate: 7.9 symbols/min [2025-10-21T18:14:15.032763] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:14:15.032945] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-21T18:14:15.032981] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-21T18:14:15.033083] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-21T18:14:15.033123] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-21T18:14:15.033165] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-21T18:14:15.033198] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-21T18:14:15.358897] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-21T18:14:15.398725] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:14:15.678120] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-21T18:14:16.151000] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-21T18:14:16.563512] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-21T18:14:16.950983] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-21T18:14:17.227514] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T18:14:17.750997] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-21T18:14:17.955970] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T18:14:18.551021] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-21T18:14:18.782172] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T18:14:19.350987] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-21T18:14:19.367426] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-21T18:14:19.689468] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-21T18:14:19.700259] [INFO ] [REMOTE ] DAVA: Full fetch complete (57217 records). [2025-10-21T18:14:19.700626] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-21T18:14:20.106554] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-21T18:14:20.106627] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-21T18:14:20.107406] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-21T18:14:20.107459] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-21T18:14:20.108598] [DEBUG] [LOCAL ] DAVA: Trimmed 57217 records to 41991 (keeping 200 days of data) [2025-10-21T18:14:20.155943] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-21T18:14:20.347058] [DEBUG] [LOCAL ] DAVA: Primary data saved (41991 records). [2025-10-21T18:14:20.347174] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-21T18:14:20.347246] [INFO ] [MAIN ] Update Progress: 588/2366 symbols completed. DAVA took 26.6s. Estimated remaining: 3h 44m 35s. Rate: 7.9 symbols/min [2025-10-21T18:14:20.516780] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:14:20.554768] [DEBUG] [LOCAL ] DBI: Loaded 43623 existing records from primary storage. [2025-10-21T18:14:20.555043] [INFO ] [MAIN ] DBI: Loaded 43623 existing records. [2025-10-21T18:14:20.733744] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:14:20.733963] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-21T18:14:20.734009] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-21T18:14:20.734465] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-21T18:14:20.734521] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-21T18:14:20.964798] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-21T18:14:21.110282] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:14:21.243174] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-21T18:14:21.750992] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-21T18:14:22.046764] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-21T18:14:22.269673] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-21T18:14:22.551079] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-21T18:14:23.351057] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-21T18:14:23.558365] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T18:14:23.566791] [INFO ] [REMOTE ] DAY: Full fetch complete (71797 records). [2025-10-21T18:14:23.566972] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-21T18:14:24.005991] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-21T18:14:24.006067] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-21T18:14:24.006895] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-21T18:14:24.006958] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-21T18:14:24.008245] [DEBUG] [LOCAL ] DAY: Trimmed 71797 records to 49140 (keeping 200 days of data) [2025-10-21T18:14:24.169695] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-21T18:14:24.236331] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-21T18:14:24.296323] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T18:14:24.369396] [DEBUG] [LOCAL ] DAY: Primary data saved (49140 records). [2025-10-21T18:14:24.369635] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-21T18:14:24.370560] [INFO ] [MAIN ] Update Progress: 589/2366 symbols completed. DAY took 29.4s. Estimated remaining: 3h 44m 17s. Rate: 7.9 symbols/min [2025-10-21T18:14:24.553522] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:14:24.553802] [DEBUG] [LOCAL ] DBL: No existing data file found in primary storage. [2025-10-21T18:14:24.553916] [WARN ] [MAIN ] DBL: No existing data found, performing full refresh instead. [2025-10-21T18:14:24.554014] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-21T18:14:24.554055] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-21T18:14:24.554096] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-21T18:14:24.554131] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-21T18:14:24.919680] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:14:24.951073] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-21T18:14:25.751020] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-21T18:14:25.818471] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T18:14:25.889045] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-21T18:14:26.551084] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-21T18:14:27.351023] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-21T18:14:27.700127] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-21T18:14:27.737964] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T18:14:28.151006] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-21T18:14:28.364869] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T18:14:28.951028] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-21T18:14:29.750999] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-21T18:14:29.912633] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-21T18:14:29.920913] [INFO ] [REMOTE ] DB: Full fetch complete (75576 records). [2025-10-21T18:14:29.921051] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-21T18:14:30.323354] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-21T18:14:30.323504] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-21T18:14:30.324408] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-21T18:14:30.324490] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-21T18:14:30.326005] [DEBUG] [LOCAL ] DB: Trimmed 75576 records to 52474 (keeping 200 days of data) [2025-10-21T18:14:30.558243] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-21T18:14:30.574800] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T18:14:30.672519] [DEBUG] [LOCAL ] DB: Primary data saved (52474 records). [2025-10-21T18:14:30.672664] [INFO ] [MAIN ] DB: Full history saved. [2025-10-21T18:14:30.673592] [INFO ] [MAIN ] Update Progress: 590/2366 symbols completed. DB took 34.2s. Estimated remaining: 3h 44m 5s. Rate: 7.9 symbols/min [2025-10-21T18:14:30.851870] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:14:30.867981] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-21T18:14:30.914906] [DEBUG] [LOCAL ] DBRG: Loaded 49985 existing records from primary storage. [2025-10-21T18:14:30.915198] [INFO ] [MAIN ] DBRG: Loaded 49985 existing records. [2025-10-21T18:14:31.096037] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:14:31.096750] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-21T18:14:31.096801] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-21T18:14:31.097582] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-21T18:14:31.097639] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-21T18:14:31.356014] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-21T18:14:31.456378] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T18:14:31.489261] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:14:32.151076] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-21T18:14:32.687032] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T18:14:32.951033] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-21T18:14:33.578832] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-21T18:14:33.751011] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-21T18:14:33.918487] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T18:14:34.551085] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-21T18:14:35.215152] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-21T18:14:35.351003] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-21T18:14:35.617408] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T18:14:36.151092] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-21T18:14:36.951008] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-21T18:14:37.027198] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T18:14:37.428725] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-21T18:14:37.756523] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-21T18:14:37.762254] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-21T18:14:38.550996] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-21T18:14:38.916006] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-21T18:14:39.351055] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-21T18:14:40.119121] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T18:14:40.150978] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-21T18:14:40.494561] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-21T18:14:40.951013] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-21T18:14:41.751058] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-21T18:14:41.924847] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T18:14:41.963147] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T18:14:42.551028] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-21T18:14:43.104231] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T18:14:43.351074] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-21T18:14:43.448674] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T18:14:43.452786] [INFO ] [REMOTE ] DBD: Full fetch complete (31771 records). [2025-10-21T18:14:43.452936] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-21T18:14:43.453489] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:14:43.453620] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:14:43.453707] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:14:43.453782] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-21T18:14:43.453847] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-21T18:14:43.453882] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-21T18:14:43.453977] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-21T18:14:43.454041] [INFO ] [MAIN ] Update Progress: 591/2366 symbols completed. DBD took 28.6s. Estimated remaining: 3h 44m 13s. Rate: 7.9 symbols/min [2025-10-21T18:14:43.633418] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:14:43.633605] [DEBUG] [LOCAL ] DCI: No existing data file found in primary storage. [2025-10-21T18:14:43.633689] [WARN ] [MAIN ] DCI: No existing data found, performing full refresh instead. [2025-10-21T18:14:43.633822] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-21T18:14:43.633865] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-21T18:14:43.633907] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-10-21T18:14:43.633940] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-21T18:14:44.004237] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:14:44.151008] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-21T18:14:44.951043] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-21T18:14:45.751068] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-21T18:14:45.785619] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-21T18:14:46.393436] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T18:14:46.551022] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-21T18:14:46.654209] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-21T18:14:47.237449] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (3.09 seconds). [2025-10-21T18:14:47.351005] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-21T18:14:48.029336] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T18:14:48.151011] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-21T18:14:48.691716] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T18:14:48.951052] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-21T18:14:49.595514] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T18:14:49.751006] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-21T18:14:49.776275] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-21T18:14:50.551018] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-21T18:14:51.151043] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-21T18:14:51.282957] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T18:14:51.288885] [INFO ] [REMOTE ] DBI: Full fetch complete (64850 records). [2025-10-21T18:14:51.288989] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-21T18:14:51.356209] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-21T18:14:51.677398] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-21T18:14:51.677476] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-21T18:14:51.678354] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-21T18:14:51.678417] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-21T18:14:51.679591] [DEBUG] [LOCAL ] DBI: Trimmed 64850 records to 43510 (keeping 200 days of data) [2025-10-21T18:14:51.925835] [DEBUG] [LOCAL ] DBI: Primary data saved (43510 records). [2025-10-21T18:14:51.925963] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-21T18:14:51.926040] [INFO ] [MAIN ] Update Progress: 592/2366 symbols completed. DBI took 31.6s. Estimated remaining: 3h 44m 8s. Rate: 7.9 symbols/min [2025-10-21T18:14:52.092400] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:14:52.108230] [DEBUG] [LOCAL ] DCO: Loaded 14765 existing records from primary storage. [2025-10-21T18:14:52.108454] [INFO ] [MAIN ] DCO: Loaded 14765 existing records. [2025-10-21T18:14:52.163005] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-21T18:14:52.285991] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:14:52.286230] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-21T18:14:52.286277] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-21T18:14:52.286505] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-21T18:14:52.286562] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-21T18:14:52.672027] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:14:52.910999] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T18:14:52.951008] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-21T18:14:53.033267] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-21T18:14:53.751082] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-21T18:14:54.515981] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-21T18:14:54.550984] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-21T18:14:54.706676] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T18:14:55.351024] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-21T18:14:55.446375] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-21T18:14:56.151029] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-21T18:14:56.185046] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T18:14:56.186736] [INFO ] [REMOTE ] DBL: Full fetch complete (12672 records). [2025-10-21T18:14:56.186805] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-21T18:14:56.553491] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-21T18:14:56.553568] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-21T18:14:56.553894] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-21T18:14:56.553959] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-21T18:14:56.554439] [DEBUG] [LOCAL ] DBL: Trimmed 12672 records to 9364 (keeping 200 days of data) [2025-10-21T18:14:56.612518] [DEBUG] [LOCAL ] DBL: Primary data saved (9364 records). [2025-10-21T18:14:56.612666] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-21T18:14:56.612755] [INFO ] [MAIN ] Update Progress: 593/2366 symbols completed. DBL took 32.2s. Estimated remaining: 3h 43m 52s. Rate: 7.9 symbols/min [2025-10-21T18:14:56.785764] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:14:56.836426] [DEBUG] [LOCAL ] DD: Loaded 52934 existing records from primary storage. [2025-10-21T18:14:56.836759] [INFO ] [MAIN ] DD: Loaded 52934 existing records. [2025-10-21T18:14:56.956121] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-21T18:14:57.021230] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:14:57.021492] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-21T18:14:57.021540] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-21T18:14:57.022422] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-21T18:14:57.022481] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-21T18:14:57.378506] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:14:57.756088] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-21T18:14:57.772095] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T18:14:57.805051] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-21T18:14:58.551030] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-21T18:14:59.350992] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-21T18:14:59.601434] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-21T18:15:00.151067] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-21T18:15:00.336588] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T18:15:00.842224] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T18:15:00.951026] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-21T18:15:01.201145] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-21T18:15:01.751029] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-21T18:15:02.551049] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-21T18:15:02.794664] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-21T18:15:03.351165] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-21T18:15:03.368924] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T18:15:03.821974] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-21T18:15:04.151084] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-21T18:15:04.958434] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-21T18:15:04.980227] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T18:15:05.751019] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-21T18:15:06.034060] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T18:15:06.550994] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-21T18:15:06.738830] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T18:15:06.966809] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T18:15:07.351018] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-21T18:15:08.151009] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-21T18:15:08.545350] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-21T18:15:08.820568] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T18:15:08.829249] [INFO ] [REMOTE ] DBRG: Full fetch complete (72531 records). [2025-10-21T18:15:08.829386] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-21T18:15:08.956131] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-21T18:15:09.280874] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-21T18:15:09.280044] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-21T18:15:09.285296] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-21T18:15:09.286915] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-21T18:15:09.287012] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-21T18:15:09.288832] [DEBUG] [LOCAL ] DBRG: Trimmed 72531 records to 49982 (keeping 200 days of data) [2025-10-21T18:15:09.723428] [DEBUG] [LOCAL ] DBRG: Primary data saved (49982 records). [2025-10-21T18:15:09.723599] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-21T18:15:09.724420] [INFO ] [MAIN ] Update Progress: 594/2366 symbols completed. DBRG took 39.1s. Estimated remaining: 3h 44m 1s. Rate: 7.9 symbols/min [2025-10-21T18:15:09.762234] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-21T18:15:09.984267] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:15:10.055769] [DEBUG] [LOCAL ] DDD: Loaded 50939 existing records from primary storage. [2025-10-21T18:15:10.056251] [INFO ] [MAIN ] DDD: Loaded 50939 existing records. [2025-10-21T18:15:10.259779] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:15:10.260061] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-21T18:15:10.260125] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-21T18:15:10.260985] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-21T18:15:10.261063] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-21T18:15:10.551007] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-21T18:15:10.662725] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:15:10.852837] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T18:15:10.890878] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-21T18:15:11.351061] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-21T18:15:12.151065] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-21T18:15:12.194053] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T18:15:12.951023] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-21T18:15:13.036029] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T18:15:13.162285] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-21T18:15:13.751052] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-21T18:15:14.550988] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-21T18:15:14.741945] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T18:15:15.351000] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-21T18:15:15.815042] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-21T18:15:16.124689] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-21T18:15:16.150991] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-21T18:15:16.419106] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-21T18:15:16.422348] [INFO ] [REMOTE ] DCO: Full fetch complete (19637 records). [2025-10-21T18:15:16.422419] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-21T18:15:16.774261] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-21T18:15:16.774336] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-21T18:15:16.774749] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-21T18:15:16.774808] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-21T18:15:16.775415] [DEBUG] [LOCAL ] DCO: Trimmed 19637 records to 14899 (keeping 200 days of data) [2025-10-21T18:15:16.859139] [DEBUG] [LOCAL ] DCO: Primary data saved (14899 records). [2025-10-21T18:15:16.859267] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-21T18:15:16.859340] [INFO ] [MAIN ] Update Progress: 595/2366 symbols completed. DCO took 24.9s. Estimated remaining: 3h 43m 52s. Rate: 7.9 symbols/min [2025-10-21T18:15:16.956471] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-21T18:15:17.028371] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:15:17.061073] [DEBUG] [LOCAL ] DDL: Loaded 37211 existing records from primary storage. [2025-10-21T18:15:17.061335] [INFO ] [MAIN ] DDL: Loaded 37211 existing records. [2025-10-21T18:15:17.237895] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:15:17.238135] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-21T18:15:17.238201] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-21T18:15:17.238709] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-21T18:15:17.238766] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-21T18:15:17.588816] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:15:17.753013] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-21T18:15:17.756133] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T18:15:18.551058] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-21T18:15:18.899272] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-21T18:15:19.321773] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T18:15:19.350990] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-21T18:15:19.707349] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T18:15:19.712840] [INFO ] [REMOTE ] DCI: Full fetch complete (53640 records). [2025-10-21T18:15:19.712954] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-21T18:15:20.106745] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-21T18:15:20.106842] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-21T18:15:20.107685] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-21T18:15:20.107765] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-21T18:15:20.109230] [DEBUG] [LOCAL ] DCI: Trimmed 53640 records to 36912 (keeping 200 days of data) [2025-10-21T18:15:20.166959] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-21T18:15:20.332250] [DEBUG] [LOCAL ] DCI: Primary data saved (36912 records). [2025-10-21T18:15:20.332376] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-21T18:15:20.332444] [INFO ] [MAIN ] Update Progress: 596/2366 symbols completed. DCI took 36.9s. Estimated remaining: 3h 43m 32s. Rate: 7.9 symbols/min [2025-10-21T18:15:20.503257] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:15:20.503437] [DEBUG] [LOCAL ] DDS: No existing data file found in primary storage. [2025-10-21T18:15:20.503492] [WARN ] [MAIN ] DDS: No existing data found, performing full refresh instead. [2025-10-21T18:15:20.503602] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-21T18:15:20.503678] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-21T18:15:20.503761] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-10-21T18:15:20.503801] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-21T18:15:20.858865] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:15:20.951015] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-21T18:15:21.169785] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T18:15:21.751036] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-21T18:15:22.097104] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T18:15:22.379838] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T18:15:22.551046] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-21T18:15:23.295379] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T18:15:23.351001] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-21T18:15:23.463862] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-21T18:15:24.151060] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-21T18:15:24.858813] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T18:15:24.951083] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-21T18:15:25.560164] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T18:15:25.751072] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-21T18:15:25.876777] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T18:15:25.885151] [INFO ] [REMOTE ] DD: Full fetch complete (76621 records). [2025-10-21T18:15:25.885293] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-21T18:15:26.284944] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-21T18:15:26.285036] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-21T18:15:26.286036] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-21T18:15:26.286106] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-21T18:15:26.287589] [DEBUG] [LOCAL ] DD: Trimmed 76621 records to 52933 (keeping 200 days of data) [2025-10-21T18:15:26.551113] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-21T18:15:26.632795] [DEBUG] [LOCAL ] DD: Primary data saved (52933 records). [2025-10-21T18:15:26.632985] [INFO ] [MAIN ] DD: Full history saved. [2025-10-21T18:15:26.633838] [INFO ] [MAIN ] Update Progress: 597/2366 symbols completed. DD took 30.0s. Estimated remaining: 3h 43m 21s. Rate: 7.9 symbols/min [2025-10-21T18:15:26.811304] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T18:15:27.351101] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-21T18:15:28.158693] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-21T18:15:28.174119] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T18:15:28.193051] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-21T18:15:28.951027] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-21T18:15:29.733508] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T18:15:29.750990] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-21T18:15:29.829061] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-21T18:15:30.551023] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-21T18:15:31.351003] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-21T18:15:31.384956] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-21T18:15:31.559877] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T18:15:32.151042] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-21T18:15:32.951032] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-21T18:15:33.037442] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T18:15:33.751063] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-21T18:15:33.807982] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T18:15:34.104142] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-21T18:15:34.551118] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-21T18:15:35.351011] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-21T18:15:35.411922] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T18:15:36.053529] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-21T18:15:36.151038] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-21T18:15:36.385792] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T18:15:36.802313] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-21T18:15:36.951109] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-21T18:15:37.751027] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-21T18:15:37.849608] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T18:15:37.851390] [INFO ] [REMOTE ] DDS: Full fetch complete (18508 records). [2025-10-21T18:15:37.851463] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-21T18:15:38.236788] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-21T18:15:38.236887] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-21T18:15:38.237288] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-21T18:15:38.237327] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-21T18:15:38.237877] [DEBUG] [LOCAL ] DDS: Trimmed 18508 records to 12448 (keeping 200 days of data) [2025-10-21T18:15:38.312984] [DEBUG] [LOCAL ] DDS: Primary data saved (12448 records). [2025-10-21T18:15:38.313110] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-21T18:15:38.313178] [INFO ] [MAIN ] Update Progress: 598/2366 symbols completed. DDS took 18.0s. Estimated remaining: 3h 43m 26s. Rate: 7.9 symbols/min [2025-10-21T18:15:38.551045] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-21T18:15:39.660665] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-21T18:15:39.687443] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-21T18:15:39.689473] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T18:15:40.151024] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-21T18:15:41.399444] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T18:15:41.407311] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-21T18:15:41.862571] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-21T18:15:41.870619] [INFO ] [REMOTE ] DDD: Full fetch complete (73946 records). [2025-10-21T18:15:41.870776] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-21T18:15:42.259408] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-21T18:15:42.259489] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-21T18:15:42.260351] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-21T18:15:42.260412] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-21T18:15:42.261803] [DEBUG] [LOCAL ] DDD: Trimmed 73946 records to 50947 (keeping 200 days of data) [2025-10-21T18:15:42.551261] [DEBUG] [LOCAL ] DDD: Primary data saved (50947 records). [2025-10-21T18:15:42.551424] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-21T18:15:42.552173] [INFO ] [MAIN ] Update Progress: 599/2366 symbols completed. DDD took 32.8s. Estimated remaining: 3h 43m 8s. Rate: 7.9 symbols/min [2025-10-21T18:15:42.652698] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T18:15:42.659477] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-21T18:15:44.215227] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T18:15:44.224377] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-21T18:15:45.908405] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T18:15:45.915604] [INFO ] [REMOTE ] DDL: Full fetch complete (53636 records). [2025-10-21T18:15:45.915747] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-21T18:15:46.342717] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-21T18:15:46.342837] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-21T18:15:46.343813] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-21T18:15:46.343881] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-21T18:15:46.345547] [DEBUG] [LOCAL ] DDL: Trimmed 53636 records to 37279 (keeping 200 days of data) [2025-10-21T18:15:46.584359] [DEBUG] [LOCAL ] DDL: Primary data saved (37279 records). [2025-10-21T18:15:46.584635] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-21T18:15:46.584816] [INFO ] [MAIN ] Update Progress: 600/2366 symbols completed. DDL took 29.7s. Estimated remaining: 3h 42m 50s. Rate: 7.9 symbols/min [2025-10-21T18:15:47.220024] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:15:47.250620] [DEBUG] [LOCAL ] DE: No existing data file found in primary storage. [2025-10-21T18:15:47.276107] [WARN ] [MAIN ] DE: No existing data found, performing full refresh instead. [2025-10-21T18:15:47.276287] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-21T18:15:47.276338] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-21T18:15:47.276384] [DEBUG] [LOCAL ] DE: No primary data file found to delete. [2025-10-21T18:15:47.276425] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-21T18:15:47.337136] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:15:47.372281] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:15:47.391199] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:15:47.391541] [DEBUG] [LOCAL ] DEC: No existing data file found in primary storage. [2025-10-21T18:15:47.391449] [DEBUG] [LOCAL ] DEA: No existing data file found in primary storage. [2025-10-21T18:15:47.401340] [WARN ] [MAIN ] DEC: No existing data found, performing full refresh instead. [2025-10-21T18:15:47.411365] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-21T18:15:47.411244] [WARN ] [MAIN ] DEA: No existing data found, performing full refresh instead. [2025-10-21T18:15:47.438276] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-21T18:15:47.438669] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-21T18:15:47.455217] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-21T18:15:47.453935] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-10-21T18:15:47.485213] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-21T18:15:47.485360] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-21T18:15:47.474559] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-21T18:15:47.479953] [DEBUG] [LOCAL ] DDT: Loaded 1978 existing records from primary storage. [2025-10-21T18:15:47.590400] [INFO ] [MAIN ] DDT: Loaded 1978 existing records. [2025-10-21T18:15:48.524388] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:15:48.527212] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:15:48.582416] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-21T18:15:48.666105] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-21T18:15:48.646749] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:15:48.706289] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:15:48.706569] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-21T18:15:48.707637] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-21T18:15:48.707577] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-21T18:15:48.708405] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-21T18:15:48.708475] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-21T18:15:49.082233] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:15:49.082634] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-21T18:15:49.557616] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-21T18:15:49.558913] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-21T18:15:49.925409] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T18:15:49.930754] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-21T18:15:50.010496] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-21T18:15:50.011692] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-21T18:15:50.500187] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-21T18:15:50.501385] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-21T18:15:50.532328] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T18:15:50.541500] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-21T18:15:50.573867] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-21T18:15:50.583433] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-21T18:15:50.937126] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-21T18:15:51.128562] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-21T18:15:51.351026] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-21T18:15:51.845872] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-21T18:15:52.151017] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-21T18:15:52.183631] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T18:15:52.492599] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T18:15:52.951050] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-21T18:15:53.471561] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-21T18:15:53.632762] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T18:15:53.751042] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-21T18:15:54.551074] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-21T18:15:55.070273] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-21T18:15:55.351051] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-21T18:15:55.490887] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T18:15:56.151044] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-21T18:15:56.762407] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T18:15:56.951024] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-21T18:15:57.322147] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T18:15:57.751018] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-21T18:15:58.551005] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-21T18:15:58.687883] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T18:15:59.098195] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-21T18:15:59.350993] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-21T18:16:00.151020] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-21T18:16:00.258684] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-21T18:16:00.367600] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-21T18:16:00.562542] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-21T18:16:00.951046] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-21T18:16:01.463365] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-21T18:16:01.464530] [INFO ] [REMOTE ] DDT: Full fetch complete (2812 records). [2025-10-21T18:16:01.464620] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-21T18:16:01.465135] [FATAL] [VALIDATOR ] DDT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:16:01.465232] [FATAL] [MAIN ] DDT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:16:01.465288] [WARN ] [MAIN ] DDT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:16:01.465368] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-21T18:16:01.465447] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-21T18:16:01.465496] [INFO ] [LOCAL ] DDT: Starting deletion of derivative data. [2025-10-21T18:16:01.465704] [DEBUG] [LOCAL ] DDT: Deleted derivative data file. [2025-10-21T18:16:01.465818] [INFO ] [MAIN ] Update Progress: 601/2366 symbols completed. DDT took 14.9s. Estimated remaining: 3h 43m 4s. Rate: 7.9 symbols/min [2025-10-21T18:16:01.697330] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:16:01.697494] [DEBUG] [LOCAL ] DECK: No existing data file found in primary storage. [2025-10-21T18:16:01.697530] [WARN ] [MAIN ] DECK: No existing data found, performing full refresh instead. [2025-10-21T18:16:01.697636] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-21T18:16:01.697713] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-21T18:16:01.697760] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-10-21T18:16:01.697792] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-21T18:16:01.757611] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-21T18:16:02.158410] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:16:02.551115] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-21T18:16:03.351074] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-21T18:16:03.547320] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T18:16:04.151100] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-21T18:16:04.677015] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-21T18:16:04.951017] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-21T18:16:05.357402] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-21T18:16:05.550301] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T18:16:05.751039] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-21T18:16:06.551020] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-21T18:16:06.813384] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T18:16:07.351021] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-21T18:16:07.836968] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-21T18:16:07.992362] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T18:16:08.151056] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-21T18:16:08.914528] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T18:16:08.950995] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-21T18:16:09.719318] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T18:16:09.750991] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-21T18:16:10.551050] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-21T18:16:10.846490] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T18:16:10.900536] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-21T18:16:11.351054] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-21T18:16:11.876684] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T18:16:12.151049] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-21T18:16:12.951079] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-21T18:16:13.219551] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T18:16:13.751033] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-21T18:16:13.843177] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-21T18:16:14.315297] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-21T18:16:14.551006] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-21T18:16:14.630631] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T18:16:14.639723] [INFO ] [REMOTE ] DE: Full fetch complete (69854 records). [2025-10-21T18:16:14.640010] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-21T18:16:15.081806] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-21T18:16:15.081934] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-21T18:16:15.083266] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-21T18:16:15.083339] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-21T18:16:15.085307] [DEBUG] [LOCAL ] DE: Trimmed 69854 records to 47547 (keeping 200 days of data) [2025-10-21T18:16:15.351481] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-21T18:16:15.412257] [DEBUG] [LOCAL ] DE: Primary data saved (47547 records). [2025-10-21T18:16:15.412448] [INFO ] [MAIN ] DE: Full history saved. [2025-10-21T18:16:15.412538] [INFO ] [MAIN ] Update Progress: 602/2366 symbols completed. DE took 28.8s. Estimated remaining: 3h 43m 15s. Rate: 7.9 symbols/min [2025-10-21T18:16:15.590320] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:16:15.641609] [DEBUG] [LOCAL ] DEI: Loaded 48313 existing records from primary storage. [2025-10-21T18:16:15.642040] [INFO ] [MAIN ] DEI: Loaded 48313 existing records. [2025-10-21T18:16:15.833586] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:16:15.833907] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-21T18:16:15.834077] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-21T18:16:15.834538] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-21T18:16:15.834604] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-21T18:16:16.120174] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T18:16:16.160364] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-21T18:16:16.247982] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:16:16.951055] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-21T18:16:16.984620] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T18:16:17.751025] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-21T18:16:18.299566] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-21T18:16:18.376502] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T18:16:18.381633] [INFO ] [REMOTE ] DEC: Full fetch complete (44273 records). [2025-10-21T18:16:18.381771] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-21T18:16:18.382392] [FATAL] [VALIDATOR ] DEC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:16:18.382473] [FATAL] [MAIN ] DEC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:16:18.382516] [WARN ] [MAIN ] DEC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:16:18.382580] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-21T18:16:18.382665] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-10-21T18:16:18.382723] [INFO ] [LOCAL ] DEC: Starting deletion of derivative data. [2025-10-21T18:16:18.382768] [DEBUG] [LOCAL ] DEC: No derivative data file found to delete. [2025-10-21T18:16:18.382825] [INFO ] [MAIN ] Update Progress: 603/2366 symbols completed. DEC took 31.8s. Estimated remaining: 3h 42m 54s. Rate: 7.9 symbols/min [2025-10-21T18:16:18.556437] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-21T18:16:18.559842] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:16:18.612984] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-21T18:16:18.613310] [INFO ] [MAIN ] DELL: Loaded 53736 existing records. [2025-10-21T18:16:18.799297] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:16:18.799488] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-21T18:16:18.799534] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-21T18:16:18.799771] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-21T18:16:18.799826] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-21T18:16:19.159895] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:16:19.350998] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-21T18:16:19.452141] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T18:16:20.151023] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-21T18:16:20.730462] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-21T18:16:20.951098] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-21T18:16:21.254696] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T18:16:21.260635] [INFO ] [REMOTE ] DEA: Full fetch complete (61504 records). [2025-10-21T18:16:21.260765] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-21T18:16:21.261421] [FATAL] [VALIDATOR ] DEA: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:16:21.261506] [FATAL] [MAIN ] DEA: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:16:21.261547] [WARN ] [MAIN ] DEA: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:16:21.261612] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-21T18:16:21.261710] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-21T18:16:21.261763] [INFO ] [LOCAL ] DEA: Starting deletion of derivative data. [2025-10-21T18:16:21.261856] [DEBUG] [LOCAL ] DEA: No derivative data file found to delete. [2025-10-21T18:16:21.261926] [INFO ] [MAIN ] Update Progress: 604/2366 symbols completed. DEA took 34.7s. Estimated remaining: 3h 42m 33s. Rate: 7.9 symbols/min [2025-10-21T18:16:21.436682] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:16:21.486187] [DEBUG] [LOCAL ] DEO: Loaded 49256 existing records from primary storage. [2025-10-21T18:16:21.486553] [INFO ] [MAIN ] DEO: Loaded 49256 existing records. [2025-10-21T18:16:21.683909] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:16:21.684209] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-21T18:16:21.684300] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-21T18:16:21.684714] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-10-21T18:16:21.684773] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-21T18:16:21.756133] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-21T18:16:22.097612] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-21T18:16:22.103042] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:16:22.551053] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-21T18:16:22.952486] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-21T18:16:23.351712] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-21T18:16:23.351606] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T18:16:24.151084] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-21T18:16:24.910157] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T18:16:24.951614] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-21T18:16:24.951537] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-21T18:16:25.751060] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-21T18:16:25.866633] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T18:16:26.551009] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-21T18:16:26.786306] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T18:16:27.351076] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-21T18:16:27.988519] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-21T18:16:28.035101] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-21T18:16:28.151035] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-21T18:16:28.936321] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T18:16:28.951002] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-21T18:16:29.476399] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-21T18:16:29.751026] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-21T18:16:30.551043] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-21T18:16:31.345333] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-21T18:16:31.356486] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-21T18:16:31.601008] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T18:16:32.151020] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-21T18:16:32.205367] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T18:16:32.951035] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-21T18:16:33.277105] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-21T18:16:33.751023] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-21T18:16:34.551010] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-21T18:16:34.717635] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-21T18:16:34.777407] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T18:16:35.351028] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-21T18:16:35.934413] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-21T18:16:36.151114] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-21T18:16:36.505766] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-21T18:16:36.951058] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-21T18:16:37.762572] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-21T18:16:37.802036] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-21T18:16:37.826973] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T18:16:38.551068] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-21T18:16:39.219238] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-21T18:16:39.227404] [INFO ] [REMOTE ] DECK: Full fetch complete (76759 records). [2025-10-21T18:16:39.227576] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-21T18:16:39.228520] [FATAL] [VALIDATOR ] DECK: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:16:39.228711] [FATAL] [MAIN ] DECK: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:16:39.228765] [WARN ] [MAIN ] DECK: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:16:39.228833] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-21T18:16:39.228911] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-10-21T18:16:39.228949] [INFO ] [LOCAL ] DECK: Starting deletion of derivative data. [2025-10-21T18:16:39.228990] [DEBUG] [LOCAL ] DECK: No derivative data file found to delete. [2025-10-21T18:16:39.229050] [INFO ] [MAIN ] Update Progress: 605/2366 symbols completed. DECK took 37.8s. Estimated remaining: 3h 42m 55s. Rate: 7.9 symbols/min [2025-10-21T18:16:39.364473] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-21T18:16:39.429915] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:16:39.430285] [DEBUG] [LOCAL ] DFH: No existing data file found in primary storage. [2025-10-21T18:16:39.430465] [WARN ] [MAIN ] DFH: No existing data found, performing full refresh instead. [2025-10-21T18:16:39.430597] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-21T18:16:39.430821] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-21T18:16:39.430951] [DEBUG] [LOCAL ] DFH: No primary data file found to delete. [2025-10-21T18:16:39.431056] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-21T18:16:39.563173] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-21T18:16:39.831415] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:16:40.151028] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-21T18:16:40.349893] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T18:16:40.951040] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-21T18:16:41.461097] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-21T18:16:41.524963] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T18:16:41.751046] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-21T18:16:42.551027] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-21T18:16:43.104420] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T18:16:43.226314] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-21T18:16:43.351029] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-21T18:16:44.151026] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-21T18:16:44.187245] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T18:16:44.951088] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-21T18:16:45.751014] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-21T18:16:45.822123] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-21T18:16:46.220783] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-21T18:16:46.292972] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T18:16:46.300682] [INFO ] [REMOTE ] DEI: Full fetch complete (69925 records). [2025-10-21T18:16:46.300795] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-21T18:16:46.559740] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-21T18:16:46.727927] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-21T18:16:46.728084] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-21T18:16:46.729166] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-21T18:16:46.729237] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-21T18:16:46.731239] [DEBUG] [LOCAL ] DEI: Trimmed 69925 records to 48305 (keeping 200 days of data) [2025-10-21T18:16:47.073375] [DEBUG] [LOCAL ] DEI: Primary data saved (48305 records). [2025-10-21T18:16:47.073590] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-21T18:16:47.074145] [INFO ] [MAIN ] Update Progress: 606/2366 symbols completed. DEI took 31.7s. Estimated remaining: 3h 42m 49s. Rate: 7.9 symbols/min [2025-10-21T18:16:47.273330] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:16:47.273844] [DEBUG] [LOCAL ] DFIN: No existing data file found in primary storage. [2025-10-21T18:16:47.282119] [WARN ] [MAIN ] DFIN: No existing data found, performing full refresh instead. [2025-10-21T18:16:47.294415] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-21T18:16:47.294782] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-21T18:16:47.295297] [DEBUG] [LOCAL ] DFIN: No primary data file found to delete. [2025-10-21T18:16:47.296269] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T18:16:47.296543] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-21T18:16:47.356152] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-21T18:16:47.686147] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:16:48.151066] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-21T18:16:48.939742] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T18:16:48.950988] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-21T18:16:49.013794] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-21T18:16:49.141738] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T18:16:49.751001] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-21T18:16:50.227386] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T18:16:50.551028] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-21T18:16:51.351076] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-21T18:16:52.151060] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-21T18:16:52.181422] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T18:16:52.219886] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-21T18:16:52.227630] [INFO ] [REMOTE ] DELL: Full fetch complete (77525 records). [2025-10-21T18:16:52.227803] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-21T18:16:52.228625] [FATAL] [VALIDATOR ] DELL: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:16:52.228725] [FATAL] [MAIN ] DELL: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:16:52.228767] [WARN ] [MAIN ] DELL: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:16:52.228834] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-21T18:16:52.228899] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-10-21T18:16:52.228932] [INFO ] [LOCAL ] DELL: Starting deletion of derivative data. [2025-10-21T18:16:52.229124] [DEBUG] [LOCAL ] DELL: Deleted derivative data file. [2025-10-21T18:16:52.229213] [INFO ] [MAIN ] Update Progress: 607/2366 symbols completed. DELL took 33.8s. Estimated remaining: 3h 42m 34s. Rate: 7.9 symbols/min [2025-10-21T18:16:52.397092] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:16:52.408991] [DEBUG] [LOCAL ] DFP: Loaded 11121 existing records from primary storage. [2025-10-21T18:16:52.409181] [INFO ] [MAIN ] DFP: Loaded 11121 existing records. [2025-10-21T18:16:52.585921] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:16:52.586177] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-21T18:16:52.586230] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-21T18:16:52.586580] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-21T18:16:52.586637] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-21T18:16:52.910071] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T18:16:52.965255] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-21T18:16:52.988437] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:16:53.230274] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-21T18:16:53.751044] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-21T18:16:54.551023] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-21T18:16:54.955095] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T18:16:54.962866] [INFO ] [REMOTE ] DEO: Full fetch complete (71387 records). [2025-10-21T18:16:54.963015] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-21T18:16:54.963891] [FATAL] [VALIDATOR ] DEO: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:16:54.963984] [FATAL] [MAIN ] DEO: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:16:54.964027] [WARN ] [MAIN ] DEO: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:16:54.964089] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-21T18:16:54.964145] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-21T18:16:54.964180] [INFO ] [LOCAL ] DEO: Starting deletion of derivative data. [2025-10-21T18:16:54.964313] [DEBUG] [LOCAL ] DEO: Deleted derivative data file. [2025-10-21T18:16:54.964970] [INFO ] [MAIN ] Update Progress: 608/2366 symbols completed. DEO took 33.7s. Estimated remaining: 3h 42m 12s. Rate: 7.9 symbols/min [2025-10-21T18:16:55.159842] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:16:55.169629] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-21T18:16:55.205766] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T18:16:55.263354] [DEBUG] [LOCAL ] DG: Loaded 53269 existing records from primary storage. [2025-10-21T18:16:55.263719] [INFO ] [MAIN ] DG: Loaded 53269 existing records. [2025-10-21T18:16:55.356139] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-21T18:16:55.471275] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:16:55.471499] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-21T18:16:55.471551] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-21T18:16:55.472047] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-21T18:16:55.472105] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-21T18:16:55.929751] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:16:56.151090] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-21T18:16:56.728280] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T18:16:56.951034] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-21T18:16:57.043062] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-21T18:16:57.714471] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-21T18:16:57.751008] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-21T18:16:58.551007] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-21T18:16:58.611638] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T18:16:59.351014] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-21T18:17:00.150997] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-21T18:17:00.433390] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T18:17:00.491727] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-21T18:17:00.951055] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-21T18:17:01.208836] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-21T18:17:01.751035] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-21T18:17:02.004193] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-21T18:17:02.010097] [INFO ] [REMOTE ] DFH: Full fetch complete (47556 records). [2025-10-21T18:17:02.010222] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-21T18:17:02.407420] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-21T18:17:02.407498] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-21T18:17:02.408179] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-21T18:17:02.408243] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-21T18:17:02.409196] [DEBUG] [LOCAL ] DFH: Trimmed 47556 records to 31847 (keeping 200 days of data) [2025-10-21T18:17:02.555218] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-21T18:17:02.592918] [DEBUG] [LOCAL ] DFH: Primary data saved (31847 records). [2025-10-21T18:17:02.593094] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-21T18:17:02.593171] [INFO ] [MAIN ] Update Progress: 609/2366 symbols completed. DFH took 23.4s. Estimated remaining: 3h 42m 5s. Rate: 7.9 symbols/min [2025-10-21T18:17:02.771695] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:17:02.771818] [DEBUG] [LOCAL ] DGX: No existing data file found in primary storage. [2025-10-21T18:17:02.771855] [WARN ] [MAIN ] DGX: No existing data found, performing full refresh instead. [2025-10-21T18:17:02.771964] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-21T18:17:02.772005] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-21T18:17:02.772046] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-21T18:17:02.772078] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-21T18:17:03.124543] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T18:17:03.165169] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:17:03.249043] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-21T18:17:03.351055] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-21T18:17:04.151006] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-21T18:17:04.186609] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-21T18:17:04.951040] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-21T18:17:05.751033] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-21T18:17:05.960894] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T18:17:06.007681] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-21T18:17:06.551043] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-21T18:17:07.351058] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-21T18:17:07.389713] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T18:17:07.583898] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-21T18:17:08.151098] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-21T18:17:08.510113] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T18:17:08.951066] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-21T18:17:09.003441] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-21T18:17:09.751019] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-21T18:17:10.003096] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-21T18:17:10.551036] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-21T18:17:11.351071] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-21T18:17:11.610574] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T18:17:12.151084] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-21T18:17:12.179455] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-21T18:17:12.295032] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T18:17:12.951062] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-21T18:17:13.751075] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-21T18:17:14.067430] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-21T18:17:14.551046] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-21T18:17:14.609189] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T18:17:14.891132] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T18:17:14.894603] [INFO ] [REMOTE ] DFIN: Full fetch complete (33323 records). [2025-10-21T18:17:14.894701] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-21T18:17:15.268408] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-21T18:17:15.268506] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-21T18:17:15.269067] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-21T18:17:15.269127] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-21T18:17:15.269957] [DEBUG] [LOCAL ] DFIN: Trimmed 33323 records to 22406 (keeping 200 days of data) [2025-10-21T18:17:15.356688] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-21T18:17:15.399616] [DEBUG] [LOCAL ] DFIN: Primary data saved (22406 records). [2025-10-21T18:17:15.399766] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-21T18:17:15.399838] [INFO ] [MAIN ] Update Progress: 610/2366 symbols completed. DFIN took 28.3s. Estimated remaining: 3h 42m 12s. Rate: 7.9 symbols/min [2025-10-21T18:17:15.564751] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:17:15.564876] [DEBUG] [LOCAL ] DHF: No existing data file found in primary storage. [2025-10-21T18:17:15.564912] [WARN ] [MAIN ] DHF: No existing data found, performing full refresh instead. [2025-10-21T18:17:15.565039] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-21T18:17:15.565099] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-21T18:17:15.565143] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-10-21T18:17:15.565176] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-21T18:17:15.914985] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:17:16.151009] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-21T18:17:16.181781] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-21T18:17:16.485863] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-21T18:17:16.950996] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-21T18:17:17.750992] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-21T18:17:18.029382] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-21T18:17:18.551066] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-21T18:17:18.664877] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-21T18:17:18.836529] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-21T18:17:19.351066] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-21T18:17:19.606173] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T18:17:20.151048] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-21T18:17:20.347019] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-21T18:17:20.348700] [INFO ] [REMOTE ] DFP: Full fetch complete (15739 records). [2025-10-21T18:17:20.348768] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-21T18:17:20.704597] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-21T18:17:20.704711] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-21T18:17:20.705013] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-21T18:17:20.705073] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-21T18:17:20.705561] [DEBUG] [LOCAL ] DFP: Trimmed 15739 records to 11074 (keeping 200 days of data) [2025-10-21T18:17:20.769879] [DEBUG] [LOCAL ] DFP: Primary data saved (11074 records). [2025-10-21T18:17:20.769987] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-21T18:17:20.770060] [INFO ] [MAIN ] Update Progress: 611/2366 symbols completed. DFP took 28.5s. Estimated remaining: 3h 41m 58s. Rate: 7.9 symbols/min [2025-10-21T18:17:20.946519] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:17:20.951023] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-21T18:17:21.000359] [DEBUG] [LOCAL ] DHI: Loaded 53365 existing records from primary storage. [2025-10-21T18:17:21.000699] [INFO ] [MAIN ] DHI: Loaded 53365 existing records. [2025-10-21T18:17:21.171868] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:17:21.172072] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-21T18:17:21.172151] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-21T18:17:21.172876] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-21T18:17:21.172932] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-21T18:17:21.519108] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:17:21.750991] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-21T18:17:22.054533] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T18:17:22.240460] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T18:17:22.551092] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-21T18:17:23.351020] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-21T18:17:23.746847] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-21T18:17:24.151019] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-21T18:17:24.324306] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-21T18:17:24.951058] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-21T18:17:25.018290] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T18:17:25.227858] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T18:17:25.751027] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-21T18:17:26.550996] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-21T18:17:26.749190] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T18:17:27.214190] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T18:17:27.350982] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-21T18:17:27.621847] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T18:17:28.150986] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-21T18:17:28.398901] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-21T18:17:28.407058] [INFO ] [REMOTE ] DG: Full fetch complete (77334 records). [2025-10-21T18:17:28.407180] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-21T18:17:28.802292] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-21T18:17:28.802385] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-21T18:17:28.803319] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-21T18:17:28.803380] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-21T18:17:28.804765] [DEBUG] [LOCAL ] DG: Trimmed 77334 records to 53258 (keeping 200 days of data) [2025-10-21T18:17:28.980048] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-21T18:17:29.131000] [DEBUG] [LOCAL ] DG: Primary data saved (53258 records). [2025-10-21T18:17:29.131122] [INFO ] [MAIN ] DG: Full history saved. [2025-10-21T18:17:29.131748] [INFO ] [MAIN ] Update Progress: 612/2366 symbols completed. DG took 34.2s. Estimated remaining: 3h 41m 53s. Rate: 7.9 symbols/min [2025-10-21T18:17:29.297623] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:17:29.349132] [DEBUG] [LOCAL ] DHR: Loaded 53381 existing records from primary storage. [2025-10-21T18:17:29.349447] [INFO ] [MAIN ] DHR: Loaded 53381 existing records. [2025-10-21T18:17:29.526924] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:17:29.527139] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-21T18:17:29.527188] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-21T18:17:29.528126] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-21T18:17:29.528186] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-21T18:17:29.765493] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-21T18:17:29.896092] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:17:30.123868] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T18:17:30.551048] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-21T18:17:30.825152] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-21T18:17:30.918196] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T18:17:31.351077] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-21T18:17:32.151001] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-21T18:17:32.578748] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-21T18:17:32.951007] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-21T18:17:33.104103] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-21T18:17:33.751076] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-21T18:17:34.174430] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-21T18:17:34.551063] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-21T18:17:34.824871] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-21T18:17:34.965376] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T18:17:35.351022] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-21T18:17:36.094633] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T18:17:36.151039] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-21T18:17:36.951001] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-21T18:17:37.140628] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T18:17:37.572212] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-21T18:17:37.751029] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-21T18:17:38.366311] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-21T18:17:38.551039] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-21T18:17:39.351122] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-21T18:17:39.823976] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-21T18:17:40.151036] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-21T18:17:40.236680] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T18:17:40.951029] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-21T18:17:41.097937] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T18:17:41.751091] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-21T18:17:42.070358] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T18:17:42.550991] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-21T18:17:42.888867] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-21T18:17:42.943350] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T18:17:43.351097] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-21T18:17:43.774733] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-21T18:17:44.151037] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-21T18:17:44.951125] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-21T18:17:45.548022] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-21T18:17:45.579101] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T18:17:45.585622] [INFO ] [REMOTE ] DGX: Full fetch complete (65202 records). [2025-10-21T18:17:45.585808] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-21T18:17:45.586530] [FATAL] [VALIDATOR ] DGX: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:17:45.586617] [FATAL] [MAIN ] DGX: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:17:45.586706] [WARN ] [MAIN ] DGX: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:17:45.586780] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-21T18:17:45.586842] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-21T18:17:45.586877] [INFO ] [LOCAL ] DGX: Starting deletion of derivative data. [2025-10-21T18:17:45.586914] [DEBUG] [LOCAL ] DGX: No derivative data file found to delete. [2025-10-21T18:17:45.586967] [INFO ] [MAIN ] Update Progress: 613/2366 symbols completed. DGX took 43.0s. Estimated remaining: 3h 42m 11s. Rate: 7.9 symbols/min [2025-10-21T18:17:45.763385] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-21T18:17:45.766967] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:17:45.819941] [DEBUG] [LOCAL ] DHT: Loaded 47915 existing records from primary storage. [2025-10-21T18:17:45.820282] [INFO ] [MAIN ] DHT: Loaded 47915 existing records. [2025-10-21T18:17:46.002274] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:17:46.017861] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-21T18:17:46.018706] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-21T18:17:46.019346] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T18:17:46.025226] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-21T18:17:46.025740] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-21T18:17:46.379182] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:17:46.550984] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-21T18:17:47.136682] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T18:17:47.145168] [INFO ] [REMOTE ] DHI: Full fetch complete (77397 records). [2025-10-21T18:17:47.145316] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-21T18:17:47.357871] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-21T18:17:47.591561] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-21T18:17:47.591677] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-21T18:17:47.592672] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-21T18:17:47.592738] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-21T18:17:47.594511] [DEBUG] [LOCAL ] DHI: Trimmed 77397 records to 53364 (keeping 200 days of data) [2025-10-21T18:17:47.925486] [DEBUG] [LOCAL ] DHI: Primary data saved (53364 records). [2025-10-21T18:17:47.925635] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-21T18:17:47.925755] [INFO ] [MAIN ] Update Progress: 614/2366 symbols completed. DHI took 27.2s. Estimated remaining: 3h 41m 48s. Rate: 7.9 symbols/min [2025-10-21T18:17:48.109325] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:17:48.123494] [DEBUG] [LOCAL ] DHX: Loaded 13199 existing records from primary storage. [2025-10-21T18:17:48.123787] [INFO ] [MAIN ] DHX: Loaded 13199 existing records. [2025-10-21T18:17:48.158852] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-21T18:17:48.342561] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:17:48.342932] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-21T18:17:48.343004] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-21T18:17:48.343491] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-21T18:17:48.343552] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-21T18:17:48.578530] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-21T18:17:48.930031] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:17:48.951097] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-21T18:17:49.378140] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T18:17:49.382520] [INFO ] [REMOTE ] DHF: Full fetch complete (29772 records). [2025-10-21T18:17:49.382759] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-21T18:17:49.394507] [FATAL] [VALIDATOR ] DHF: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:17:49.415510] [FATAL] [MAIN ] DHF: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:17:49.415761] [WARN ] [MAIN ] DHF: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:17:49.415844] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-21T18:17:49.416527] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-10-21T18:17:49.416589] [INFO ] [LOCAL ] DHF: Starting deletion of derivative data. [2025-10-21T18:17:49.418464] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-21T18:17:49.428986] [DEBUG] [LOCAL ] DHF: No derivative data file found to delete. [2025-10-21T18:17:49.429518] [INFO ] [MAIN ] Update Progress: 615/2366 symbols completed. DHF took 34.0s. Estimated remaining: 3h 41m 23s. Rate: 7.9 symbols/min [2025-10-21T18:17:49.613092] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:17:49.628583] [DEBUG] [LOCAL ] DIAX: Loaded 12903 existing records from primary storage. [2025-10-21T18:17:49.628848] [INFO ] [MAIN ] DIAX: Loaded 12903 existing records. [2025-10-21T18:17:49.757595] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-21T18:17:49.849356] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:17:49.849596] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-21T18:17:49.849675] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-21T18:17:49.849853] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-21T18:17:49.849908] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-21T18:17:50.205723] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:17:50.551010] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-21T18:17:50.593946] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T18:17:51.351012] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-21T18:17:51.428739] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-21T18:17:51.847587] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T18:17:52.151017] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-21T18:17:52.951047] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-21T18:17:53.202671] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T18:17:53.612573] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T18:17:53.751043] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-21T18:17:54.168488] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-21T18:17:54.551039] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-21T18:17:55.199254] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-21T18:17:55.351002] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-21T18:17:55.419633] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-21T18:17:56.151088] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-21T18:17:56.720500] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T18:17:56.951033] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-21T18:17:57.292571] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T18:17:57.751020] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-21T18:17:58.551018] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-21T18:17:58.840921] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-21T18:17:58.921521] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-21T18:17:59.351062] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-21T18:18:00.152886] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-21T18:18:00.156862] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T18:18:00.229460] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T18:18:00.237837] [INFO ] [REMOTE ] DHR: Full fetch complete (77442 records). [2025-10-21T18:18:00.238048] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-21T18:18:00.644410] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-21T18:18:00.644489] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-21T18:18:00.645413] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-21T18:18:00.645482] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-21T18:18:00.646929] [DEBUG] [LOCAL ] DHR: Trimmed 77442 records to 53381 (keeping 200 days of data) [2025-10-21T18:18:00.956218] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-21T18:18:00.983458] [DEBUG] [LOCAL ] DHR: Primary data saved (53381 records). [2025-10-21T18:18:00.983603] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-21T18:18:00.984275] [INFO ] [MAIN ] Update Progress: 616/2366 symbols completed. DHR took 31.9s. Estimated remaining: 3h 41m 27s. Rate: 7.9 symbols/min [2025-10-21T18:18:01.160185] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:18:01.198060] [DEBUG] [LOCAL ] DIN: Loaded 37006 existing records from primary storage. [2025-10-21T18:18:01.198367] [INFO ] [MAIN ] DIN: Loaded 37006 existing records. [2025-10-21T18:18:01.396471] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:18:01.407377] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-21T18:18:01.408942] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-21T18:18:01.408311] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-21T18:18:01.412991] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-21T18:18:01.413603] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-21T18:18:01.758262] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-21T18:18:01.833993] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:18:02.551042] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-21T18:18:02.755634] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T18:18:02.963842] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-21T18:18:03.351048] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-21T18:18:03.610484] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-21T18:18:04.151045] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-21T18:18:04.950999] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-21T18:18:05.111167] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T18:18:05.158909] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T18:18:05.751082] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-21T18:18:06.541839] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T18:18:06.551029] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-21T18:18:06.570141] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T18:18:07.351038] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-21T18:18:08.151024] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-21T18:18:08.276715] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T18:18:08.392753] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T18:18:08.951010] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-21T18:18:09.427558] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T18:18:09.707326] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-21T18:18:09.751052] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-21T18:18:10.551074] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-21T18:18:10.615922] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-21T18:18:11.332208] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-21T18:18:11.350995] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-21T18:18:12.151045] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-21T18:18:12.278230] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-21T18:18:12.951059] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-21T18:18:13.626385] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T18:18:13.751003] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-21T18:18:13.991795] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-21T18:18:14.551083] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-21T18:18:15.350992] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-21T18:18:15.412938] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T18:18:16.031240] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T18:18:16.038661] [INFO ] [REMOTE ] DHT: Full fetch complete (69877 records). [2025-10-21T18:18:16.038770] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-21T18:18:16.039472] [FATAL] [VALIDATOR ] DHT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:18:16.039573] [FATAL] [MAIN ] DHT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:18:16.039672] [WARN ] [MAIN ] DHT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:18:16.039765] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-21T18:18:16.039830] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-10-21T18:18:16.039864] [INFO ] [LOCAL ] DHT: Starting deletion of derivative data. [2025-10-21T18:18:16.040005] [DEBUG] [LOCAL ] DHT: Deleted derivative data file. [2025-10-21T18:18:16.040869] [INFO ] [MAIN ] Update Progress: 617/2366 symbols completed. DHT took 30.5s. Estimated remaining: 3h 41m 40s. Rate: 7.9 symbols/min [2025-10-21T18:18:16.155013] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-21T18:18:16.155864] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T18:18:16.227486] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:18:16.277748] [DEBUG] [LOCAL ] DINO: Loaded 52842 existing records from primary storage. [2025-10-21T18:18:16.278073] [INFO ] [MAIN ] DINO: Loaded 52842 existing records. [2025-10-21T18:18:16.452638] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:18:16.452849] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-21T18:18:16.452895] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-21T18:18:16.453442] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-21T18:18:16.453498] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-21T18:18:16.802614] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:18:16.951085] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-21T18:18:17.219585] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-21T18:18:17.222692] [INFO ] [REMOTE ] DHX: Full fetch complete (21375 records). [2025-10-21T18:18:17.222830] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-21T18:18:17.223309] [FATAL] [VALIDATOR ] DHX: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:18:17.223388] [FATAL] [MAIN ] DHX: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:18:17.223456] [WARN ] [MAIN ] DHX: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:18:17.223537] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-21T18:18:17.223600] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-10-21T18:18:17.223636] [INFO ] [LOCAL ] DHX: Starting deletion of derivative data. [2025-10-21T18:18:17.223823] [DEBUG] [LOCAL ] DHX: Deleted derivative data file. [2025-10-21T18:18:17.223910] [INFO ] [MAIN ] Update Progress: 618/2366 symbols completed. DHX took 29.3s. Estimated remaining: 3h 41m 15s. Rate: 7.9 symbols/min [2025-10-21T18:18:17.411810] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:18:17.461321] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-21T18:18:17.461635] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-10-21T18:18:17.652237] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:18:17.652434] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-21T18:18:17.652480] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-21T18:18:17.653306] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-21T18:18:17.653364] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-21T18:18:17.753134] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-21T18:18:17.774698] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-21T18:18:18.029565] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:18:18.551069] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-21T18:18:19.062355] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T18:18:19.351121] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-21T18:18:20.151076] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-21T18:18:20.388249] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T18:18:20.736584] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T18:18:20.951078] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-21T18:18:21.726356] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-21T18:18:21.728964] [INFO ] [REMOTE ] DIAX: Full fetch complete (17571 records). [2025-10-21T18:18:21.729057] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-21T18:18:21.729478] [FATAL] [VALIDATOR ] DIAX: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:18:21.729563] [FATAL] [MAIN ] DIAX: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:18:21.729626] [WARN ] [MAIN ] DIAX: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:18:21.729749] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-21T18:18:21.729825] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-10-21T18:18:21.729873] [INFO ] [LOCAL ] DIAX: Starting deletion of derivative data. [2025-10-21T18:18:21.730015] [DEBUG] [LOCAL ] DIAX: Deleted derivative data file. [2025-10-21T18:18:21.730107] [INFO ] [MAIN ] Update Progress: 619/2366 symbols completed. DIAX took 32.3s. Estimated remaining: 3h 40m 58s. Rate: 7.9 symbols/min [2025-10-21T18:18:21.762571] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-21T18:18:21.908920] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:18:21.909105] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-21T18:18:21.909160] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-21T18:18:21.909270] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-21T18:18:21.909312] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-21T18:18:21.909352] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-21T18:18:21.909383] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-21T18:18:22.273077] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:18:22.551090] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-21T18:18:22.767680] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-10-21T18:18:23.350999] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-21T18:18:23.872878] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-21T18:18:24.151009] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-21T18:18:24.242353] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T18:18:24.951041] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-21T18:18:25.612532] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-21T18:18:25.716699] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T18:18:25.750981] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-21T18:18:26.245774] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T18:18:26.551019] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-21T18:18:27.086853] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-21T18:18:27.351026] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-21T18:18:27.484730] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T18:18:27.683935] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-21T18:18:28.151056] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-21T18:18:28.951024] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-21T18:18:29.429561] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-21T18:18:29.658011] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T18:18:29.750981] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-21T18:18:30.551027] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-21T18:18:31.212138] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-21T18:18:31.218479] [INFO ] [REMOTE ] DIN: Full fetch complete (54781 records). [2025-10-21T18:18:31.218658] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-21T18:18:31.362940] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-21T18:18:31.607572] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-21T18:18:31.607703] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-21T18:18:31.608486] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-21T18:18:31.608550] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-21T18:18:31.610200] [DEBUG] [LOCAL ] DIN: Trimmed 54781 records to 36831 (keeping 200 days of data) [2025-10-21T18:18:31.834904] [DEBUG] [LOCAL ] DIN: Primary data saved (36831 records). [2025-10-21T18:18:31.835043] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-21T18:18:31.835874] [INFO ] [MAIN ] Update Progress: 620/2366 symbols completed. DIN took 30.9s. Estimated remaining: 3h 40m 58s. Rate: 7.9 symbols/min [2025-10-21T18:18:32.011858] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:18:32.060320] [DEBUG] [LOCAL ] DK: Loaded 49346 existing records from primary storage. [2025-10-21T18:18:32.060698] [INFO ] [MAIN ] DK: Loaded 49346 existing records. [2025-10-21T18:18:32.156278] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-21T18:18:32.247671] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:18:32.247884] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-21T18:18:32.247932] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-21T18:18:32.248356] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-21T18:18:32.248414] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-21T18:18:32.619250] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:18:32.643399] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-21T18:18:32.950997] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-21T18:18:33.027794] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-21T18:18:33.235931] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T18:18:33.751019] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-21T18:18:34.550997] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-21T18:18:34.588539] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T18:18:34.849090] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-21T18:18:35.351037] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-21T18:18:35.950198] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-21T18:18:36.150991] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-21T18:18:36.951098] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-21T18:18:36.981180] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T18:18:37.751094] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-21T18:18:38.164622] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-21T18:18:38.551810] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-21T18:18:38.554948] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-21T18:18:39.028754] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-21T18:18:39.351063] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-21T18:18:40.151005] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-21T18:18:40.454627] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T18:18:40.614937] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-21T18:18:40.868473] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T18:18:40.950991] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-21T18:18:41.751025] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-21T18:18:42.551002] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-21T18:18:42.669753] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T18:18:42.807155] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-21T18:18:42.899130] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-21T18:18:43.351030] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-21T18:18:44.151035] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-21T18:18:44.501118] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-21T18:18:44.951081] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-21T18:18:45.417675] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-21T18:18:45.418467] [INFO ] [REMOTE ] DIVY: Full fetch complete (1700 records). [2025-10-21T18:18:45.418535] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-21T18:18:45.622913] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-21T18:18:45.623126] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:18:45.623172] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:18:45.623214] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-21T18:18:45.623268] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-21T18:18:45.623301] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-21T18:18:45.623342] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-21T18:18:45.623435] [INFO ] [MAIN ] Update Progress: 621/2366 symbols completed. DIVY took 23.9s. Estimated remaining: 3h 41m 8s. Rate: 7.9 symbols/min [2025-10-21T18:18:45.761107] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-21T18:18:45.792508] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:18:45.812119] [DEBUG] [LOCAL ] DKL: Loaded 17203 existing records from primary storage. [2025-10-21T18:18:45.812563] [INFO ] [MAIN ] DKL: Loaded 17203 existing records. [2025-10-21T18:18:45.988303] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:18:45.988521] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-21T18:18:45.988678] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-21T18:18:45.989143] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-21T18:18:45.989202] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-21T18:18:46.376895] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (3.03 seconds). [2025-10-21T18:18:46.382290] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:18:46.551029] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-21T18:18:47.351058] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-21T18:18:47.691813] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T18:18:47.731171] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-21T18:18:48.151027] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-21T18:18:48.951088] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-21T18:18:49.196109] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T18:18:49.751098] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-21T18:18:49.956929] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T18:18:49.964870] [INFO ] [REMOTE ] DINO: Full fetch complete (76720 records). [2025-10-21T18:18:49.964999] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-21T18:18:50.349223] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-21T18:18:50.349308] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-21T18:18:50.350664] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-21T18:18:50.350726] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-21T18:18:50.352328] [DEBUG] [LOCAL ] DINO: Trimmed 76720 records to 52837 (keeping 200 days of data) [2025-10-21T18:18:50.565739] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-21T18:18:50.685985] [DEBUG] [LOCAL ] DINO: Primary data saved (52837 records). [2025-10-21T18:18:50.686182] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-21T18:18:50.687306] [INFO ] [MAIN ] Update Progress: 622/2366 symbols completed. DINO took 34.6s. Estimated remaining: 3h 40m 53s. Rate: 7.9 symbols/min [2025-10-21T18:18:50.865196] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:18:50.913905] [DEBUG] [LOCAL ] DKS: Loaded 49551 existing records from primary storage. [2025-10-21T18:18:50.914202] [INFO ] [MAIN ] DKS: Loaded 49551 existing records. [2025-10-21T18:18:51.096804] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:18:51.097065] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-21T18:18:51.097125] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-21T18:18:51.098202] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-21T18:18:51.098267] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-21T18:18:51.376412] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-21T18:18:51.444059] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-21T18:18:51.528593] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:18:51.581401] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-21T18:18:51.584753] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T18:18:52.151040] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-21T18:18:52.951031] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-21T18:18:53.751120] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-21T18:18:53.786442] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T18:18:53.833469] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-21T18:18:54.478180] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T18:18:54.550981] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-21T18:18:54.935769] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-21T18:18:55.351066] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-21T18:18:55.877305] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-21T18:18:56.151024] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-21T18:18:56.951029] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-21T18:18:57.680946] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-21T18:18:57.753997] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-21T18:18:57.757481] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T18:18:58.286566] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-21T18:18:58.296164] [INFO ] [REMOTE ] DIS: Full fetch complete (77967 records). [2025-10-21T18:18:58.296421] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-21T18:18:58.556951] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-21T18:18:58.714149] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T18:18:58.766700] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-21T18:18:58.766790] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-21T18:18:58.768160] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-21T18:18:58.768225] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-21T18:18:58.769687] [DEBUG] [LOCAL ] DIS: Trimmed 77967 records to 53788 (keeping 200 days of data) [2025-10-21T18:18:59.097210] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-10-21T18:18:59.097355] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-21T18:18:59.097445] [INFO ] [MAIN ] Update Progress: 623/2366 symbols completed. DIS took 41.9s. Estimated remaining: 3h 40m 47s. Rate: 7.9 symbols/min [2025-10-21T18:18:59.266448] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:18:59.296394] [DEBUG] [LOCAL ] DLB: Loaded 32311 existing records from primary storage. [2025-10-21T18:18:59.296673] [INFO ] [MAIN ] DLB: Loaded 32311 existing records. [2025-10-21T18:18:59.358559] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-21T18:18:59.477374] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:18:59.477593] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-21T18:18:59.477639] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-21T18:18:59.478268] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-21T18:18:59.478324] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-21T18:18:59.853252] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:19:00.151051] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-21T18:19:00.514121] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-21T18:19:00.951070] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-21T18:19:01.152150] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T18:19:01.707889] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T18:19:01.750989] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-21T18:19:02.551023] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-21T18:19:02.587377] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T18:19:03.104182] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T18:19:03.351093] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-21T18:19:04.151004] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-21T18:19:04.320512] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-21T18:19:04.327518] [INFO ] [REMOTE ] DK: Full fetch complete (70484 records). [2025-10-21T18:19:04.327691] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-21T18:19:04.328525] [FATAL] [VALIDATOR ] DK: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:19:04.328626] [FATAL] [MAIN ] DK: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:19:04.328706] [WARN ] [MAIN ] DK: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:19:04.328777] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-21T18:19:04.328844] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-10-21T18:19:04.328880] [INFO ] [LOCAL ] DK: Starting deletion of derivative data. [2025-10-21T18:19:04.329005] [DEBUG] [LOCAL ] DK: Deleted derivative data file. [2025-10-21T18:19:04.329477] [INFO ] [MAIN ] Update Progress: 624/2366 symbols completed. DK took 32.5s. Estimated remaining: 3h 40m 33s. Rate: 7.9 symbols/min [2025-10-21T18:19:04.500720] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:19:04.510196] [DEBUG] [LOCAL ] DLNG: Loaded 6143 existing records from primary storage. [2025-10-21T18:19:04.510416] [INFO ] [MAIN ] DLNG: Loaded 6143 existing records. [2025-10-21T18:19:04.694766] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:19:04.695118] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-21T18:19:04.695289] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-21T18:19:04.695542] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-21T18:19:04.695599] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-21T18:19:04.915611] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T18:19:04.956117] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-21T18:19:05.143823] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:19:05.751033] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-21T18:19:06.047320] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-21T18:19:06.285337] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-21T18:19:06.551051] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-21T18:19:06.907895] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T18:19:07.351033] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-21T18:19:08.151008] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-21T18:19:08.226856] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T18:19:08.340881] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-21T18:19:08.951007] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-21T18:19:09.233320] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-21T18:19:09.751161] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-21T18:19:10.462065] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T18:19:10.550980] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-21T18:19:10.831782] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T18:19:11.351095] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-21T18:19:12.003115] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T18:19:12.151045] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-21T18:19:12.175904] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T18:19:12.951072] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-21T18:19:13.750785] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-21T18:19:13.752593] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-21T18:19:13.836305] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T18:19:14.551050] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-21T18:19:14.836395] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-21T18:19:15.351062] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-21T18:19:16.151020] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-21T18:19:16.442153] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T18:19:16.679853] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T18:19:16.951003] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-21T18:19:17.170858] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T18:19:17.751027] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-21T18:19:18.551010] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-21T18:19:18.753043] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-21T18:19:19.101371] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T18:19:19.351052] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-21T18:19:19.455680] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T18:19:19.457850] [INFO ] [REMOTE ] DKL: Full fetch complete (27586 records). [2025-10-21T18:19:19.457930] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-21T18:19:19.821108] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-21T18:19:19.821190] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-21T18:19:19.821717] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-21T18:19:19.821777] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-21T18:19:19.822475] [DEBUG] [LOCAL ] DKL: Trimmed 27586 records to 17059 (keeping 200 days of data) [2025-10-21T18:19:19.926073] [DEBUG] [LOCAL ] DKL: Primary data saved (17059 records). [2025-10-21T18:19:19.926225] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-21T18:19:19.926309] [INFO ] [MAIN ] Update Progress: 625/2366 symbols completed. DKL took 34.3s. Estimated remaining: 3h 40m 48s. Rate: 7.9 symbols/min [2025-10-21T18:19:20.099635] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:19:20.154007] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-21T18:19:20.156032] [DEBUG] [LOCAL ] DLR: Loaded 50645 existing records from primary storage. [2025-10-21T18:19:20.156458] [INFO ] [MAIN ] DLR: Loaded 50645 existing records. [2025-10-21T18:19:20.355021] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:19:20.355254] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-21T18:19:20.355301] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-21T18:19:20.356248] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-21T18:19:20.356309] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-21T18:19:20.700374] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:19:20.951032] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-21T18:19:21.085628] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-21T18:19:21.412133] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-21T18:19:21.419902] [INFO ] [REMOTE ] DKS: Full fetch complete (71676 records). [2025-10-21T18:19:21.420096] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-21T18:19:21.760271] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-21T18:19:21.808381] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-21T18:19:21.808462] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-21T18:19:21.809337] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-21T18:19:21.809402] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-21T18:19:21.810799] [DEBUG] [LOCAL ] DKS: Trimmed 71676 records to 49449 (keeping 200 days of data) [2025-10-21T18:19:22.113067] [DEBUG] [LOCAL ] DKS: Primary data saved (49449 records). [2025-10-21T18:19:22.113191] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-21T18:19:22.114187] [INFO ] [MAIN ] Update Progress: 626/2366 symbols completed. DKS took 31.4s. Estimated remaining: 3h 40m 25s. Rate: 7.9 symbols/min [2025-10-21T18:19:22.281430] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:19:22.311969] [DEBUG] [LOCAL ] DLX: Loaded 28318 existing records from primary storage. [2025-10-21T18:19:22.312224] [INFO ] [MAIN ] DLX: Loaded 28318 existing records. [2025-10-21T18:19:22.448040] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T18:19:22.532263] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:19:22.532459] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-21T18:19:22.532531] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-21T18:19:22.533101] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-21T18:19:22.533160] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-21T18:19:22.562926] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-21T18:19:22.789946] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T18:19:22.906301] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:19:23.351057] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-21T18:19:24.151075] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-21T18:19:24.460387] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T18:19:24.743375] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T18:19:24.748755] [INFO ] [REMOTE ] DLB: Full fetch complete (47386 records). [2025-10-21T18:19:24.748851] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-21T18:19:24.847366] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-21T18:19:24.956730] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-21T18:19:25.146227] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-21T18:19:25.146305] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-21T18:19:25.146995] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-21T18:19:25.147057] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-21T18:19:25.148020] [DEBUG] [LOCAL ] DLB: Trimmed 47386 records to 32289 (keeping 200 days of data) [2025-10-21T18:19:25.337314] [DEBUG] [LOCAL ] DLB: Primary data saved (32289 records). [2025-10-21T18:19:25.337444] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-21T18:19:25.337521] [INFO ] [MAIN ] Update Progress: 627/2366 symbols completed. DLB took 26.2s. Estimated remaining: 3h 40m 6s. Rate: 7.9 symbols/min [2025-10-21T18:19:25.507436] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:19:25.526677] [DEBUG] [LOCAL ] DLY: Loaded 20770 existing records from primary storage. [2025-10-21T18:19:25.526912] [INFO ] [MAIN ] DLY: Loaded 20770 existing records. [2025-10-21T18:19:25.703348] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:19:25.703541] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-21T18:19:25.703597] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-21T18:19:25.704092] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-21T18:19:25.704149] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-21T18:19:25.757895] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-21T18:19:26.050880] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:19:26.551059] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-21T18:19:27.006748] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-21T18:19:27.030622] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T18:19:27.351018] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-21T18:19:27.648306] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T18:19:27.937776] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-21T18:19:28.151060] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-21T18:19:28.951057] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-21T18:19:29.557045] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T18:19:29.751039] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-21T18:19:30.551038] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-21T18:19:30.683143] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-21T18:19:30.987046] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-21T18:19:31.258438] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-21T18:19:31.351091] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-21T18:19:32.151023] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-21T18:19:32.750979] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-21T18:19:32.781568] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-21T18:19:32.951010] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-21T18:19:33.751017] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-21T18:19:34.551074] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-21T18:19:34.746425] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T18:19:35.301207] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-21T18:19:35.315984] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-21T18:19:35.317571] [INFO ] [REMOTE ] DLNG: Full fetch complete (11469 records). [2025-10-21T18:19:35.317662] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-21T18:19:35.357106] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-21T18:19:35.686973] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-21T18:19:35.687056] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-21T18:19:35.687310] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-21T18:19:35.687348] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-21T18:19:35.687805] [DEBUG] [LOCAL ] DLNG: Trimmed 11469 records to 6106 (keeping 200 days of data) [2025-10-21T18:19:35.722377] [DEBUG] [LOCAL ] DLNG: Primary data saved (6106 records). [2025-10-21T18:19:35.722480] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-21T18:19:35.722553] [INFO ] [MAIN ] Update Progress: 628/2366 symbols completed. DLNG took 31.4s. Estimated remaining: 3h 40m 6s. Rate: 7.9 symbols/min [2025-10-21T18:19:35.905632] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:19:35.905806] [DEBUG] [LOCAL ] DMA: No existing data file found in primary storage. [2025-10-21T18:19:35.905847] [WARN ] [MAIN ] DMA: No existing data found, performing full refresh instead. [2025-10-21T18:19:35.905954] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-21T18:19:35.905995] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-21T18:19:35.906057] [DEBUG] [LOCAL ] DMA: No primary data file found to delete. [2025-10-21T18:19:35.906127] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-21T18:19:36.156194] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-21T18:19:36.255200] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:19:36.950990] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-21T18:19:37.210789] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T18:19:37.297175] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T18:19:37.628303] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-21T18:19:37.751097] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-21T18:19:38.361812] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T18:19:38.551000] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-21T18:19:38.899915] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-21T18:19:39.351005] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-21T18:19:40.151078] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-21T18:19:40.951000] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-21T18:19:41.137422] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T18:19:41.509576] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-21T18:19:41.753834] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-21T18:19:41.757071] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T18:19:42.551030] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-21T18:19:43.173776] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-21T18:19:43.192801] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-21T18:19:43.351045] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-21T18:19:44.151068] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-21T18:19:44.560819] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-21T18:19:44.951113] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-21T18:19:45.153909] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-21T18:19:45.751015] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-21T18:19:46.551005] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-21T18:19:46.967938] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-21T18:19:46.993028] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-21T18:19:47.351033] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-21T18:19:47.790921] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-21T18:19:48.097372] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-21T18:19:48.151042] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-21T18:19:48.602606] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-21T18:19:48.951025] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-21T18:19:49.751069] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-21T18:19:50.241409] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T18:19:50.551020] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-21T18:19:51.119839] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-21T18:19:51.351031] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-21T18:19:51.425855] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T18:19:52.150995] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-21T18:19:52.442952] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T18:19:52.951066] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-21T18:19:53.751047] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-21T18:19:54.082944] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T18:19:54.257162] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-21T18:19:54.551072] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-21T18:19:54.673960] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T18:19:55.351030] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-21T18:19:55.385372] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T18:19:55.393022] [INFO ] [REMOTE ] DLR: Full fetch complete (74173 records). [2025-10-21T18:19:55.393159] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-21T18:19:55.780040] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-21T18:19:55.780181] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-21T18:19:55.781076] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-21T18:19:55.781145] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-21T18:19:55.782528] [DEBUG] [LOCAL ] DLR: Trimmed 74173 records to 50634 (keeping 200 days of data) [2025-10-21T18:19:56.003498] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-21T18:19:56.105215] [DEBUG] [LOCAL ] DLR: Primary data saved (50634 records). [2025-10-21T18:19:56.105357] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-21T18:19:56.106108] [INFO ] [MAIN ] Update Progress: 629/2366 symbols completed. DLR took 36.2s. Estimated remaining: 3h 40m 33s. Rate: 7.9 symbols/min [2025-10-21T18:19:56.159831] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-21T18:19:56.277675] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:19:56.292711] [DEBUG] [LOCAL ] DMB: Loaded 10378 existing records from primary storage. [2025-10-21T18:19:56.292934] [INFO ] [MAIN ] DMB: Loaded 10378 existing records. [2025-10-21T18:19:56.470998] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:19:56.471221] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-21T18:19:56.471277] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-21T18:19:56.471526] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-21T18:19:56.471567] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-21T18:19:56.834577] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:19:56.951024] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-21T18:19:57.557483] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T18:19:57.561376] [INFO ] [REMOTE ] DLX: Full fetch complete (41249 records). [2025-10-21T18:19:57.561488] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-21T18:19:57.756194] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-21T18:19:57.949490] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-21T18:19:57.949594] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-21T18:19:57.950292] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-21T18:19:57.950498] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-21T18:19:57.963255] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-21T18:19:57.967710] [DEBUG] [LOCAL ] DLX: Trimmed 41249 records to 28165 (keeping 200 days of data) [2025-10-21T18:19:57.968532] [INFO ] [REMOTE ] DLY: Full fetch complete (28534 records). [2025-10-21T18:19:57.968631] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-21T18:19:58.322056] [DEBUG] [LOCAL ] DLX: Primary data saved (28165 records). [2025-10-21T18:19:58.340811] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-21T18:19:58.405869] [INFO ] [MAIN ] Update Progress: 630/2366 symbols completed. DLX took 36.3s. Estimated remaining: 3h 40m 11s. Rate: 7.9 symbols/min [2025-10-21T18:19:58.564883] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-21T18:19:58.668191] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-21T18:19:58.668546] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-21T18:19:58.697995] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-21T18:19:58.704379] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-21T18:19:58.722638] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-21T18:19:58.751682] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:19:58.752073] [DEBUG] [LOCAL ] DLY: Trimmed 28534 records to 20743 (keeping 200 days of data) [2025-10-21T18:19:58.869145] [DEBUG] [LOCAL ] DMO: Loaded 9868 existing records from primary storage. [2025-10-21T18:19:58.881840] [INFO ] [MAIN ] DMO: Loaded 9868 existing records. [2025-10-21T18:19:58.983395] [DEBUG] [LOCAL ] DLY: Primary data saved (20743 records). [2025-10-21T18:19:58.993786] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-21T18:19:58.993879] [INFO ] [MAIN ] Update Progress: 631/2366 symbols completed. DLY took 33.7s. Estimated remaining: 3h 39m 44s. Rate: 7.9 symbols/min [2025-10-21T18:19:59.205563] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:19:59.232995] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-21T18:19:59.234588] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-21T18:19:59.252421] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:19:59.252797] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-21T18:19:59.252939] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-21T18:19:59.357965] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-21T18:19:59.673941] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:19:59.684085] [DEBUG] [LOCAL ] DNA: Loaded 48575 existing records from primary storage. [2025-10-21T18:19:59.685037] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-21T18:19:59.685169] [INFO ] [MAIN ] DNA: Loaded 48575 existing records. [2025-10-21T18:19:59.871697] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:19:59.872580] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-21T18:19:59.872724] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-21T18:19:59.873476] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-21T18:19:59.873826] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-21T18:20:00.156440] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-21T18:20:00.156372] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T18:20:00.216191] [INFO ] [REMOTE ] DMA: Full fetch complete (6621 records). [2025-10-21T18:20:00.217257] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-21T18:20:00.439499] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:20:00.732146] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-21T18:20:00.732230] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-21T18:20:00.732671] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-21T18:20:00.732753] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-21T18:20:00.733224] [DEBUG] [LOCAL ] DMA: Trimmed 6621 records to 4729 (keeping 200 days of data) [2025-10-21T18:20:00.766322] [DEBUG] [LOCAL ] DMA: Primary data saved (4729 records). [2025-10-21T18:20:00.766459] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-21T18:20:00.766533] [INFO ] [MAIN ] Update Progress: 632/2366 symbols completed. DMA took 25.0s. Estimated remaining: 3h 39m 21s. Rate: 7.9 symbols/min [2025-10-21T18:20:00.973206] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:20:00.968361] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-21T18:20:01.018139] [DEBUG] [LOCAL ] DNOW: Loaded 43858 existing records from primary storage. [2025-10-21T18:20:01.018822] [INFO ] [MAIN ] DNOW: Loaded 43858 existing records. [2025-10-21T18:20:01.231735] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:20:01.231935] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-21T18:20:01.231982] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-21T18:20:01.232712] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-21T18:20:01.232770] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-21T18:20:01.355894] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T18:20:01.636514] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:20:01.751035] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-21T18:20:02.532584] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T18:20:02.550981] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-21T18:20:03.068977] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-21T18:20:03.118012] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-21T18:20:03.351029] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-21T18:20:04.048183] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-21T18:20:04.151050] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-21T18:20:04.951026] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-21T18:20:05.751068] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-21T18:20:05.810708] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T18:20:06.040905] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-21T18:20:06.551121] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-21T18:20:07.350988] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-21T18:20:07.858714] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-21T18:20:07.893348] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-21T18:20:08.150996] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-21T18:20:08.320439] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-21T18:20:08.763947] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-21T18:20:08.951102] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-21T18:20:09.751006] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-21T18:20:09.758332] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T18:20:10.551099] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-21T18:20:11.338436] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-21T18:20:11.350978] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-21T18:20:11.701313] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T18:20:12.151034] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-21T18:20:12.324218] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-21T18:20:12.951024] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-21T18:20:12.962716] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-21T18:20:13.751041] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-21T18:20:14.123849] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-21T18:20:14.551080] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-21T18:20:15.349185] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-21T18:20:15.351369] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-21T18:20:16.135505] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-21T18:20:16.150979] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-21T18:20:16.486559] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-10-21T18:20:16.951041] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-21T18:20:17.479875] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-21T18:20:17.751021] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-21T18:20:18.447335] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-21T18:20:18.449323] [INFO ] [REMOTE ] DMO: Full fetch complete (14537 records). [2025-10-21T18:20:18.449404] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-21T18:20:18.552318] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-21T18:20:18.835147] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-21T18:20:18.835222] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-21T18:20:18.835530] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-21T18:20:18.835566] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-21T18:20:18.836050] [DEBUG] [LOCAL ] DMO: Trimmed 14537 records to 9862 (keeping 200 days of data) [2025-10-21T18:20:18.895858] [DEBUG] [LOCAL ] DMO: Primary data saved (9862 records). [2025-10-21T18:20:18.895995] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-21T18:20:18.896080] [INFO ] [MAIN ] Update Progress: 633/2366 symbols completed. DMO took 20.5s. Estimated remaining: 3h 39m 42s. Rate: 7.9 symbols/min [2025-10-21T18:20:19.066519] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:20:19.100225] [DEBUG] [LOCAL ] DNP: Loaded 33154 existing records from primary storage. [2025-10-21T18:20:19.100522] [INFO ] [MAIN ] DNP: Loaded 33154 existing records. [2025-10-21T18:20:19.218490] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-21T18:20:19.295319] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:20:19.295484] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-21T18:20:19.295530] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-21T18:20:19.296152] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-21T18:20:19.296208] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-21T18:20:19.357089] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-21T18:20:19.650516] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:20:19.675845] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T18:20:20.151041] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-21T18:20:20.951034] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-21T18:20:21.483298] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T18:20:21.751012] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-21T18:20:21.801546] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-21T18:20:22.118228] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-10-21T18:20:22.551087] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-21T18:20:23.339825] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T18:20:23.350978] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-21T18:20:24.017095] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T18:20:24.151085] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-21T18:20:24.951140] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-21T18:20:25.155059] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T18:20:25.584128] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-21T18:20:25.751057] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-21T18:20:26.345794] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T18:20:26.551075] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-21T18:20:26.946710] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T18:20:27.083188] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-21T18:20:27.085328] [INFO ] [REMOTE ] DMB: Full fetch complete (14739 records). [2025-10-21T18:20:27.085407] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-21T18:20:27.356224] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-21T18:20:27.452084] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-21T18:20:27.452157] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-21T18:20:27.452572] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-21T18:20:27.452634] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-21T18:20:27.453189] [DEBUG] [LOCAL ] DMB: Trimmed 14739 records to 10482 (keeping 200 days of data) [2025-10-21T18:20:27.516218] [DEBUG] [LOCAL ] DMB: Primary data saved (10482 records). [2025-10-21T18:20:27.516349] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-21T18:20:27.516429] [INFO ] [MAIN ] Update Progress: 634/2366 symbols completed. DMB took 31.4s. Estimated remaining: 3h 39m 37s. Rate: 7.9 symbols/min [2025-10-21T18:20:27.687046] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:20:27.740904] [DEBUG] [LOCAL ] DOC: Loaded 53556 existing records from primary storage. [2025-10-21T18:20:27.741232] [INFO ] [MAIN ] DOC: Loaded 53556 existing records. [2025-10-21T18:20:27.931735] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:20:27.931945] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-21T18:20:27.931992] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-21T18:20:27.932892] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-21T18:20:27.932954] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-21T18:20:28.158395] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-21T18:20:28.309260] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:20:28.951095] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-21T18:20:29.587231] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-21T18:20:29.720991] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T18:20:29.751024] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-21T18:20:30.535892] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T18:20:30.550979] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-21T18:20:31.119291] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T18:20:31.351029] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-21T18:20:32.059797] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T18:20:32.151040] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-21T18:20:32.648761] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T18:20:32.951070] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-21T18:20:33.637876] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-21T18:20:33.751038] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-21T18:20:34.551036] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-21T18:20:34.595602] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T18:20:35.351058] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-21T18:20:35.632233] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T18:20:35.804576] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-21T18:20:36.151085] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-21T18:20:36.747629] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T18:20:36.951034] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-21T18:20:37.753950] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-21T18:20:37.758290] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T18:20:37.765754] [INFO ] [REMOTE ] DNOW: Full fetch complete (63520 records). [2025-10-21T18:20:37.765883] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-21T18:20:38.149708] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-21T18:20:38.149805] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-21T18:20:38.150588] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-21T18:20:38.150631] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-21T18:20:38.152001] [DEBUG] [LOCAL ] DNOW: Trimmed 63520 records to 43799 (keeping 200 days of data) [2025-10-21T18:20:38.403894] [DEBUG] [LOCAL ] DNOW: Primary data saved (43799 records). [2025-10-21T18:20:38.404030] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-21T18:20:38.404678] [INFO ] [MAIN ] Update Progress: 635/2366 symbols completed. DNOW took 37.6s. Estimated remaining: 3h 39m 38s. Rate: 7.9 symbols/min [2025-10-21T18:20:38.557797] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-21T18:20:38.576883] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:20:38.577032] [DEBUG] [LOCAL ] DOCN: No existing data file found in primary storage. [2025-10-21T18:20:38.577067] [WARN ] [MAIN ] DOCN: No existing data found, performing full refresh instead. [2025-10-21T18:20:38.577174] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-21T18:20:38.577214] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-21T18:20:38.577255] [DEBUG] [LOCAL ] DOCN: No primary data file found to delete. [2025-10-21T18:20:38.577286] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-21T18:20:38.936333] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:20:39.141032] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-21T18:20:39.149201] [INFO ] [REMOTE ] DNA: Full fetch complete (71253 records). [2025-10-21T18:20:39.149398] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-21T18:20:39.357926] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-21T18:20:39.565271] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-21T18:20:39.565385] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-21T18:20:39.566396] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-21T18:20:39.566510] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-21T18:20:39.577710] [DEBUG] [LOCAL ] DNA: Trimmed 71253 records to 48547 (keeping 200 days of data) [2025-10-21T18:20:39.595747] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-21T18:20:39.879439] [DEBUG] [LOCAL ] DNA: Primary data saved (48547 records). [2025-10-21T18:20:39.879734] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-21T18:20:39.879903] [INFO ] [MAIN ] Update Progress: 636/2366 symbols completed. DNA took 40.9s. Estimated remaining: 3h 39m 14s. Rate: 7.9 symbols/min [2025-10-21T18:20:40.049820] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:20:40.050091] [DEBUG] [LOCAL ] DOCS: No existing data file found in primary storage. [2025-10-21T18:20:40.050163] [WARN ] [MAIN ] DOCS: No existing data found, performing full refresh instead. [2025-10-21T18:20:40.050278] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-21T18:20:40.050343] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-21T18:20:40.050590] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-10-21T18:20:40.050833] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-21T18:20:40.151811] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-21T18:20:40.284632] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T18:20:40.438137] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:20:40.791505] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T18:20:40.951092] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-21T18:20:41.751011] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-21T18:20:42.156090] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-21T18:20:42.551099] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-21T18:20:42.774050] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T18:20:43.290790] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T18:20:43.351062] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-21T18:20:44.020231] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-21T18:20:44.151036] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-21T18:20:44.726577] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T18:20:44.732249] [INFO ] [REMOTE ] DNP: Full fetch complete (48643 records). [2025-10-21T18:20:44.732413] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-21T18:20:44.957158] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-21T18:20:45.129501] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-21T18:20:45.129601] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-21T18:20:45.130366] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-21T18:20:45.130433] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-21T18:20:45.131611] [DEBUG] [LOCAL ] DNP: Trimmed 48643 records to 33093 (keeping 200 days of data) [2025-10-21T18:20:45.328694] [DEBUG] [LOCAL ] DNP: Primary data saved (33093 records). [2025-10-21T18:20:45.328843] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-21T18:20:45.328927] [INFO ] [MAIN ] Update Progress: 637/2366 symbols completed. DNP took 26.4s. Estimated remaining: 3h 39m 1s. Rate: 7.9 symbols/min [2025-10-21T18:20:45.751100] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-21T18:20:46.118752] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-21T18:20:46.551034] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-21T18:20:46.800311] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-21T18:20:47.351103] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-21T18:20:47.524532] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-21T18:20:48.151075] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-21T18:20:48.298239] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T18:20:48.951050] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-21T18:20:49.304268] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T18:20:49.681605] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T18:20:49.751070] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-21T18:20:50.551020] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-21T18:20:51.015963] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-21T18:20:51.351020] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-21T18:20:51.731806] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T18:20:52.121962] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T18:20:52.151033] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-21T18:20:52.951027] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-21T18:20:53.368533] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-21T18:20:53.751075] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-21T18:20:53.894575] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T18:20:54.551031] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-21T18:20:55.033728] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-21T18:20:55.351109] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-21T18:20:55.577713] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-21T18:20:56.151037] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-21T18:20:56.243871] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T18:20:56.828948] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T18:20:56.951025] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-21T18:20:57.676825] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T18:20:57.685183] [INFO ] [REMOTE ] DOC: Full fetch complete (77576 records). [2025-10-21T18:20:57.685330] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-21T18:20:57.758233] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-21T18:20:58.079035] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-21T18:20:58.079111] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-21T18:20:58.080011] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-21T18:20:58.080071] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-21T18:20:58.081422] [DEBUG] [LOCAL ] DOC: Trimmed 77576 records to 53555 (keeping 200 days of data) [2025-10-21T18:20:58.406384] [DEBUG] [LOCAL ] DOC: Primary data saved (53555 records). [2025-10-21T18:20:58.406604] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-21T18:20:58.407093] [INFO ] [MAIN ] Update Progress: 638/2366 symbols completed. DOC took 30.9s. Estimated remaining: 3h 39m 8s. Rate: 7.9 symbols/min [2025-10-21T18:20:58.608056] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T18:20:58.618949] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-21T18:20:59.499126] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T18:20:59.510428] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-21T18:21:00.364917] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T18:21:00.375337] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-21T18:21:02.044248] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-21T18:21:02.055375] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-21T18:21:02.350891] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T18:21:02.361133] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-21T18:21:04.143322] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T18:21:04.150282] [INFO ] [REMOTE ] DOCS: Full fetch complete (73501 records). [2025-10-21T18:21:04.150440] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-21T18:21:04.151314] [FATAL] [VALIDATOR ] DOCS: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:21:04.151407] [FATAL] [MAIN ] DOCS: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:21:04.151450] [WARN ] [MAIN ] DOCS: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:21:04.151514] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-21T18:21:04.151578] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-10-21T18:21:04.151613] [INFO ] [LOCAL ] DOCS: Starting deletion of derivative data. [2025-10-21T18:21:04.151686] [DEBUG] [LOCAL ] DOCS: No derivative data file found to delete. [2025-10-21T18:21:04.151763] [INFO ] [MAIN ] Update Progress: 639/2366 symbols completed. DOCS took 24.3s. Estimated remaining: 3h 38m 55s. Rate: 7.9 symbols/min [2025-10-21T18:21:04.201083] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-21T18:21:04.212910] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-21T18:21:06.230373] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-21T18:21:06.241878] [INFO ] [REMOTE ] DOCN: Full fetch complete (72888 records). [2025-10-21T18:21:06.242070] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-21T18:21:06.650447] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-21T18:21:06.650556] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-21T18:21:06.651525] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-21T18:21:06.651616] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-21T18:21:06.653290] [DEBUG] [LOCAL ] DOCN: Trimmed 72888 records to 51135 (keeping 200 days of data) [2025-10-21T18:21:06.946966] [DEBUG] [LOCAL ] DOCN: Primary data saved (51135 records). [2025-10-21T18:21:06.947109] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-21T18:21:06.947182] [INFO ] [MAIN ] Update Progress: 640/2366 symbols completed. DOCN took 28.5s. Estimated remaining: 3h 38m 35s. Rate: 7.9 symbols/min [2025-10-21T18:21:07.566910] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:21:07.630957] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:21:07.680803] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:21:07.664121] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:21:07.734575] [DEBUG] [LOCAL ] DOUG: Loaded 33965 existing records from primary storage. [2025-10-21T18:21:07.735222] [INFO ] [MAIN ] DOUG: Loaded 33965 existing records. [2025-10-21T18:21:07.832286] [DEBUG] [LOCAL ] DOLE: Loaded 39134 existing records from primary storage. [2025-10-21T18:21:07.878052] [DEBUG] [LOCAL ] DOV: Loaded 45575 existing records from primary storage. [2025-10-21T18:21:07.861574] [INFO ] [MAIN ] DOLE: Loaded 39134 existing records. [2025-10-21T18:21:07.919013] [INFO ] [MAIN ] DOV: Loaded 45575 existing records. [2025-10-21T18:21:07.991487] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-21T18:21:08.109045] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-10-21T18:21:08.136174] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:21:08.287554] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-21T18:21:08.312489] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-21T18:21:08.412071] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-21T18:21:08.458858] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:21:08.436722] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-21T18:21:08.472340] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-21T18:21:08.525147] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-21T18:21:08.586043] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:21:08.614437] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-21T18:21:08.650420] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-21T18:21:08.642591] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-21T18:21:08.676862] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:21:08.673813] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-21T18:21:08.691980] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-21T18:21:08.707673] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-21T18:21:08.698044] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-21T18:21:08.707843] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-21T18:21:08.732865] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-21T18:21:08.738146] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-21T18:21:09.582140] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:21:09.775991] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-21T18:21:09.987290] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:21:10.039785] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-21T18:21:10.095853] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:21:10.106772] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-21T18:21:10.169827] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:21:10.170219] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-21T18:21:11.223532] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T18:21:11.231477] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-21T18:21:11.503856] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T18:21:11.511196] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-21T18:21:11.897247] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T18:21:11.907089] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-21T18:21:12.020471] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-21T18:21:12.031291] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-21T18:21:12.455907] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-21T18:21:12.463183] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-21T18:21:12.574034] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T18:21:12.580515] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-21T18:21:13.401159] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T18:21:13.409563] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-21T18:21:13.632405] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T18:21:13.646928] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-21T18:21:13.672401] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-21T18:21:13.680531] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-21T18:21:13.773306] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T18:21:13.781183] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-21T18:21:15.533712] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T18:21:15.541441] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-21T18:21:15.627991] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-21T18:21:15.637925] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-21T18:21:15.933900] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-21T18:21:16.008192] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-21T18:21:16.151009] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-21T18:21:16.956123] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-21T18:21:16.973871] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-21T18:21:17.751056] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-21T18:21:17.843379] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-21T18:21:18.476562] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-21T18:21:18.551055] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-21T18:21:18.722714] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T18:21:19.314456] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-21T18:21:19.350986] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-21T18:21:20.150986] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-21T18:21:20.708096] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-21T18:21:20.861588] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-21T18:21:20.951010] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-21T18:21:21.751041] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-21T18:21:21.901412] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-21T18:21:22.556106] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-21T18:21:22.573763] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T18:21:23.351120] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-21T18:21:24.019469] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T18:21:24.067413] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-21T18:21:24.151046] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-21T18:21:24.951064] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-21T18:21:25.182552] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T18:21:25.751005] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-21T18:21:26.348773] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-21T18:21:26.467508] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T18:21:26.550986] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-21T18:21:27.351000] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-21T18:21:27.437008] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T18:21:28.151030] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-21T18:21:28.246799] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T18:21:28.662687] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-21T18:21:28.951095] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-21T18:21:29.751008] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-21T18:21:29.831115] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T18:21:30.430491] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T18:21:30.436754] [INFO ] [REMOTE ] DOLE: Full fetch complete (54374 records). [2025-10-21T18:21:30.436881] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-21T18:21:30.437492] [FATAL] [VALIDATOR ] DOLE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:21:30.437594] [FATAL] [MAIN ] DOLE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:21:30.437680] [WARN ] [MAIN ] DOLE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:21:30.437752] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-21T18:21:30.437814] [DEBUG] [LOCAL ] DOLE: No primary data file found to delete. [2025-10-21T18:21:30.437849] [INFO ] [LOCAL ] DOLE: Starting deletion of derivative data. [2025-10-21T18:21:30.438109] [DEBUG] [LOCAL ] DOLE: Deleted derivative data file. [2025-10-21T18:21:30.438212] [INFO ] [MAIN ] Update Progress: 641/2366 symbols completed. DOLE took 23.5s. Estimated remaining: 3h 39m 10s. Rate: 7.9 symbols/min [2025-10-21T18:21:30.556081] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-21T18:21:30.607538] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:21:30.623225] [DEBUG] [LOCAL ] DPG: Loaded 13502 existing records from primary storage. [2025-10-21T18:21:30.623442] [INFO ] [MAIN ] DPG: Loaded 13502 existing records. [2025-10-21T18:21:30.795879] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:21:30.796092] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-21T18:21:30.796137] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-21T18:21:30.796279] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-21T18:21:30.796316] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-21T18:21:31.144290] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:21:31.351009] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-21T18:21:31.523308] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-21T18:21:31.528092] [INFO ] [REMOTE ] DOUG: Full fetch complete (50023 records). [2025-10-21T18:21:31.528199] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-21T18:21:31.935635] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-21T18:21:31.935744] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-21T18:21:31.936450] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-21T18:21:31.936489] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-21T18:21:31.937482] [DEBUG] [LOCAL ] DOUG: Trimmed 50023 records to 33846 (keeping 200 days of data) [2025-10-21T18:21:32.128555] [DEBUG] [LOCAL ] DOUG: Primary data saved (33846 records). [2025-10-21T18:21:32.128775] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-21T18:21:32.129473] [INFO ] [MAIN ] Update Progress: 642/2366 symbols completed. DOUG took 25.2s. Estimated remaining: 3h 38m 46s. Rate: 7.9 symbols/min [2025-10-21T18:21:32.160164] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-21T18:21:32.304933] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:21:32.346533] [DEBUG] [LOCAL ] DQ: Loaded 43901 existing records from primary storage. [2025-10-21T18:21:32.346840] [INFO ] [MAIN ] DQ: Loaded 43901 existing records. [2025-10-21T18:21:32.541080] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:21:32.550812] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-21T18:21:32.552053] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T18:21:32.551216] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-21T18:21:32.561378] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-21T18:21:32.561773] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-21T18:21:32.912193] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:21:32.950977] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-21T18:21:33.149410] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T18:21:33.751089] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-21T18:21:34.530949] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T18:21:34.550981] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-21T18:21:34.594992] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-21T18:21:34.724339] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T18:21:35.351043] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-21T18:21:35.436459] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-21T18:21:36.151043] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-21T18:21:36.951035] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-21T18:21:37.180092] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T18:21:37.667883] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-21T18:21:37.751009] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-21T18:21:38.551133] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-21T18:21:38.597836] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T18:21:38.656953] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-21T18:21:39.351072] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-21T18:21:40.151090] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-21T18:21:40.777933] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-21T18:21:40.951095] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-21T18:21:41.373667] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-21T18:21:41.414265] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-21T18:21:41.751081] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-21T18:21:42.551030] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-21T18:21:42.802198] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T18:21:43.351060] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-21T18:21:43.475739] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-21T18:21:43.483566] [INFO ] [REMOTE ] DOW: Full fetch complete (77520 records). [2025-10-21T18:21:43.483790] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-21T18:21:43.484623] [FATAL] [VALIDATOR ] DOW: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:21:43.484750] [FATAL] [MAIN ] DOW: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:21:43.484794] [WARN ] [MAIN ] DOW: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:21:43.484834] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-21T18:21:43.484891] [DEBUG] [LOCAL ] DOW: No primary data file found to delete. [2025-10-21T18:21:43.484928] [INFO ] [LOCAL ] DOW: Starting deletion of derivative data. [2025-10-21T18:21:43.485055] [DEBUG] [LOCAL ] DOW: Deleted derivative data file. [2025-10-21T18:21:43.485813] [INFO ] [MAIN ] Update Progress: 643/2366 symbols completed. DOW took 36.5s. Estimated remaining: 3h 38m 49s. Rate: 7.9 symbols/min [2025-10-21T18:21:43.659159] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:21:43.697595] [DEBUG] [LOCAL ] DRD: Loaded 37805 existing records from primary storage. [2025-10-21T18:21:43.697920] [INFO ] [MAIN ] DRD: Loaded 37805 existing records. [2025-10-21T18:21:43.894468] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:21:43.894700] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-21T18:21:43.894758] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-21T18:21:43.894973] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-21T18:21:43.895046] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-21T18:21:44.156137] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-21T18:21:44.291447] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:21:44.361503] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-21T18:21:44.411289] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-21T18:21:44.418804] [INFO ] [REMOTE ] DOV: Full fetch complete (66000 records). [2025-10-21T18:21:44.418973] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-21T18:21:44.799699] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-21T18:21:44.799811] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-21T18:21:44.800820] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-21T18:21:44.800886] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-21T18:21:44.802247] [DEBUG] [LOCAL ] DOV: Trimmed 66000 records to 45577 (keeping 200 days of data) [2025-10-21T18:21:44.978872] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-21T18:21:45.084480] [DEBUG] [LOCAL ] DOV: Primary data saved (45577 records). [2025-10-21T18:21:45.084612] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-21T18:21:45.084718] [INFO ] [MAIN ] Update Progress: 644/2366 symbols completed. DOV took 38.1s. Estimated remaining: 3h 38m 25s. Rate: 7.9 symbols/min [2025-10-21T18:21:45.253511] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:21:45.295759] [DEBUG] [LOCAL ] DRH: Loaded 50315 existing records from primary storage. [2025-10-21T18:21:45.296068] [INFO ] [MAIN ] DRH: Loaded 50315 existing records. [2025-10-21T18:21:45.469034] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:21:45.469240] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-21T18:21:45.469301] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-21T18:21:45.470032] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-21T18:21:45.470116] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-21T18:21:45.756238] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-21T18:21:45.822981] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:21:46.010849] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-21T18:21:46.547135] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-21T18:21:46.556255] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-21T18:21:46.989887] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T18:21:47.351078] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-21T18:21:48.061485] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-21T18:21:48.151030] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-21T18:21:48.634899] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T18:21:48.951035] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-21T18:21:49.395588] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-21T18:21:49.398271] [INFO ] [REMOTE ] DPG: Full fetch complete (19026 records). [2025-10-21T18:21:49.398346] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-21T18:21:49.756362] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-21T18:21:49.766944] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-21T18:21:49.767154] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-21T18:21:49.767681] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-21T18:21:49.767745] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-21T18:21:49.768377] [DEBUG] [LOCAL ] DPG: Trimmed 19026 records to 13478 (keeping 200 days of data) [2025-10-21T18:21:49.856138] [DEBUG] [LOCAL ] DPG: Primary data saved (13478 records). [2025-10-21T18:21:49.856252] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-21T18:21:49.856331] [INFO ] [MAIN ] Update Progress: 645/2366 symbols completed. DPG took 19.4s. Estimated remaining: 3h 38m 10s. Rate: 7.9 symbols/min [2025-10-21T18:21:50.029622] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:21:50.076954] [DEBUG] [LOCAL ] DRI: Loaded 47643 existing records from primary storage. [2025-10-21T18:21:50.077274] [INFO ] [MAIN ] DRI: Loaded 47643 existing records. [2025-10-21T18:21:50.251171] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:21:50.251406] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-21T18:21:50.251473] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-21T18:21:50.252356] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-21T18:21:50.252414] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-21T18:21:50.556175] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-21T18:21:50.616719] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:21:50.832732] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T18:21:51.111290] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T18:21:51.351036] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-21T18:21:52.151063] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-21T18:21:52.209179] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T18:21:52.951045] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-21T18:21:53.152475] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T18:21:53.546166] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T18:21:53.751054] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-21T18:21:54.551062] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-21T18:21:54.609067] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T18:21:55.351021] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-21T18:21:55.353423] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T18:21:56.151023] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-21T18:21:56.268049] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T18:21:56.752535] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-21T18:21:56.951055] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-21T18:21:57.756243] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-21T18:21:57.773545] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T18:21:58.460911] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T18:21:58.551016] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-21T18:21:59.351049] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-21T18:21:59.688056] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T18:22:00.151064] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-21T18:22:00.296524] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T18:22:00.951073] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-21T18:22:01.196410] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T18:22:01.751051] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-21T18:22:01.899243] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T18:22:02.236529] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T18:22:02.551031] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-21T18:22:03.351020] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-21T18:22:03.588292] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-21T18:22:04.151093] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-21T18:22:04.358726] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T18:22:04.672259] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-21T18:22:04.950992] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-21T18:22:05.557529] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-21T18:22:05.751003] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-21T18:22:06.551031] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-21T18:22:06.591893] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-21T18:22:06.599474] [INFO ] [REMOTE ] DQ: Full fetch complete (63629 records). [2025-10-21T18:22:06.599696] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-21T18:22:06.990140] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-21T18:22:06.990226] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-21T18:22:06.991004] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-21T18:22:06.991067] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-21T18:22:06.992275] [DEBUG] [LOCAL ] DQ: Trimmed 63629 records to 43827 (keeping 200 days of data) [2025-10-21T18:22:07.244383] [DEBUG] [LOCAL ] DQ: Primary data saved (43827 records). [2025-10-21T18:22:07.244560] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-21T18:22:07.244934] [INFO ] [MAIN ] Update Progress: 646/2366 symbols completed. DQ took 35.1s. Estimated remaining: 3h 38m 28s. Rate: 7.9 symbols/min [2025-10-21T18:22:07.351929] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-21T18:22:07.427503] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:22:07.438869] [DEBUG] [LOCAL ] DRLL: Loaded 8856 existing records from primary storage. [2025-10-21T18:22:07.439087] [INFO ] [MAIN ] DRLL: Loaded 8856 existing records. [2025-10-21T18:22:07.652994] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:22:07.647226] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T18:22:07.653222] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-21T18:22:07.663155] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-21T18:22:07.663566] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-21T18:22:07.663621] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-21T18:22:08.048119] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:22:08.069018] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T18:22:08.151005] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-21T18:22:08.951053] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-21T18:22:08.979263] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-21T18:22:09.327384] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T18:22:09.751029] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-21T18:22:10.551027] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-21T18:22:10.744147] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T18:22:11.351059] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-21T18:22:11.443608] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T18:22:12.150999] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-21T18:22:12.233448] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T18:22:12.515434] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-21T18:22:12.951093] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-21T18:22:13.751089] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-21T18:22:13.903061] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-21T18:22:14.181560] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-21T18:22:14.190115] [INFO ] [REMOTE ] DRD: Full fetch complete (51996 records). [2025-10-21T18:22:14.190301] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-21T18:22:14.556199] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-21T18:22:14.652379] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-21T18:22:14.652684] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-21T18:22:14.653384] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-21T18:22:14.653426] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-21T18:22:14.654790] [DEBUG] [LOCAL ] DRD: Trimmed 51996 records to 37887 (keeping 200 days of data) [2025-10-21T18:22:14.879434] [DEBUG] [LOCAL ] DRD: Primary data saved (37887 records). [2025-10-21T18:22:14.879578] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-21T18:22:14.880394] [INFO ] [MAIN ] Update Progress: 647/2366 symbols completed. DRD took 31.4s. Estimated remaining: 3h 38m 21s. Rate: 7.9 symbols/min [2025-10-21T18:22:15.046301] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:22:15.080967] [DEBUG] [LOCAL ] DSL: Loaded 29017 existing records from primary storage. [2025-10-21T18:22:15.081250] [INFO ] [MAIN ] DSL: Loaded 29017 existing records. [2025-10-21T18:22:15.256607] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:22:15.256818] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-21T18:22:15.256907] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-21T18:22:15.257213] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-21T18:22:15.257268] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-21T18:22:15.354483] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-21T18:22:15.623163] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:22:15.650684] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T18:22:16.151093] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-21T18:22:16.275055] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-21T18:22:16.447922] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T18:22:16.455612] [INFO ] [REMOTE ] DRH: Full fetch complete (71970 records). [2025-10-21T18:22:16.455781] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-21T18:22:16.878544] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-21T18:22:16.878732] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-21T18:22:16.879889] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-21T18:22:16.879966] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-21T18:22:16.881417] [DEBUG] [LOCAL ] DRH: Trimmed 71970 records to 50269 (keeping 200 days of data) [2025-10-21T18:22:16.955197] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-21T18:22:17.224978] [DEBUG] [LOCAL ] DRH: Primary data saved (50269 records). [2025-10-21T18:22:17.225110] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-21T18:22:17.225186] [INFO ] [MAIN ] Update Progress: 648/2366 symbols completed. DRH took 32.1s. Estimated remaining: 3h 37m 59s. Rate: 7.9 symbols/min [2025-10-21T18:22:17.396553] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:22:17.411820] [DEBUG] [LOCAL ] DSM: Loaded 14073 existing records from primary storage. [2025-10-21T18:22:17.412058] [INFO ] [MAIN ] DSM: Loaded 14073 existing records. [2025-10-21T18:22:17.602268] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:22:17.602631] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-21T18:22:17.602785] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-21T18:22:17.603049] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-21T18:22:17.603220] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-21T18:22:17.755975] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-21T18:22:17.828971] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-21T18:22:18.022188] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:22:18.025266] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T18:22:18.551048] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-21T18:22:19.124291] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T18:22:19.223428] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-21T18:22:19.351021] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-21T18:22:20.150995] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-21T18:22:20.951046] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-21T18:22:21.328867] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T18:22:21.487245] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T18:22:21.751074] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-21T18:22:21.791269] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-21T18:22:22.551038] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-21T18:22:22.799342] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T18:22:23.313209] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T18:22:23.350981] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-21T18:22:24.060265] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-21T18:22:24.151094] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-21T18:22:24.951046] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-21T18:22:25.447690] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T18:22:25.751049] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-21T18:22:26.049727] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T18:22:26.470277] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-21T18:22:26.472837] [INFO ] [REMOTE ] DRLL: Full fetch complete (14563 records). [2025-10-21T18:22:26.472930] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-21T18:22:26.556108] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-21T18:22:26.878517] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-21T18:22:26.878618] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-21T18:22:26.879105] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-21T18:22:26.879155] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-21T18:22:26.879701] [DEBUG] [LOCAL ] DRLL: Trimmed 14563 records to 8769 (keeping 200 days of data) [2025-10-21T18:22:26.937038] [DEBUG] [LOCAL ] DRLL: Primary data saved (8769 records). [2025-10-21T18:22:26.937215] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-21T18:22:26.937312] [INFO ] [MAIN ] Update Progress: 649/2366 symbols completed. DRLL took 19.7s. Estimated remaining: 3h 37m 57s. Rate: 7.9 symbols/min [2025-10-21T18:22:27.129491] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:22:27.133683] [DEBUG] [LOCAL ] DSMC: Loaded 1838 existing records from primary storage. [2025-10-21T18:22:27.133835] [INFO ] [MAIN ] DSMC: Loaded 1838 existing records. [2025-10-21T18:22:27.313385] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:22:27.313579] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-21T18:22:27.313668] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-21T18:22:27.313892] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-21T18:22:27.313957] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-21T18:22:27.356768] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-21T18:22:27.671119] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:22:28.151003] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-21T18:22:28.232013] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T18:22:28.634913] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-21T18:22:28.951031] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-21T18:22:29.113574] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T18:22:29.367893] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-21T18:22:29.375237] [INFO ] [REMOTE ] DRI: Full fetch complete (69567 records). [2025-10-21T18:22:29.375338] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-21T18:22:29.757340] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-21T18:22:29.759317] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-21T18:22:29.759372] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-21T18:22:29.760157] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-21T18:22:29.760305] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-21T18:22:29.761607] [DEBUG] [LOCAL ] DRI: Trimmed 69567 records to 47615 (keeping 200 days of data) [2025-10-21T18:22:30.089954] [DEBUG] [LOCAL ] DRI: Primary data saved (47615 records). [2025-10-21T18:22:30.090075] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-21T18:22:30.091029] [INFO ] [MAIN ] Update Progress: 650/2366 symbols completed. DRI took 40.2s. Estimated remaining: 3h 37m 38s. Rate: 7.9 symbols/min [2025-10-21T18:22:30.258151] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:22:30.258312] [DEBUG] [LOCAL ] DSU: No existing data file found in primary storage. [2025-10-21T18:22:30.258347] [WARN ] [MAIN ] DSU: No existing data found, performing full refresh instead. [2025-10-21T18:22:30.258453] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-21T18:22:30.258492] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-21T18:22:30.258532] [DEBUG] [LOCAL ] DSU: No primary data file found to delete. [2025-10-21T18:22:30.258562] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-21T18:22:30.350579] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-21T18:22:30.556119] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-21T18:22:30.614061] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:22:31.351076] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-21T18:22:31.821709] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-21T18:22:32.151042] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-21T18:22:32.641905] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-21T18:22:32.681616] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-21T18:22:32.951026] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-21T18:22:33.505837] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-21T18:22:33.751013] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-21T18:22:34.223185] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-21T18:22:34.551038] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-21T18:22:35.351034] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-21T18:22:35.504365] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T18:22:36.150997] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-21T18:22:36.547761] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T18:22:36.951040] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-21T18:22:37.235496] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T18:22:37.751045] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-21T18:22:38.219063] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-21T18:22:38.551029] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-21T18:22:38.960226] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-21T18:22:39.237061] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-21T18:22:39.351016] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-21T18:22:40.151030] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-21T18:22:40.498773] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-21T18:22:40.951039] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-21T18:22:41.163113] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T18:22:41.442793] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-21T18:22:41.751027] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-21T18:22:42.551034] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-21T18:22:42.689802] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T18:22:43.351043] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-21T18:22:43.828182] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-21T18:22:44.151073] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-21T18:22:44.383584] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-21T18:22:44.951027] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-21T18:22:45.300786] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-21T18:22:45.426205] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T18:22:45.751017] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-21T18:22:46.551023] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-21T18:22:46.728880] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T18:22:46.987041] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-21T18:22:47.350993] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-21T18:22:48.151005] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-21T18:22:48.334541] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-21T18:22:48.481220] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-21T18:22:48.951021] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-21T18:22:49.403465] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-21T18:22:49.404304] [INFO ] [REMOTE ] DSMC: Full fetch complete (2853 records). [2025-10-21T18:22:49.404372] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-21T18:22:49.404732] [FATAL] [VALIDATOR ] DSMC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:22:49.404814] [FATAL] [MAIN ] DSMC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:22:49.404857] [WARN ] [MAIN ] DSMC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:22:49.404894] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-21T18:22:49.404948] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-21T18:22:49.404983] [INFO ] [LOCAL ] DSMC: Starting deletion of derivative data. [2025-10-21T18:22:49.405133] [DEBUG] [LOCAL ] DSMC: Deleted derivative data file. [2025-10-21T18:22:49.405216] [INFO ] [MAIN ] Update Progress: 651/2366 symbols completed. DSMC took 22.5s. Estimated remaining: 3h 38m 1s. Rate: 7.9 symbols/min [2025-10-21T18:22:49.574153] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:22:49.595849] [DEBUG] [LOCAL ] DSX: Loaded 23744 existing records from primary storage. [2025-10-21T18:22:49.596113] [INFO ] [MAIN ] DSX: Loaded 23744 existing records. [2025-10-21T18:22:49.752760] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-21T18:22:49.774739] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:22:49.775777] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-21T18:22:49.775882] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-21T18:22:49.776442] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-21T18:22:49.776506] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-21T18:22:50.138911] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:22:50.551031] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-21T18:22:50.836866] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T18:22:51.351022] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-21T18:22:51.654684] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T18:22:52.151021] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-21T18:22:52.951035] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-21T18:22:53.751073] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-21T18:23:05.688715] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (14.34 seconds). [2025-10-21T18:23:05.692002] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-21T18:23:06.013702] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (12.26 seconds). [2025-10-21T18:23:06.019006] [INFO ] [REMOTE ] DSL: Full fetch complete (41503 records). [2025-10-21T18:23:06.019143] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-21T18:23:06.019828] [FATAL] [VALIDATOR ] DSL: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:23:06.019922] [FATAL] [MAIN ] DSL: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:23:06.019963] [WARN ] [MAIN ] DSL: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:23:06.020001] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-21T18:23:06.020059] [DEBUG] [LOCAL ] DSL: No primary data file found to delete. [2025-10-21T18:23:06.020092] [INFO ] [LOCAL ] DSL: Starting deletion of derivative data. [2025-10-21T18:23:06.020276] [DEBUG] [LOCAL ] DSL: Deleted derivative data file. [2025-10-21T18:23:06.020723] [INFO ] [MAIN ] Update Progress: 652/2366 symbols completed. DSL took 51.1s. Estimated remaining: 3h 38m 17s. Rate: 7.9 symbols/min [2025-10-21T18:23:06.196522] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:23:06.214020] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (14.06 seconds). [2025-10-21T18:23:06.220804] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-21T18:23:06.268084] [DEBUG] [LOCAL ] DT: Loaded 52952 existing records from primary storage. [2025-10-21T18:23:06.268458] [INFO ] [MAIN ] DT: Loaded 52952 existing records. [2025-10-21T18:23:06.459839] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (13.51 seconds). [2025-10-21T18:23:06.464370] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:23:06.470761] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-21T18:23:06.470856] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-21T18:23:06.470687] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-21T18:23:06.472487] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-21T18:23:06.472553] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-21T18:23:06.830042] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:23:06.830491] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-21T18:23:06.870508] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-21T18:23:06.874120] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-21T18:23:07.632212] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-21T18:23:07.638261] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-21T18:23:07.750411] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T18:23:07.752500] [INFO ] [REMOTE ] DSM: Full fetch complete (23865 records). [2025-10-21T18:23:07.752576] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-21T18:23:08.135023] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-21T18:23:08.135144] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-21T18:23:08.141638] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-21T18:23:08.144776] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-21T18:23:08.147996] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-21T18:23:08.152918] [DEBUG] [LOCAL ] DSM: Trimmed 23865 records to 14103 (keeping 200 days of data) [2025-10-21T18:23:08.152812] [INFO ] [REMOTE ] DSU: Full fetch complete (33156 records). [2025-10-21T18:23:08.153374] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-21T18:23:08.373461] [DEBUG] [LOCAL ] DSM: Primary data saved (14103 records). [2025-10-21T18:23:08.398242] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-21T18:23:08.435220] [INFO ] [MAIN ] Update Progress: 653/2366 symbols completed. DSM took 51.2s. Estimated remaining: 3h 37m 55s. Rate: 7.9 symbols/min [2025-10-21T18:23:08.819211] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-21T18:23:08.818913] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:23:08.819762] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-21T18:23:08.820965] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-21T18:23:08.822283] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-21T18:23:08.845801] [DEBUG] [LOCAL ] DSU: Trimmed 33156 records to 23023 (keeping 200 days of data) [2025-10-21T18:23:08.850499] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-21T18:23:08.848827] [DEBUG] [LOCAL ] DTB: Loaded 4937 existing records from primary storage. [2025-10-21T18:23:08.856634] [INFO ] [MAIN ] DTB: Loaded 4937 existing records. [2025-10-21T18:23:08.868959] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-21T18:23:09.199573] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:23:09.201846] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-21T18:23:09.201959] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-21T18:23:09.209621] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-21T18:23:09.209757] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-21T18:23:09.323630] [DEBUG] [LOCAL ] DSU: Primary data saved (23023 records). [2025-10-21T18:23:09.331459] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-21T18:23:09.331699] [INFO ] [MAIN ] Update Progress: 654/2366 symbols completed. DSU took 39.2s. Estimated remaining: 3h 37m 30s. Rate: 7.9 symbols/min [2025-10-21T18:23:09.502825] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-10-21T18:23:09.571197] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-21T18:23:09.725559] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:23:09.817845] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:23:09.818237] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-21T18:23:09.861768] [DEBUG] [LOCAL ] DTE: Loaded 47244 existing records from primary storage. [2025-10-21T18:23:09.862097] [INFO ] [MAIN ] DTE: Loaded 47244 existing records. [2025-10-21T18:23:10.060661] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:23:10.060916] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-21T18:23:10.060974] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-21T18:23:10.061174] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-21T18:23:10.061217] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-21T18:23:10.357447] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-21T18:23:10.399151] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-21T18:23:10.442395] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:23:10.454906] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-21T18:23:10.456039] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T18:23:10.461950] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-21T18:23:10.979184] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T18:23:10.980590] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-21T18:23:11.376902] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T18:23:11.387803] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-21T18:23:11.535749] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-21T18:23:11.537120] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-21T18:23:11.656584] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-21T18:23:11.662461] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-21T18:23:11.831289] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T18:23:11.841417] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-21T18:23:11.994458] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-21T18:23:11.996124] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-21T18:23:12.539145] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-21T18:23:12.540631] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-21T18:23:12.734916] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-21T18:23:12.740542] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-21T18:23:13.016980] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-21T18:23:13.018965] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-21T18:23:13.054491] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T18:23:13.090905] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-21T18:23:13.093216] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T18:23:13.102481] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-21T18:23:13.580180] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-21T18:23:13.585401] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-21T18:23:13.672478] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-21T18:23:13.751074] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-21T18:23:14.140319] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-21T18:23:14.551008] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-21T18:23:14.615560] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T18:23:14.641207] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-21T18:23:14.859395] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T18:23:15.291376] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T18:23:15.351030] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-21T18:23:16.151058] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-21T18:23:16.951079] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-21T18:23:17.491432] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-21T18:23:17.750994] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-21T18:23:17.824529] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T18:23:17.825769] [INFO ] [REMOTE ] DTB: Full fetch complete (6539 records). [2025-10-21T18:23:17.825851] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-21T18:23:18.185516] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-21T18:23:18.283206] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-21T18:23:18.283283] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-21T18:23:18.283467] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-21T18:23:18.283508] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-21T18:23:18.283930] [DEBUG] [LOCAL ] DTB: Trimmed 6539 records to 4919 (keeping 200 days of data) [2025-10-21T18:23:18.315681] [DEBUG] [LOCAL ] DTB: Primary data saved (4919 records). [2025-10-21T18:23:18.315809] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-21T18:23:18.315890] [INFO ] [MAIN ] Update Progress: 655/2366 symbols completed. DTB took 9.8s. Estimated remaining: 3h 37m 26s. Rate: 7.9 symbols/min [2025-10-21T18:23:18.501997] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:23:18.502155] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-21T18:23:18.502190] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-21T18:23:18.502328] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-21T18:23:18.502368] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-21T18:23:18.502407] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-21T18:23:18.502438] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-21T18:23:18.556310] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-21T18:23:18.862611] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:23:19.351049] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-21T18:23:19.595169] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-21T18:23:19.801274] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-21T18:23:19.931974] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T18:23:19.936070] [INFO ] [REMOTE ] DSX: Full fetch complete (35626 records). [2025-10-21T18:23:19.936140] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-21T18:23:20.156276] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-21T18:23:20.321013] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-21T18:23:20.321094] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-21T18:23:20.321668] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-21T18:23:20.321728] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-21T18:23:20.322518] [DEBUG] [LOCAL ] DSX: Trimmed 35626 records to 23594 (keeping 200 days of data) [2025-10-21T18:23:20.454159] [DEBUG] [LOCAL ] DSX: Primary data saved (23594 records). [2025-10-21T18:23:20.454281] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-21T18:23:20.454371] [INFO ] [MAIN ] Update Progress: 656/2366 symbols completed. DSX took 31.0s. Estimated remaining: 3h 37m 4s. Rate: 7.9 symbols/min [2025-10-21T18:23:20.627770] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:23:20.635191] [DEBUG] [LOCAL ] DTG: Loaded 5735 existing records from primary storage. [2025-10-21T18:23:20.635348] [INFO ] [MAIN ] DTG: Loaded 5735 existing records. [2025-10-21T18:23:20.818488] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:23:20.818733] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-21T18:23:20.818786] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-21T18:23:20.818963] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-21T18:23:20.819020] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-21T18:23:20.960730] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-21T18:23:21.192695] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:23:21.434062] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-21T18:23:21.751035] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-21T18:23:22.035823] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T18:23:22.263695] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-21T18:23:22.551049] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-21T18:23:23.351082] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-21T18:23:23.852721] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-21T18:23:24.151005] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-21T18:23:24.413977] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T18:23:24.951038] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-21T18:23:25.699407] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T18:23:25.751037] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-21T18:23:26.551046] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-21T18:23:26.702014] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T18:23:27.305118] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-21T18:23:27.350991] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-21T18:23:27.454091] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T18:23:27.689979] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-21T18:23:28.151042] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-21T18:23:28.951025] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-21T18:23:29.750992] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-21T18:23:30.165072] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-21T18:23:30.174880] [INFO ] [REMOTE ] DT: Full fetch complete (76898 records). [2025-10-21T18:23:30.175056] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-21T18:23:30.401291] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-21T18:23:30.556147] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-21T18:23:30.635383] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-21T18:23:30.635504] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-21T18:23:30.636561] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-21T18:23:30.636625] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-21T18:23:30.638189] [DEBUG] [LOCAL ] DT: Trimmed 76898 records to 52954 (keeping 200 days of data) [2025-10-21T18:23:30.773283] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-21T18:23:30.985289] [DEBUG] [LOCAL ] DT: Primary data saved (52954 records). [2025-10-21T18:23:30.985419] [INFO ] [MAIN ] DT: Full history saved. [2025-10-21T18:23:30.986216] [INFO ] [MAIN ] Update Progress: 657/2366 symbols completed. DT took 25.0s. Estimated remaining: 3h 37m 4s. Rate: 7.9 symbols/min [2025-10-21T18:23:31.156407] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:23:31.156552] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-21T18:23:31.156590] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-21T18:23:31.156722] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-21T18:23:31.156768] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-21T18:23:31.156810] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-21T18:23:31.156843] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-21T18:23:31.360958] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-21T18:23:31.389330] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-21T18:23:31.540615] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:23:32.151037] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-21T18:23:32.756572] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-21T18:23:32.787053] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-21T18:23:32.951035] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-21T18:23:33.456855] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-21T18:23:33.751043] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-21T18:23:34.350634] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-21T18:23:34.551041] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-21T18:23:35.351041] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-10-21T18:23:35.579540] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T18:23:35.579841] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-10-21T18:23:35.579942] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:23:35.580029] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-21T18:23:35.580131] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:23:35.580223] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-21T18:23:35.580307] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-21T18:23:35.580345] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-21T18:23:35.580385] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-21T18:23:35.580430] [INFO ] [MAIN ] Update Progress: 658/2366 symbols completed. DTK took 4.6s. Estimated remaining: 3h 36m 49s. Rate: 7.9 symbols/min [2025-10-21T18:23:35.762368] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:23:35.806365] [DEBUG] [LOCAL ] DTM: Loaded 43821 existing records from primary storage. [2025-10-21T18:23:35.806688] [INFO ] [MAIN ] DTM: Loaded 43821 existing records. [2025-10-21T18:23:35.984853] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:23:35.985065] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-21T18:23:35.985119] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-21T18:23:35.985344] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-21T18:23:35.985400] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-21T18:23:36.167787] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-21T18:23:36.373193] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:23:36.446523] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T18:23:36.591684] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-21T18:23:36.951040] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-21T18:23:37.751023] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-21T18:23:38.527054] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T18:23:38.550978] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-21T18:23:38.592313] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-21T18:23:38.599589] [INFO ] [REMOTE ] DTE: Full fetch complete (68916 records). [2025-10-21T18:23:38.599776] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-21T18:23:38.992824] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-21T18:23:38.992908] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-21T18:23:38.993940] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-21T18:23:38.994002] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-21T18:23:38.995364] [DEBUG] [LOCAL ] DTE: Trimmed 68916 records to 47181 (keeping 200 days of data) [2025-10-21T18:23:39.287612] [DEBUG] [LOCAL ] DTE: Primary data saved (47181 records). [2025-10-21T18:23:39.287758] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-21T18:23:39.287838] [INFO ] [MAIN ] Update Progress: 659/2366 symbols completed. DTE took 30.0s. Estimated remaining: 3h 36m 31s. Rate: 7.9 symbols/min [2025-10-21T18:23:39.356213] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-21T18:23:39.465021] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:23:39.465167] [DEBUG] [LOCAL ] DTW: No existing data file found in primary storage. [2025-10-21T18:23:39.465202] [WARN ] [MAIN ] DTW: No existing data found, performing full refresh instead. [2025-10-21T18:23:39.465308] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-21T18:23:39.465348] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-21T18:23:39.465407] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-21T18:23:39.465439] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-21T18:23:39.715312] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-21T18:23:39.826222] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:23:40.150988] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-21T18:23:40.242301] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T18:23:40.832003] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-21T18:23:40.951064] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-21T18:23:41.395991] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-21T18:23:41.751002] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-21T18:23:42.551020] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-21T18:23:42.986356] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-21T18:23:42.987310] [INFO ] [REMOTE ] DTF: Full fetch complete (1758 records). [2025-10-21T18:23:42.987377] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-21T18:23:43.174800] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-21T18:23:43.174966] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:23:43.175032] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:23:43.175102] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-21T18:23:43.175162] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-21T18:23:43.175197] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-21T18:23:43.175234] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-21T18:23:43.175288] [INFO ] [MAIN ] Update Progress: 660/2366 symbols completed. DTF took 24.9s. Estimated remaining: 3h 36m 14s. Rate: 7.9 symbols/min [2025-10-21T18:23:43.346107] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:23:43.351005] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-21T18:23:43.399337] [DEBUG] [LOCAL ] DUK: Loaded 53437 existing records from primary storage. [2025-10-21T18:23:43.399678] [INFO ] [MAIN ] DUK: Loaded 53437 existing records. [2025-10-21T18:23:43.589341] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:23:43.589580] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-21T18:23:43.589796] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-21T18:23:43.600239] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-21T18:23:43.613823] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-21T18:23:43.696616] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T18:23:43.755435] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-21T18:23:43.999799] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:23:44.151021] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-21T18:23:44.833206] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-21T18:23:44.951088] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-21T18:23:45.751049] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-21T18:23:46.551044] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-21T18:23:46.567496] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-21T18:23:46.675516] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T18:23:47.182051] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-21T18:23:47.351041] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-21T18:23:48.067551] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-21T18:23:48.069243] [INFO ] [REMOTE ] DTG: Full fetch complete (8563 records). [2025-10-21T18:23:48.069353] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-21T18:23:48.069829] [FATAL] [VALIDATOR ] DTG: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:23:48.069922] [FATAL] [MAIN ] DTG: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:23:48.069965] [WARN ] [MAIN ] DTG: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:23:48.070004] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-21T18:23:48.070061] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-21T18:23:48.070096] [INFO ] [LOCAL ] DTG: Starting deletion of derivative data. [2025-10-21T18:23:48.070271] [DEBUG] [LOCAL ] DTG: Deleted derivative data file. [2025-10-21T18:23:48.070359] [INFO ] [MAIN ] Update Progress: 661/2366 symbols completed. DTG took 27.6s. Estimated remaining: 3h 35m 59s. Rate: 7.9 symbols/min [2025-10-21T18:23:48.156223] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-21T18:23:48.266077] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:23:48.273235] [DEBUG] [LOCAL ] DUKB: Loaded 6196 existing records from primary storage. [2025-10-21T18:23:48.273403] [INFO ] [MAIN ] DUKB: Loaded 6196 existing records. [2025-10-21T18:23:48.452781] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:23:48.452987] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-21T18:23:48.453034] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-21T18:23:48.453204] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-21T18:23:48.453260] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-21T18:23:48.864063] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:23:48.951018] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-21T18:23:49.751014] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-21T18:23:49.877828] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T18:23:49.912996] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-21T18:23:50.308197] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-21T18:23:50.551015] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-21T18:23:50.977512] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-21T18:23:51.351057] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-21T18:23:52.151068] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-21T18:23:52.834314] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-21T18:23:52.951040] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-21T18:23:53.251241] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T18:23:53.751020] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-21T18:23:54.546139] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T18:23:54.554173] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-21T18:23:55.153329] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-21T18:23:55.351052] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-21T18:23:55.558833] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T18:23:55.910046] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-21T18:23:56.151082] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-21T18:23:56.730005] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-21T18:23:56.951078] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-21T18:23:57.751028] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-21T18:23:58.551076] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-21T18:23:58.630277] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T18:23:58.985428] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-21T18:23:59.351057] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-21T18:23:59.408269] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T18:23:59.947565] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-21T18:24:00.151061] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-21T18:24:00.951028] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-21T18:24:01.751056] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-21T18:24:01.927894] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T18:24:01.941691] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-21T18:24:02.551035] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-21T18:24:03.351102] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-21T18:24:03.720978] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-21T18:24:04.080078] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T18:24:04.160491] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-21T18:24:04.165481] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T18:24:04.748818] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-21T18:24:04.951018] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-21T18:24:05.751037] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-21T18:24:06.301277] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-21T18:24:06.555409] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-21T18:24:06.560052] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T18:24:06.568229] [INFO ] [REMOTE ] DTM: Full fetch complete (65133 records). [2025-10-21T18:24:06.568376] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-21T18:24:06.989198] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-21T18:24:06.989296] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-21T18:24:06.990311] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-21T18:24:06.990380] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-21T18:24:06.991873] [DEBUG] [LOCAL ] DTM: Trimmed 65133 records to 43736 (keeping 200 days of data) [2025-10-21T18:24:07.286956] [DEBUG] [LOCAL ] DTM: Primary data saved (43736 records). [2025-10-21T18:24:07.287095] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-21T18:24:07.287853] [INFO ] [MAIN ] Update Progress: 662/2366 symbols completed. DTM took 31.7s. Estimated remaining: 3h 36m 21s. Rate: 7.9 symbols/min [2025-10-21T18:24:07.357432] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-21T18:24:07.389785] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-21T18:24:07.485309] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:24:07.539595] [DEBUG] [LOCAL ] DV: Loaded 51250 existing records from primary storage. [2025-10-21T18:24:07.539965] [INFO ] [MAIN ] DV: Loaded 51250 existing records. [2025-10-21T18:24:07.717940] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:24:07.718199] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-21T18:24:07.718269] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-21T18:24:07.719160] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-21T18:24:07.719217] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-21T18:24:08.090459] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:24:08.151011] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-21T18:24:08.294766] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-21T18:24:08.765746] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T18:24:08.951029] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-21T18:24:09.751053] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-21T18:24:10.353895] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-21T18:24:10.551072] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-21T18:24:10.687638] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T18:24:11.351044] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-21T18:24:11.797317] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-21T18:24:11.798852] [INFO ] [REMOTE ] DUKB: Full fetch complete (9022 records). [2025-10-21T18:24:11.798925] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-21T18:24:12.155724] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-21T18:24:12.183043] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-21T18:24:12.183233] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-21T18:24:12.183595] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-21T18:24:12.183696] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-21T18:24:12.184584] [DEBUG] [LOCAL ] DUKB: Trimmed 9022 records to 6174 (keeping 200 days of data) [2025-10-21T18:24:12.222787] [DEBUG] [LOCAL ] DUKB: Primary data saved (6174 records). [2025-10-21T18:24:12.222992] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-21T18:24:12.223078] [INFO ] [MAIN ] Update Progress: 663/2366 symbols completed. DUKB took 24.2s. Estimated remaining: 3h 36m 7s. Rate: 7.9 symbols/min [2025-10-21T18:24:12.422182] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:24:12.424542] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T18:24:12.474850] [DEBUG] [LOCAL ] DVA: Loaded 40887 existing records from primary storage. [2025-10-21T18:24:12.475143] [INFO ] [MAIN ] DVA: Loaded 40887 existing records. [2025-10-21T18:24:12.649994] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:24:12.654162] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-21T18:24:12.654081] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-21T18:24:12.655517] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-21T18:24:12.655609] [INFO ] [REMOTE ] DTW: Full fetch complete (6952 records). [2025-10-21T18:24:12.655838] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-21T18:24:12.656462] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-21T18:24:12.656424] [FATAL] [VALIDATOR ] DTW: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:24:12.656724] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-21T18:24:12.688851] [FATAL] [MAIN ] DTW: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:24:12.732867] [WARN ] [MAIN ] DTW: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:24:12.759118] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-21T18:24:12.759213] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-21T18:24:12.759535] [INFO ] [LOCAL ] DTW: Starting deletion of derivative data. [2025-10-21T18:24:12.764982] [DEBUG] [LOCAL ] DTW: No derivative data file found to delete. [2025-10-21T18:24:12.765063] [INFO ] [MAIN ] Update Progress: 664/2366 symbols completed. DTW took 33.5s. Estimated remaining: 3h 35m 41s. Rate: 7.9 symbols/min [2025-10-21T18:24:12.954868] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-21T18:24:13.107885] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:24:13.211845] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:24:13.252406] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-10-21T18:24:13.252781] [INFO ] [MAIN ] DVN: Loaded 53699 existing records. [2025-10-21T18:24:13.429130] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:24:13.429363] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-21T18:24:13.429420] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-21T18:24:13.430393] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-21T18:24:13.430451] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-21T18:24:13.764668] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-21T18:24:13.785625] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:24:14.551053] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-21T18:24:14.650201] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T18:24:15.313265] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-21T18:24:15.351012] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-21T18:24:16.151040] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-21T18:24:16.632289] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-21T18:24:16.951074] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-21T18:24:17.052242] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T18:24:17.751026] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-21T18:24:18.064590] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T18:24:18.214837] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-21T18:24:18.551065] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-21T18:24:19.351073] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-21T18:24:19.416745] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T18:24:20.151219] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-21T18:24:20.585583] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-21T18:24:20.950997] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-21T18:24:21.283587] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-21T18:24:21.751030] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-21T18:24:21.800830] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T18:24:22.551005] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-21T18:24:22.746289] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-21T18:24:23.324115] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T18:24:23.350997] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-21T18:24:24.135104] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T18:24:24.150985] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-21T18:24:24.951055] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-21T18:24:25.259567] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T18:24:25.751079] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-21T18:24:26.151575] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-21T18:24:26.483912] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T18:24:26.551014] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-21T18:24:27.351159] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-21T18:24:27.706279] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-21T18:24:28.019555] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T18:24:28.151016] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-21T18:24:28.275158] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T18:24:28.283638] [INFO ] [REMOTE ] DUK: Full fetch complete (77568 records). [2025-10-21T18:24:28.283839] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-21T18:24:28.675818] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-21T18:24:28.675895] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-21T18:24:28.676888] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-21T18:24:28.676955] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-21T18:24:28.678424] [DEBUG] [LOCAL ] DUK: Trimmed 77568 records to 53437 (keeping 200 days of data) [2025-10-21T18:24:28.962468] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-21T18:24:29.013914] [DEBUG] [LOCAL ] DUK: Primary data saved (53437 records). [2025-10-21T18:24:29.014037] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-21T18:24:29.014114] [INFO ] [MAIN ] Update Progress: 665/2366 symbols completed. DUK took 45.8s. Estimated remaining: 3h 35m 56s. Rate: 7.9 symbols/min [2025-10-21T18:24:29.190165] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:24:29.239577] [DEBUG] [LOCAL ] DX: Loaded 52526 existing records from primary storage. [2025-10-21T18:24:29.239901] [INFO ] [MAIN ] DX: Loaded 52526 existing records. [2025-10-21T18:24:29.422602] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:24:29.422847] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-21T18:24:29.422905] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-21T18:24:29.423834] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-21T18:24:29.423896] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-21T18:24:29.752420] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-21T18:24:29.793412] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:24:29.820737] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T18:24:30.551005] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-21T18:24:30.663633] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T18:24:31.351019] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-21T18:24:31.917776] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-21T18:24:32.151003] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-21T18:24:32.206129] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T18:24:32.951043] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-21T18:24:33.067099] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T18:24:33.633396] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T18:24:33.751028] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-21T18:24:34.551079] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-21T18:24:35.113802] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-21T18:24:35.298963] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T18:24:35.351053] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-21T18:24:36.024632] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T18:24:36.151040] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-21T18:24:36.920181] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-21T18:24:36.951022] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-21T18:24:37.751150] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-21T18:24:37.886359] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T18:24:38.551130] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-21T18:24:38.625720] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T18:24:38.636457] [INFO ] [REMOTE ] DV: Full fetch complete (73868 records). [2025-10-21T18:24:38.636700] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-21T18:24:39.093088] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-21T18:24:39.093203] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-21T18:24:39.094115] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-21T18:24:39.094241] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-21T18:24:39.095817] [DEBUG] [LOCAL ] DV: Trimmed 73868 records to 51247 (keeping 200 days of data) [2025-10-21T18:24:39.361730] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-21T18:24:39.405217] [DEBUG] [LOCAL ] DV: Primary data saved (51247 records). [2025-10-21T18:24:39.405385] [INFO ] [MAIN ] DV: Full history saved. [2025-10-21T18:24:39.406074] [INFO ] [MAIN ] Update Progress: 666/2366 symbols completed. DV took 32.1s. Estimated remaining: 3h 35m 55s. Rate: 7.9 symbols/min [2025-10-21T18:24:39.577538] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:24:39.627864] [DEBUG] [LOCAL ] DXC: Loaded 49946 existing records from primary storage. [2025-10-21T18:24:39.628378] [INFO ] [MAIN ] DXC: Loaded 49946 existing records. [2025-10-21T18:24:39.813379] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:24:39.813939] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-21T18:24:39.814326] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-21T18:24:39.825151] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-21T18:24:39.839154] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-21T18:24:39.929432] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-21T18:24:40.171842] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-21T18:24:40.239542] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T18:24:40.261182] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:24:40.951011] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-21T18:24:41.220680] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T18:24:41.751007] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-21T18:24:42.068918] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T18:24:42.385942] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T18:24:42.551033] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-21T18:24:43.351711] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-21T18:24:43.354932] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T18:24:43.364516] [INFO ] [REMOTE ] DVN: Full fetch complete (77489 records). [2025-10-21T18:24:43.364776] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-21T18:24:43.365824] [FATAL] [VALIDATOR ] DVN: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:24:43.365921] [FATAL] [MAIN ] DVN: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:24:43.365964] [WARN ] [MAIN ] DVN: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:24:43.366040] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-21T18:24:43.366112] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-21T18:24:43.366152] [INFO ] [LOCAL ] DVN: Starting deletion of derivative data. [2025-10-21T18:24:43.366532] [DEBUG] [LOCAL ] DVN: Deleted derivative data file. [2025-10-21T18:24:43.366664] [INFO ] [MAIN ] Update Progress: 667/2366 symbols completed. DVN took 30.6s. Estimated remaining: 3h 35m 38s. Rate: 7.9 symbols/min [2025-10-21T18:24:43.547921] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:24:43.589440] [DEBUG] [LOCAL ] DXYZ: Loaded 37229 existing records from primary storage. [2025-10-21T18:24:43.589845] [INFO ] [MAIN ] DXYZ: Loaded 37229 existing records. [2025-10-21T18:24:43.785415] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:24:43.785934] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-21T18:24:43.786111] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-21T18:24:43.786979] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-21T18:24:43.787049] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-21T18:24:44.149884] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-21T18:24:44.169758] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-21T18:24:44.231749] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:24:44.827948] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T18:24:44.951022] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-21T18:24:45.619620] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T18:24:45.625851] [INFO ] [REMOTE ] DVA: Full fetch complete (59554 records). [2025-10-21T18:24:45.626001] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-21T18:24:45.756195] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-21T18:24:46.056479] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-21T18:24:46.056566] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-21T18:24:46.057445] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-21T18:24:46.057512] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-21T18:24:46.058767] [DEBUG] [LOCAL ] DVA: Trimmed 59554 records to 40739 (keeping 200 days of data) [2025-10-21T18:24:46.306414] [DEBUG] [LOCAL ] DVA: Primary data saved (40739 records). [2025-10-21T18:24:46.306540] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-21T18:24:46.306953] [INFO ] [MAIN ] Update Progress: 668/2366 symbols completed. DVA took 34.1s. Estimated remaining: 3h 35m 19s. Rate: 7.9 symbols/min [2025-10-21T18:24:46.490815] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:24:46.523110] [DEBUG] [LOCAL ] DY: Loaded 28264 existing records from primary storage. [2025-10-21T18:24:46.523448] [INFO ] [MAIN ] DY: Loaded 28264 existing records. [2025-10-21T18:24:46.556401] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-21T18:24:46.724614] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:24:46.724919] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-21T18:24:46.725082] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-21T18:24:46.734376] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-21T18:24:46.746926] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-21T18:24:46.821716] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T18:24:47.149442] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:24:47.245670] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T18:24:47.351016] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-21T18:24:48.151058] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-21T18:24:48.425156] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T18:24:48.745948] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-21T18:24:48.951015] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-21T18:24:49.751073] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-21T18:24:49.951406] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T18:24:50.469962] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T18:24:50.551055] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-21T18:24:51.351012] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-21T18:24:51.680770] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-21T18:24:51.711718] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-21T18:24:52.151056] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-21T18:24:52.959672] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-21T18:24:52.964839] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T18:24:53.278050] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-21T18:24:53.751048] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-21T18:24:54.551024] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-21T18:24:54.968204] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T18:24:55.351012] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-21T18:24:55.805389] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-21T18:24:55.956373] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T18:24:56.150999] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-21T18:24:56.602357] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T18:24:56.951027] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-21T18:24:57.571265] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T18:24:57.751014] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-21T18:24:58.551014] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-21T18:24:58.816446] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T18:24:59.351018] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-21T18:24:59.747243] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T18:24:59.908915] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-21T18:25:00.151014] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-21T18:25:00.951051] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-21T18:25:01.652975] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-21T18:25:01.698249] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T18:25:01.751048] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-21T18:25:02.551008] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-21T18:25:02.644869] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T18:25:03.143906] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-21T18:25:03.350993] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-21T18:25:04.151112] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-21T18:25:04.178784] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T18:25:04.951053] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-21T18:25:05.457470] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-21T18:25:05.465791] [INFO ] [REMOTE ] DX: Full fetch complete (75485 records). [2025-10-21T18:25:05.465938] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-21T18:25:05.466847] [FATAL] [VALIDATOR ] DX: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:25:05.466949] [FATAL] [MAIN ] DX: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:25:05.467016] [WARN ] [MAIN ] DX: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:25:05.467106] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-21T18:25:05.467185] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-21T18:25:05.467272] [INFO ] [LOCAL ] DX: Starting deletion of derivative data. [2025-10-21T18:25:05.467450] [DEBUG] [LOCAL ] DX: Deleted derivative data file. [2025-10-21T18:25:05.467535] [INFO ] [MAIN ] Update Progress: 669/2366 symbols completed. DX took 36.5s. Estimated remaining: 3h 35m 40s. Rate: 7.9 symbols/min [2025-10-21T18:25:05.604001] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T18:25:05.684777] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:25:05.720727] [DEBUG] [LOCAL ] E: Loaded 33355 existing records from primary storage. [2025-10-21T18:25:05.720997] [INFO ] [MAIN ] E: Loaded 33355 existing records. [2025-10-21T18:25:05.756213] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-21T18:25:05.900485] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:25:05.900717] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-21T18:25:05.900772] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-21T18:25:05.901435] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-21T18:25:05.901494] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-21T18:25:06.249242] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:25:06.551059] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-21T18:25:06.686275] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T18:25:07.226580] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T18:25:07.230288] [INFO ] [REMOTE ] DY: Full fetch complete (43213 records). [2025-10-21T18:25:07.230368] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-21T18:25:07.356153] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-21T18:25:07.620066] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-21T18:25:07.620146] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-21T18:25:07.620820] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-21T18:25:07.620880] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-21T18:25:07.621796] [DEBUG] [LOCAL ] DY: Trimmed 43213 records to 28120 (keeping 200 days of data) [2025-10-21T18:25:07.789817] [DEBUG] [LOCAL ] DY: Primary data saved (28120 records). [2025-10-21T18:25:07.789951] [INFO ] [MAIN ] DY: Full history saved. [2025-10-21T18:25:07.790028] [INFO ] [MAIN ] Update Progress: 670/2366 symbols completed. DY took 21.5s. Estimated remaining: 3h 35m 19s. Rate: 7.9 symbols/min [2025-10-21T18:25:07.964315] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:25:08.003478] [DEBUG] [LOCAL ] EAF: Loaded 41341 existing records from primary storage. [2025-10-21T18:25:08.003997] [INFO ] [MAIN ] EAF: Loaded 41341 existing records. [2025-10-21T18:25:08.134936] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T18:25:08.169710] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-21T18:25:08.216019] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:25:08.216222] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-21T18:25:08.216270] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-21T18:25:08.217115] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-21T18:25:08.217173] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-21T18:25:08.616999] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:25:08.951030] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-21T18:25:09.501398] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-21T18:25:09.751064] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-21T18:25:09.956849] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T18:25:10.280057] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-21T18:25:10.551025] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-21T18:25:11.351022] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-21T18:25:11.781986] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-21T18:25:11.869423] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-21T18:25:12.151040] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-21T18:25:12.951025] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-21T18:25:13.020011] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T18:25:13.738609] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T18:25:13.750971] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-21T18:25:14.551073] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-21T18:25:14.727293] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T18:25:14.836294] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-21T18:25:15.351085] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-21T18:25:16.151080] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-21T18:25:16.412611] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T18:25:16.676974] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T18:25:16.951101] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-21T18:25:17.751056] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-21T18:25:18.062484] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T18:25:18.070281] [INFO ] [REMOTE ] DXC: Full fetch complete (70237 records). [2025-10-21T18:25:18.070426] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-21T18:25:18.471687] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-21T18:25:18.471818] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-21T18:25:18.472736] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-21T18:25:18.472905] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-21T18:25:18.500424] [DEBUG] [LOCAL ] DXC: Trimmed 70237 records to 49925 (keeping 200 days of data) [2025-10-21T18:25:18.500264] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T18:25:18.561889] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-21T18:25:18.810168] [DEBUG] [LOCAL ] DXC: Primary data saved (49925 records). [2025-10-21T18:25:18.810308] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-21T18:25:18.811182] [INFO ] [MAIN ] Update Progress: 671/2366 symbols completed. DXC took 39.4s. Estimated remaining: 3h 35m 20s. Rate: 7.9 symbols/min [2025-10-21T18:25:18.981727] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:25:19.007854] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-21T18:25:19.020344] [DEBUG] [LOCAL ] EAI: Loaded 3940 existing records from primary storage. [2025-10-21T18:25:19.020839] [INFO ] [MAIN ] EAI: Loaded 3940 existing records. [2025-10-21T18:25:19.195426] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:25:19.195710] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-21T18:25:19.195766] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-21T18:25:19.195939] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-21T18:25:19.195976] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-21T18:25:19.375249] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-21T18:25:19.600303] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:25:20.129991] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T18:25:20.151015] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-21T18:25:20.781289] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T18:25:20.782259] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-21T18:25:20.951023] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-21T18:25:21.751059] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-21T18:25:22.163952] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-21T18:25:22.408396] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T18:25:22.551069] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-21T18:25:23.351069] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-21T18:25:23.720859] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-21T18:25:24.151055] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-21T18:25:24.344791] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T18:25:24.749958] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-21T18:25:24.951129] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-21T18:25:25.751023] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-21T18:25:26.229350] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T18:25:26.234413] [INFO ] [REMOTE ] E: Full fetch complete (47662 records). [2025-10-21T18:25:26.234509] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-21T18:25:26.556153] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-21T18:25:26.633854] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-21T18:25:26.633929] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-21T18:25:26.634673] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-21T18:25:26.634737] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-21T18:25:26.635771] [DEBUG] [LOCAL ] E: Trimmed 47662 records to 33282 (keeping 200 days of data) [2025-10-21T18:25:26.832432] [DEBUG] [LOCAL ] E: Primary data saved (33282 records). [2025-10-21T18:25:26.832559] [INFO ] [MAIN ] E: Full history saved. [2025-10-21T18:25:26.832634] [INFO ] [MAIN ] Update Progress: 672/2366 symbols completed. E took 21.4s. Estimated remaining: 3h 35m 14s. Rate: 7.9 symbols/min [2025-10-21T18:25:26.997711] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:25:27.022578] [DEBUG] [LOCAL ] EARN: Loaded 28002 existing records from primary storage. [2025-10-21T18:25:27.022849] [INFO ] [MAIN ] EARN: Loaded 28002 existing records. [2025-10-21T18:25:27.195274] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:25:27.195503] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-21T18:25:27.195567] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-21T18:25:27.196196] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-21T18:25:27.196253] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-21T18:25:27.354912] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-21T18:25:27.553966] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:25:28.151074] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-21T18:25:28.171750] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T18:25:28.378413] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.63 seconds). [2025-10-21T18:25:28.385606] [INFO ] [REMOTE ] DXYZ: Full fetch complete (56669 records). [2025-10-21T18:25:28.385877] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-21T18:25:28.386563] [FATAL] [VALIDATOR ] DXYZ: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:25:28.386688] [FATAL] [MAIN ] DXYZ: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:25:28.386765] [WARN ] [MAIN ] DXYZ: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:25:28.386854] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-21T18:25:28.386955] [DEBUG] [LOCAL ] DXYZ: No primary data file found to delete. [2025-10-21T18:25:28.387009] [INFO ] [LOCAL ] DXYZ: Starting deletion of derivative data. [2025-10-21T18:25:28.387428] [DEBUG] [LOCAL ] DXYZ: Deleted derivative data file. [2025-10-21T18:25:28.387520] [INFO ] [MAIN ] Update Progress: 673/2366 symbols completed. DXYZ took 45.0s. Estimated remaining: 3h 34m 51s. Rate: 7.9 symbols/min [2025-10-21T18:25:28.565269] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:25:28.596029] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-21T18:25:28.650854] [DEBUG] [LOCAL ] EAT: Loaded 49806 existing records from primary storage. [2025-10-21T18:25:28.651143] [INFO ] [MAIN ] EAT: Loaded 49806 existing records. [2025-10-21T18:25:28.837805] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:25:28.838058] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-21T18:25:28.838111] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-21T18:25:28.838770] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-21T18:25:28.838829] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-21T18:25:28.956110] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-21T18:25:29.217057] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:25:29.577144] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-21T18:25:29.713506] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T18:25:29.750986] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-21T18:25:30.551103] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-21T18:25:31.351055] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-21T18:25:31.649513] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T18:25:31.840884] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T18:25:32.151029] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-21T18:25:32.556839] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-21T18:25:32.951060] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-21T18:25:33.750992] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-21T18:25:33.788035] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T18:25:34.341089] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-21T18:25:34.551078] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-21T18:25:34.616084] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T18:25:35.351067] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-21T18:25:35.904107] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-21T18:25:36.151012] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-21T18:25:36.237988] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T18:25:36.951018] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-21T18:25:37.521044] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-21T18:25:37.751046] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-21T18:25:37.796324] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T18:25:38.455956] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-21T18:25:38.457006] [INFO ] [REMOTE ] EAI: Full fetch complete (5809 records). [2025-10-21T18:25:38.457073] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-21T18:25:38.457401] [FATAL] [VALIDATOR ] EAI: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:25:38.457480] [FATAL] [MAIN ] EAI: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:25:38.457521] [WARN ] [MAIN ] EAI: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:25:38.457558] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-21T18:25:38.457611] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-21T18:25:38.457679] [INFO ] [LOCAL ] EAI: Starting deletion of derivative data. [2025-10-21T18:25:38.457860] [DEBUG] [LOCAL ] EAI: Deleted derivative data file. [2025-10-21T18:25:38.457940] [INFO ] [MAIN ] Update Progress: 674/2366 symbols completed. EAI took 19.6s. Estimated remaining: 3h 34m 49s. Rate: 7.9 symbols/min [2025-10-21T18:25:38.556931] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-21T18:25:38.630370] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:25:38.664066] [DEBUG] [LOCAL ] EB: Loaded 36273 existing records from primary storage. [2025-10-21T18:25:38.664365] [INFO ] [MAIN ] EB: Loaded 36273 existing records. [2025-10-21T18:25:38.892678] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:25:38.892903] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-21T18:25:38.892950] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-21T18:25:38.893482] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-21T18:25:38.893539] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-21T18:25:39.251624] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:25:39.351023] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-21T18:25:39.857852] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T18:25:40.151096] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-21T18:25:40.947252] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T18:25:40.953957] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-21T18:25:41.751027] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-21T18:25:41.968688] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T18:25:42.484910] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T18:25:42.550987] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-21T18:25:43.041313] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-21T18:25:43.046435] [INFO ] [REMOTE ] EAF: Full fetch complete (62008 records). [2025-10-21T18:25:43.046544] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-21T18:25:43.047278] [FATAL] [VALIDATOR ] EAF: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:25:43.047363] [FATAL] [MAIN ] EAF: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:25:43.047405] [WARN ] [MAIN ] EAF: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:25:43.047441] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-21T18:25:43.047494] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-10-21T18:25:43.047528] [INFO ] [LOCAL ] EAF: Starting deletion of derivative data. [2025-10-21T18:25:43.047680] [DEBUG] [LOCAL ] EAF: Deleted derivative data file. [2025-10-21T18:25:43.048157] [INFO ] [MAIN ] Update Progress: 675/2366 symbols completed. EAF took 35.3s. Estimated remaining: 3h 34m 34s. Rate: 7.9 symbols/min [2025-10-21T18:25:43.224496] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:25:43.245373] [DEBUG] [LOCAL ] EBF: Loaded 19140 existing records from primary storage. [2025-10-21T18:25:43.245611] [INFO ] [MAIN ] EBF: Loaded 19140 existing records. [2025-10-21T18:25:43.352932] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-21T18:25:43.444545] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:25:43.444803] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-21T18:25:43.444859] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-21T18:25:43.445251] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-21T18:25:43.445309] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-21T18:25:43.805294] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:25:43.829227] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T18:25:44.151038] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-21T18:25:44.519483] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T18:25:44.951083] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-21T18:25:45.751005] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-21T18:25:45.895976] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T18:25:46.204749] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T18:25:46.453436] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-21T18:25:46.551041] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-21T18:25:47.351044] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-21T18:25:47.819723] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-21T18:25:48.151047] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-21T18:25:48.629411] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T18:25:48.951150] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-21T18:25:49.613289] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T18:25:49.750990] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-21T18:25:50.128004] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-21T18:25:50.551041] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-21T18:25:51.351052] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-21T18:25:51.539508] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-21T18:25:51.585551] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T18:25:52.151031] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-21T18:25:52.935259] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-21T18:25:52.950972] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-21T18:25:53.751071] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-21T18:25:54.137870] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-21T18:25:54.347228] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T18:25:54.551025] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-21T18:25:54.932455] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-21T18:25:54.937160] [INFO ] [REMOTE ] EARN: Full fetch complete (45108 records). [2025-10-21T18:25:54.937338] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-21T18:25:54.938123] [FATAL] [VALIDATOR ] EARN: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:25:54.938265] [FATAL] [MAIN ] EARN: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:25:54.938339] [WARN ] [MAIN ] EARN: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:25:54.938416] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-21T18:25:54.938476] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-10-21T18:25:54.938515] [INFO ] [LOCAL ] EARN: Starting deletion of derivative data. [2025-10-21T18:25:54.938700] [DEBUG] [LOCAL ] EARN: Deleted derivative data file. [2025-10-21T18:25:54.938788] [INFO ] [MAIN ] Update Progress: 676/2366 symbols completed. EARN took 28.1s. Estimated remaining: 3h 34m 37s. Rate: 7.9 symbols/min [2025-10-21T18:25:55.117628] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:25:55.156260] [DEBUG] [LOCAL ] EBR: Loaded 43386 existing records from primary storage. [2025-10-21T18:25:55.156533] [INFO ] [MAIN ] EBR: Loaded 43386 existing records. [2025-10-21T18:25:55.337135] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:25:55.337354] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-21T18:25:55.337401] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-21T18:25:55.337981] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-21T18:25:55.338047] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-21T18:25:55.366841] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-21T18:25:55.705705] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:25:55.720107] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-21T18:25:56.151034] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-21T18:25:56.859716] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T18:25:56.950983] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-21T18:25:57.340691] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-21T18:25:57.751065] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-21T18:25:58.424366] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T18:25:58.551014] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-21T18:25:59.084594] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T18:25:59.351085] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-21T18:25:59.871905] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T18:26:00.151014] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-21T18:26:00.375480] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-21T18:26:00.951097] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-21T18:26:01.751102] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-21T18:26:01.855181] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T18:26:01.977145] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T18:26:02.551038] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-21T18:26:03.351007] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-21T18:26:03.553665] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T18:26:03.739021] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T18:26:04.151090] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-21T18:26:04.762554] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-21T18:26:04.767848] [INFO ] [REMOTE ] EB: Full fetch complete (55038 records). [2025-10-21T18:26:04.767939] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-21T18:26:04.956966] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-21T18:26:05.147887] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-21T18:26:05.147983] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-21T18:26:05.148732] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-21T18:26:05.148812] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-21T18:26:05.149849] [DEBUG] [LOCAL ] EB: Trimmed 55038 records to 36257 (keeping 200 days of data) [2025-10-21T18:26:05.348588] [DEBUG] [LOCAL ] EB: Primary data saved (36257 records). [2025-10-21T18:26:05.348768] [INFO ] [MAIN ] EB: Full history saved. [2025-10-21T18:26:05.349630] [INFO ] [MAIN ] Update Progress: 677/2366 symbols completed. EB took 26.9s. Estimated remaining: 3h 34m 37s. Rate: 7.9 symbols/min [2025-10-21T18:26:05.610938] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T18:26:05.751069] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-21T18:26:06.551058] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-21T18:26:06.950910] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T18:26:06.989268] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-21T18:26:07.350986] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-21T18:26:07.671406] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-21T18:26:08.151101] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-21T18:26:08.951044] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-21T18:26:09.019931] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T18:26:09.147251] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T18:26:09.750991] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-21T18:26:10.551043] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-21T18:26:10.723289] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T18:26:11.228387] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T18:26:11.351066] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-21T18:26:11.804083] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T18:26:11.810018] [INFO ] [REMOTE ] EBF: Full fetch complete (28154 records). [2025-10-21T18:26:11.810332] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-21T18:26:12.158991] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-21T18:26:12.186960] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-21T18:26:12.187151] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-21T18:26:12.187713] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-21T18:26:12.187835] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-21T18:26:12.188575] [DEBUG] [LOCAL ] EBF: Trimmed 28154 records to 19191 (keeping 200 days of data) [2025-10-21T18:26:12.302932] [DEBUG] [LOCAL ] EBF: Primary data saved (19191 records). [2025-10-21T18:26:12.303060] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-21T18:26:12.303139] [INFO ] [MAIN ] Update Progress: 678/2366 symbols completed. EBF took 29.3s. Estimated remaining: 3h 34m 27s. Rate: 7.9 symbols/min [2025-10-21T18:26:13.150379] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T18:26:13.158149] [INFO ] [REMOTE ] EAT: Full fetch complete (72344 records). [2025-10-21T18:26:13.158301] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-21T18:26:13.556967] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-21T18:26:13.557050] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-21T18:26:13.557901] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-21T18:26:13.557985] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-21T18:26:13.559358] [DEBUG] [LOCAL ] EAT: Trimmed 72344 records to 49741 (keeping 200 days of data) [2025-10-21T18:26:13.882564] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T18:26:13.887516] [DEBUG] [LOCAL ] EAT: Primary data saved (49741 records). [2025-10-21T18:26:13.896021] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-21T18:26:13.896140] [INFO ] [MAIN ] Update Progress: 679/2366 symbols completed. EAT took 45.5s. Estimated remaining: 3h 34m 5s. Rate: 7.9 symbols/min [2025-10-21T18:26:13.897196] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-21T18:26:15.427391] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T18:26:15.436624] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-21T18:26:16.935057] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T18:26:16.944172] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-21T18:26:18.466791] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T18:26:18.476387] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-21T18:26:20.215687] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T18:26:20.223584] [INFO ] [REMOTE ] EBR: Full fetch complete (62519 records). [2025-10-21T18:26:20.223768] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-21T18:26:20.606964] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-21T18:26:20.607059] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-21T18:26:20.607841] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-21T18:26:20.607902] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-21T18:26:20.609078] [DEBUG] [LOCAL ] EBR: Trimmed 62519 records to 43373 (keeping 200 days of data) [2025-10-21T18:26:20.849431] [DEBUG] [LOCAL ] EBR: Primary data saved (43373 records). [2025-10-21T18:26:20.849548] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-21T18:26:20.849622] [INFO ] [MAIN ] Update Progress: 680/2366 symbols completed. EBR took 25.9s. Estimated remaining: 3h 33m 55s. Rate: 7.9 symbols/min [2025-10-21T18:26:21.420027] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:26:21.533277] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:26:21.570747] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:26:21.573477] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:26:21.642416] [DEBUG] [LOCAL ] ECC: Loaded 43475 existing records from primary storage. [2025-10-21T18:26:21.652612] [DEBUG] [LOCAL ] EBS: Loaded 46671 existing records from primary storage. [2025-10-21T18:26:21.653873] [DEBUG] [LOCAL ] ECAT: Loaded 29346 existing records from primary storage. [2025-10-21T18:26:21.654040] [INFO ] [MAIN ] EBS: Loaded 46671 existing records. [2025-10-21T18:26:21.659425] [INFO ] [MAIN ] ECC: Loaded 43475 existing records. [2025-10-21T18:26:21.674953] [INFO ] [MAIN ] ECAT: Loaded 29346 existing records. [2025-10-21T18:26:22.073917] [DEBUG] [LOCAL ] EC: Loaded 48929 existing records from primary storage. [2025-10-21T18:26:22.198924] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:26:22.193870] [INFO ] [MAIN ] EC: Loaded 48929 existing records. [2025-10-21T18:26:22.243499] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:26:22.285132] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-21T18:26:22.293811] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-21T18:26:22.294025] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-21T18:26:22.288206] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:26:22.322575] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-21T18:26:22.322688] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-21T18:26:22.333274] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-21T18:26:22.354143] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-21T18:26:22.361051] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-21T18:26:22.343600] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-21T18:26:22.354391] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-21T18:26:22.370420] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-21T18:26:22.369938] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-21T18:26:22.697713] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:26:22.732912] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-21T18:26:22.756560] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-21T18:26:22.777058] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-21T18:26:22.792795] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-21T18:26:23.622679] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:26:23.704048] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-21T18:26:23.745275] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:26:23.783368] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-21T18:26:23.885330] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:26:23.895924] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-21T18:26:23.957026] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:26:23.957441] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-21T18:26:25.377661] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T18:26:25.385715] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-21T18:26:25.463846] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-21T18:26:25.472638] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-21T18:26:25.516807] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T18:26:25.522627] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-21T18:26:25.800065] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T18:26:25.809958] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-21T18:26:26.707973] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T18:26:26.713933] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-21T18:26:26.844226] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T18:26:26.852780] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-21T18:26:26.876998] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T18:26:26.886317] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-21T18:26:27.016879] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-21T18:26:27.027051] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-21T18:26:27.916356] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T18:26:27.923633] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-21T18:26:28.243591] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T18:26:28.254964] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-21T18:26:28.391268] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T18:26:28.401187] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-21T18:26:28.768771] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-21T18:26:28.771338] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T18:26:28.788810] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-21T18:26:28.951053] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-21T18:26:29.605067] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-21T18:26:29.635356] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-21T18:26:29.751032] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-21T18:26:29.939831] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T18:26:30.550997] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-21T18:26:30.912886] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-21T18:26:30.980201] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-21T18:26:31.351024] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-21T18:26:32.151013] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-21T18:26:32.191444] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T18:26:32.951055] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-21T18:26:32.982317] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T18:26:33.401463] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T18:26:33.751051] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-21T18:26:34.551080] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-21T18:26:34.775432] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T18:26:35.351065] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-21T18:26:35.634988] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T18:26:36.049186] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T18:26:36.151033] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-21T18:26:36.951013] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-21T18:26:37.129486] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T18:26:37.191856] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-21T18:26:37.751026] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-21T18:26:38.551075] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-21T18:26:38.668915] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T18:26:39.351044] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-21T18:26:39.456748] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T18:26:40.113226] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T18:26:40.151084] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-21T18:26:40.958429] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-21T18:26:40.964756] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T18:26:41.506593] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T18:26:41.751036] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-21T18:26:42.551055] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-21T18:26:42.671846] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T18:26:43.015462] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T18:26:43.019985] [INFO ] [REMOTE ] ECAT: Full fetch complete (42915 records). [2025-10-21T18:26:43.020096] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-21T18:26:43.375935] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-21T18:26:43.391803] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-21T18:26:43.392105] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-21T18:26:43.392762] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-21T18:26:43.392823] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-21T18:26:43.393814] [DEBUG] [LOCAL ] ECAT: Trimmed 42915 records to 29262 (keeping 200 days of data) [2025-10-21T18:26:43.578302] [DEBUG] [LOCAL ] ECAT: Primary data saved (29262 records). [2025-10-21T18:26:43.578451] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-21T18:26:43.578546] [INFO ] [MAIN ] Update Progress: 681/2366 symbols completed. ECAT took 22.7s. Estimated remaining: 3h 34m 25s. Rate: 7.9 symbols/min [2025-10-21T18:26:43.755282] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:26:43.755451] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-21T18:26:43.755501] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-21T18:26:43.755607] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-21T18:26:43.755670] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-21T18:26:43.755733] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-21T18:26:43.755768] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-21T18:26:44.117039] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:26:44.151018] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-21T18:26:44.230048] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T18:26:44.595993] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-21T18:26:44.951021] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-21T18:26:45.130776] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T18:26:45.751003] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-21T18:26:46.551015] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-21T18:26:46.800706] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-21T18:26:46.807756] [INFO ] [REMOTE ] ECC: Full fetch complete (61579 records). [2025-10-21T18:26:46.807867] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-21T18:26:47.197358] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-21T18:26:47.197498] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-21T18:26:47.198401] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-21T18:26:47.198464] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-21T18:26:47.199709] [DEBUG] [LOCAL ] ECC: Trimmed 61579 records to 43432 (keeping 200 days of data) [2025-10-21T18:26:47.362869] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-21T18:26:47.452871] [DEBUG] [LOCAL ] ECC: Primary data saved (43432 records). [2025-10-21T18:26:47.453011] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-21T18:26:47.453117] [INFO ] [MAIN ] Update Progress: 682/2366 symbols completed. ECC took 26.6s. Estimated remaining: 3h 34m 8s. Rate: 7.9 symbols/min [2025-10-21T18:26:47.662466] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-21T18:26:47.664490] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:26:47.682481] [DEBUG] [LOCAL ] ECCU: Loaded 2179 existing records from primary storage. [2025-10-21T18:26:47.682801] [INFO ] [MAIN ] ECCU: Loaded 2179 existing records. [2025-10-21T18:26:47.846122] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-21T18:26:47.874468] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:26:47.875116] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-21T18:26:47.875170] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-21T18:26:47.875363] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-10-21T18:26:47.875419] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-21T18:26:48.152742] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-21T18:26:48.230441] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:26:48.344235] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T18:26:48.352006] [INFO ] [REMOTE ] EC: Full fetch complete (71874 records). [2025-10-21T18:26:48.352182] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-21T18:26:48.743937] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-21T18:26:48.744028] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-21T18:26:48.744899] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-21T18:26:48.744961] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-21T18:26:48.746324] [DEBUG] [LOCAL ] EC: Trimmed 71874 records to 48909 (keeping 200 days of data) [2025-10-21T18:26:48.951050] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-21T18:26:49.037922] [DEBUG] [LOCAL ] EC: Primary data saved (48909 records). [2025-10-21T18:26:49.038062] [INFO ] [MAIN ] EC: Full history saved. [2025-10-21T18:26:49.038155] [INFO ] [MAIN ] Update Progress: 683/2366 symbols completed. EC took 28.2s. Estimated remaining: 3h 33m 46s. Rate: 7.9 symbols/min [2025-10-21T18:26:49.207433] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:26:49.207591] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-21T18:26:49.207627] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-21T18:26:49.207761] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-21T18:26:49.207822] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-21T18:26:49.207889] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-21T18:26:49.207935] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-21T18:26:49.569341] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:26:49.680443] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-21T18:26:49.750992] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-21T18:26:49.855796] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T18:26:50.088831] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-21T18:26:50.551024] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-21T18:26:50.982404] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-21T18:26:51.351095] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-21T18:26:51.826100] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-21T18:26:52.151053] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-21T18:26:52.731285] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-21T18:26:52.951026] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-21T18:26:53.751061] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-21T18:26:54.119342] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-21T18:26:54.529928] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T18:26:54.536607] [INFO ] [REMOTE ] EBS: Full fetch complete (67050 records). [2025-10-21T18:26:54.536753] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-21T18:26:54.537486] [FATAL] [VALIDATOR ] EBS: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:26:54.537612] [FATAL] [MAIN ] EBS: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:26:54.537713] [WARN ] [MAIN ] EBS: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:26:54.537814] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-21T18:26:54.537892] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-10-21T18:26:54.537930] [INFO ] [LOCAL ] EBS: Starting deletion of derivative data. [2025-10-21T18:26:54.538115] [DEBUG] [LOCAL ] EBS: Deleted derivative data file. [2025-10-21T18:26:54.538827] [INFO ] [MAIN ] Update Progress: 684/2366 symbols completed. EBS took 33.7s. Estimated remaining: 3h 33m 33s. Rate: 7.9 symbols/min [2025-10-21T18:26:54.559189] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-21T18:26:54.718854] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:26:54.719039] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-21T18:26:54.719076] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-21T18:26:54.719211] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-21T18:26:54.719289] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-21T18:26:54.719351] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-21T18:26:54.719384] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-21T18:26:55.082792] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:26:55.247255] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-21T18:26:55.351048] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-21T18:26:55.629388] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-21T18:26:56.151126] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-21T18:26:56.516468] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-21T18:26:56.951042] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-21T18:26:57.383223] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-21T18:26:57.751019] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-21T18:26:58.092856] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-21T18:26:58.551029] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-21T18:26:58.893117] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-21T18:26:59.351046] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-21T18:26:59.707207] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-21T18:27:00.151023] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-21T18:27:00.713372] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-21T18:27:00.951049] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-21T18:27:01.341102] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-21T18:27:01.751038] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-21T18:27:02.099549] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-21T18:27:02.551029] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-21T18:27:02.959258] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-21T18:27:03.351043] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-21T18:27:03.680021] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-21T18:27:04.151014] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-21T18:27:04.608976] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-21T18:27:04.951056] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-21T18:27:05.501617] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-21T18:27:05.502636] [INFO ] [REMOTE ] ECCC: Full fetch complete (1302 records). [2025-10-21T18:27:05.502762] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-21T18:27:05.503196] [FATAL] [VALIDATOR ] ECCC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:27:05.503298] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:27:05.503354] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:27:05.503403] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-21T18:27:05.503588] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-21T18:27:05.503683] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-21T18:27:05.503758] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-21T18:27:05.503836] [INFO ] [MAIN ] Update Progress: 685/2366 symbols completed. ECCC took 21.9s. Estimated remaining: 3h 33m 34s. Rate: 7.9 symbols/min [2025-10-21T18:27:05.699559] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:27:05.733006] [DEBUG] [LOCAL ] ECG: Loaded 32902 existing records from primary storage. [2025-10-21T18:27:05.733309] [INFO ] [MAIN ] ECG: Loaded 32902 existing records. [2025-10-21T18:27:05.756157] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-21T18:27:05.932482] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:27:05.932737] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-21T18:27:05.932791] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-21T18:27:05.933362] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-21T18:27:05.933420] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-21T18:27:06.273550] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-21T18:27:06.329190] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:27:06.551039] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-21T18:27:07.015764] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-21T18:27:07.351085] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-21T18:27:07.684963] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-21T18:27:08.151079] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-21T18:27:08.612281] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-21T18:27:08.951025] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-21T18:27:09.264536] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-21T18:27:09.751055] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-21T18:27:10.551032] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-21T18:27:10.955613] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-21T18:27:11.287437] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T18:27:11.351032] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-21T18:27:11.922467] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-21T18:27:12.151082] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-21T18:27:12.567216] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-21T18:27:12.951076] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-21T18:27:13.751022] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-21T18:27:14.087189] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-21T18:27:14.363330] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T18:27:14.551023] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-21T18:27:15.066246] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-21T18:27:15.351012] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-21T18:27:15.834389] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T18:27:16.151076] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-21T18:27:16.951024] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-21T18:27:17.515521] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-21T18:27:17.516284] [INFO ] [REMOTE ] ECCW: Full fetch complete (1423 records). [2025-10-21T18:27:17.516349] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-21T18:27:17.712960] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T18:27:17.717555] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-21T18:27:17.717767] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:27:17.725621] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:27:17.726086] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-21T18:27:17.726418] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-21T18:27:17.726475] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-21T18:27:17.726518] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-21T18:27:17.726571] [INFO ] [MAIN ] Update Progress: 686/2366 symbols completed. ECCW took 28.7s. Estimated remaining: 3h 33m 37s. Rate: 7.9 symbols/min [2025-10-21T18:27:17.756200] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-21T18:27:17.893820] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:27:17.936747] [DEBUG] [LOCAL ] ECL: Loaded 46730 existing records from primary storage. [2025-10-21T18:27:17.937035] [INFO ] [MAIN ] ECL: Loaded 46730 existing records. [2025-10-21T18:27:18.109637] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:27:18.109850] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-21T18:27:18.109895] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-21T18:27:18.110067] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-21T18:27:18.110104] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-21T18:27:18.298587] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-21T18:27:18.470678] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:27:18.550978] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-21T18:27:19.351022] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-21T18:27:19.777269] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-21T18:27:20.151101] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-21T18:27:20.322397] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T18:27:20.951020] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-21T18:27:21.750997] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-21T18:27:21.835513] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T18:27:22.023519] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-21T18:27:22.551044] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-21T18:27:22.732151] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T18:27:22.859069] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-21T18:27:23.351096] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-21T18:27:24.151037] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-21T18:27:24.951033] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-21T18:27:25.223445] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T18:27:25.440250] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-21T18:27:25.441216] [INFO ] [REMOTE ] ECCX: Full fetch complete (1456 records). [2025-10-21T18:27:25.441320] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-21T18:27:25.635089] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-21T18:27:25.635546] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:27:25.635635] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:27:25.635899] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-21T18:27:25.636123] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-21T18:27:25.636205] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-21T18:27:25.636328] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-21T18:27:25.636521] [INFO ] [MAIN ] Update Progress: 687/2366 symbols completed. ECCX took 31.1s. Estimated remaining: 3h 33m 30s. Rate: 7.9 symbols/min [2025-10-21T18:27:25.756727] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-21T18:27:25.763896] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T18:27:25.846955] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:27:25.866670] [DEBUG] [LOCAL ] ECO: Loaded 18204 existing records from primary storage. [2025-10-21T18:27:25.866917] [INFO ] [MAIN ] ECO: Loaded 18204 existing records. [2025-10-21T18:27:26.040944] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:27:26.041135] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-21T18:27:26.041183] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-21T18:27:26.041352] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-21T18:27:26.041391] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-21T18:27:26.382553] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:27:26.550978] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-21T18:27:27.351062] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-21T18:27:27.753102] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-21T18:27:27.842083] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-21T18:27:27.884233] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-21T18:27:27.884986] [INFO ] [REMOTE ] ECCU: Full fetch complete (4251 records). [2025-10-21T18:27:27.885053] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-21T18:27:27.885380] [FATAL] [VALIDATOR ] ECCU: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:27:27.885454] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:27:27.885519] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:27:27.885589] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-21T18:27:27.885671] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-21T18:27:27.885726] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-10-21T18:27:27.885837] [DEBUG] [LOCAL ] ECCU: Deleted derivative data file. [2025-10-21T18:27:27.885901] [INFO ] [MAIN ] Update Progress: 688/2366 symbols completed. ECCU took 40.4s. Estimated remaining: 3h 33m 9s. Rate: 7.9 symbols/min [2025-10-21T18:27:28.059701] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:27:28.059871] [DEBUG] [LOCAL ] ECVT: No existing data file found in primary storage. [2025-10-21T18:27:28.059908] [WARN ] [MAIN ] ECVT: No existing data found, performing full refresh instead. [2025-10-21T18:27:28.060021] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-21T18:27:28.060061] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-21T18:27:28.060100] [DEBUG] [LOCAL ] ECVT: No primary data file found to delete. [2025-10-21T18:27:28.060131] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-21T18:27:28.156109] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-21T18:27:28.410742] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:27:28.951024] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-21T18:27:29.427757] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-21T18:27:29.751016] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-21T18:27:30.551024] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-21T18:27:30.724265] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-21T18:27:31.108163] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T18:27:31.350995] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-21T18:27:31.734926] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T18:27:32.151064] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-21T18:27:32.488905] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T18:27:32.951263] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-21T18:27:33.751087] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-21T18:27:33.916285] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T18:27:34.336321] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T18:27:34.551147] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-21T18:27:34.988295] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T18:27:35.351010] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-21T18:27:35.400524] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-21T18:27:36.151040] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-21T18:27:36.445596] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-21T18:27:36.951030] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-21T18:27:37.505509] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T18:27:37.510405] [INFO ] [REMOTE ] ECG: Full fetch complete (50797 records). [2025-10-21T18:27:37.510489] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-21T18:27:37.756122] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-21T18:27:37.895338] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T18:27:37.894882] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-21T18:27:37.895456] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-21T18:27:37.899942] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-21T18:27:37.900105] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-21T18:27:37.901286] [DEBUG] [LOCAL ] ECG: Trimmed 50797 records to 32804 (keeping 200 days of data) [2025-10-21T18:27:38.086531] [DEBUG] [LOCAL ] ECG: Primary data saved (32804 records). [2025-10-21T18:27:38.086676] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-21T18:27:38.086768] [INFO ] [MAIN ] Update Progress: 689/2366 symbols completed. ECG took 32.6s. Estimated remaining: 3h 33m 8s. Rate: 7.9 symbols/min [2025-10-21T18:27:38.257879] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:27:38.308918] [DEBUG] [LOCAL ] ED: Loaded 52649 existing records from primary storage. [2025-10-21T18:27:38.309208] [INFO ] [MAIN ] ED: Loaded 52649 existing records. [2025-10-21T18:27:38.481419] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:27:38.481594] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-21T18:27:38.481639] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-21T18:27:38.482157] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-21T18:27:38.482213] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-21T18:27:38.556192] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-21T18:27:38.828607] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:27:39.350991] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-21T18:27:39.703959] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-21T18:27:39.976740] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T18:27:40.150990] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-21T18:27:40.464523] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-21T18:27:40.951044] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-21T18:27:41.751029] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-21T18:27:41.919895] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T18:27:42.528719] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T18:27:42.550993] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-21T18:27:43.351026] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-21T18:27:43.463756] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T18:27:44.044033] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-21T18:27:44.092953] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T18:27:44.151014] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-21T18:27:44.951035] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-21T18:27:45.751032] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-21T18:27:46.039972] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-21T18:27:46.551068] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-21T18:27:46.645912] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T18:27:47.351072] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-21T18:27:47.430537] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T18:27:47.680929] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T18:27:48.151069] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-21T18:27:48.951027] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-21T18:27:49.073506] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T18:27:49.296007] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-21T18:27:49.751087] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-21T18:27:50.551049] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-21T18:27:50.817352] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T18:27:50.825364] [INFO ] [REMOTE ] ECL: Full fetch complete (68390 records). [2025-10-21T18:27:50.825521] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-21T18:27:50.996309] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T18:27:51.024688] [INFO ] [REMOTE ] ECO: Full fetch complete (28312 records). [2025-10-21T18:27:51.030386] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-21T18:27:51.375048] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-21T18:27:51.411157] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-21T18:27:51.436638] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-21T18:27:51.442763] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-21T18:27:51.506101] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-21T18:27:51.556571] [DEBUG] [LOCAL ] ECL: Trimmed 68390 records to 46734 (keeping 200 days of data) [2025-10-21T18:27:51.698885] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-21T18:27:51.725819] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-21T18:27:51.736767] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-21T18:27:51.736856] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-21T18:27:51.742893] [DEBUG] [LOCAL ] ECO: Trimmed 28312 records to 18099 (keeping 200 days of data) [2025-10-21T18:27:51.980896] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-21T18:27:52.009859] [DEBUG] [LOCAL ] ECO: Primary data saved (18099 records). [2025-10-21T18:27:52.011167] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-21T18:27:52.011609] [INFO ] [MAIN ] Update Progress: 690/2366 symbols completed. ECO took 26.4s. Estimated remaining: 3h 33m 16s. Rate: 7.9 symbols/min [2025-10-21T18:27:52.173508] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-21T18:27:52.207693] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:27:52.227406] [DEBUG] [LOCAL ] EDD: No existing data file found in primary storage. [2025-10-21T18:27:52.239712] [WARN ] [MAIN ] EDD: No existing data found, performing full refresh instead. [2025-10-21T18:27:52.243263] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-21T18:27:52.248446] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-21T18:27:52.251997] [DEBUG] [LOCAL ] EDD: No primary data file found to delete. [2025-10-21T18:27:52.252093] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-21T18:27:52.251923] [DEBUG] [LOCAL ] ECL: Primary data saved (46734 records). [2025-10-21T18:27:52.252254] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-21T18:27:52.258280] [INFO ] [MAIN ] Update Progress: 691/2366 symbols completed. ECL took 34.5s. Estimated remaining: 3h 32m 50s. Rate: 7.9 symbols/min [2025-10-21T18:27:52.636944] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:27:52.660061] [DEBUG] [LOCAL ] EDF: No existing data file found in primary storage. [2025-10-21T18:27:52.666000] [WARN ] [MAIN ] EDF: No existing data found, performing full refresh instead. [2025-10-21T18:27:52.666149] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-21T18:27:52.690039] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-21T18:27:52.737419] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-10-21T18:27:52.745397] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-21T18:27:52.980082] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:27:53.006113] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-21T18:27:53.188911] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:27:53.707211] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-21T18:27:53.744127] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T18:27:53.752020] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-21T18:27:54.309465] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T18:27:54.551069] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-21T18:27:54.818456] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T18:27:55.351045] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-21T18:27:56.151048] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-21T18:27:56.190289] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T18:27:56.685699] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T18:27:56.779297] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-21T18:27:56.951031] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-21T18:27:57.751040] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-21T18:27:58.551064] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-21T18:27:58.656949] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T18:27:58.856050] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T18:27:59.351027] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-21T18:27:59.555428] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T18:28:00.151065] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-21T18:28:00.650219] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T18:28:00.951126] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-21T18:28:01.751031] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-21T18:28:02.062106] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-21T18:28:02.221932] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-21T18:28:02.551109] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-21T18:28:03.334499] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T18:28:03.350983] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-21T18:28:04.151015] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-21T18:28:04.193557] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T18:28:04.950998] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-21T18:28:05.357499] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T18:28:05.472395] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-21T18:28:05.751102] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-21T18:28:06.491432] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-21T18:28:06.497727] [INFO ] [REMOTE ] ECVT: Full fetch complete (60038 records). [2025-10-21T18:28:06.497872] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-21T18:28:06.498511] [FATAL] [VALIDATOR ] ECVT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:28:06.498616] [FATAL] [MAIN ] ECVT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:28:06.498713] [WARN ] [MAIN ] ECVT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:28:06.498811] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-21T18:28:06.498892] [DEBUG] [LOCAL ] ECVT: No primary data file found to delete. [2025-10-21T18:28:06.498930] [INFO ] [LOCAL ] ECVT: Starting deletion of derivative data. [2025-10-21T18:28:06.498970] [DEBUG] [LOCAL ] ECVT: No derivative data file found to delete. [2025-10-21T18:28:06.499026] [INFO ] [MAIN ] Update Progress: 692/2366 symbols completed. ECVT took 38.6s. Estimated remaining: 3h 32m 59s. Rate: 7.9 symbols/min [2025-10-21T18:28:06.556221] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-21T18:28:06.678991] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:28:06.697919] [DEBUG] [LOCAL ] EDN: Loaded 19210 existing records from primary storage. [2025-10-21T18:28:06.698223] [INFO ] [MAIN ] EDN: Loaded 19210 existing records. [2025-10-21T18:28:06.912067] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:28:06.913565] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T18:28:06.913693] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-21T18:28:06.919010] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-21T18:28:06.920085] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-21T18:28:06.920146] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-21T18:28:07.273442] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:28:07.351019] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-21T18:28:08.155159] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-21T18:28:08.159927] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T18:28:08.168423] [INFO ] [REMOTE ] ED: Full fetch complete (76376 records). [2025-10-21T18:28:08.168537] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-21T18:28:08.533484] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-21T18:28:08.595636] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-21T18:28:08.595743] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-21T18:28:08.596634] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-21T18:28:08.596715] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-21T18:28:08.598127] [DEBUG] [LOCAL ] ED: Trimmed 76376 records to 52606 (keeping 200 days of data) [2025-10-21T18:28:08.924196] [DEBUG] [LOCAL ] ED: Primary data saved (52606 records). [2025-10-21T18:28:08.924429] [INFO ] [MAIN ] ED: Full history saved. [2025-10-21T18:28:08.925379] [INFO ] [MAIN ] Update Progress: 693/2366 symbols completed. ED took 30.8s. Estimated remaining: 3h 32m 38s. Rate: 7.9 symbols/min [2025-10-21T18:28:08.956103] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-21T18:28:09.037165] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-21T18:28:09.107993] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:28:09.148307] [DEBUG] [LOCAL ] EDU: Loaded 44811 existing records from primary storage. [2025-10-21T18:28:09.148598] [INFO ] [MAIN ] EDU: Loaded 44811 existing records. [2025-10-21T18:28:09.326519] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:28:09.326779] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-21T18:28:09.326840] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-21T18:28:09.327126] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-21T18:28:09.327190] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-21T18:28:09.682204] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:28:09.751045] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-21T18:28:10.116576] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T18:28:10.551797] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-21T18:28:11.136583] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T18:28:11.351073] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-21T18:28:12.151034] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-21T18:28:12.384171] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-21T18:28:12.422801] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T18:28:12.951024] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-21T18:28:13.547223] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T18:28:13.751015] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-21T18:28:14.551013] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-21T18:28:14.687252] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T18:28:14.870499] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-21T18:28:15.332099] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-21T18:28:15.350988] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-21T18:28:16.151051] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-21T18:28:16.505543] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-21T18:28:16.951079] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-21T18:28:17.728203] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T18:28:17.750979] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-21T18:28:17.885629] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-21T18:28:18.551070] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-21T18:28:19.351080] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-21T18:28:19.392878] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T18:28:19.539823] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-21T18:28:20.151012] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-21T18:28:20.847430] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T18:28:20.951023] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-21T18:28:21.618812] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-21T18:28:21.750988] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-21T18:28:21.820326] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-21T18:28:22.551033] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-21T18:28:23.337315] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T18:28:23.350996] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-21T18:28:23.528273] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T18:28:24.151026] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-21T18:28:24.951009] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-21T18:28:24.969145] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-21T18:28:25.042397] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T18:28:25.594830] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-21T18:28:25.751079] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-21T18:28:26.551001] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-21T18:28:26.701199] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-21T18:28:26.705810] [INFO ] [REMOTE ] EDD: Full fetch complete (38915 records). [2025-10-21T18:28:26.705922] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-21T18:28:27.219926] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-21T18:28:27.220074] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-21T18:28:27.220806] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-21T18:28:27.220871] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-21T18:28:27.222009] [DEBUG] [LOCAL ] EDD: Trimmed 38915 records to 27227 (keeping 200 days of data) [2025-10-21T18:28:27.353869] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-21T18:28:27.464975] [DEBUG] [LOCAL ] EDD: Primary data saved (27227 records). [2025-10-21T18:28:27.465143] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-21T18:28:27.465224] [INFO ] [MAIN ] Update Progress: 694/2366 symbols completed. EDD took 35.5s. Estimated remaining: 3h 32m 57s. Rate: 7.9 symbols/min [2025-10-21T18:28:27.680688] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:28:27.682071] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T18:28:27.723324] [DEBUG] [LOCAL ] EE: Loaded 32694 existing records from primary storage. [2025-10-21T18:28:27.723637] [INFO ] [MAIN ] EE: Loaded 32694 existing records. [2025-10-21T18:28:27.921922] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:28:27.922187] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-21T18:28:27.922279] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-21T18:28:27.922926] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-21T18:28:27.923010] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-21T18:28:28.156127] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-21T18:28:28.312590] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:28:28.327792] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-21T18:28:28.333179] [INFO ] [REMOTE ] EDF: Full fetch complete (20294 records). [2025-10-21T18:28:28.333291] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-21T18:28:28.722810] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-21T18:28:28.722880] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-21T18:28:28.723358] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-21T18:28:28.723398] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-21T18:28:28.723998] [DEBUG] [LOCAL ] EDF: Trimmed 20294 records to 12901 (keeping 200 days of data) [2025-10-21T18:28:28.797546] [DEBUG] [LOCAL ] EDF: Primary data saved (12901 records). [2025-10-21T18:28:28.797698] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-21T18:28:28.797778] [INFO ] [MAIN ] Update Progress: 695/2366 symbols completed. EDF took 36.5s. Estimated remaining: 3h 32m 34s. Rate: 7.9 symbols/min [2025-10-21T18:28:28.961419] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-21T18:28:28.964901] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:28:28.965840] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-21T18:28:28.965899] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-21T18:28:28.966037] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-21T18:28:28.966101] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-21T18:28:28.966159] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-21T18:28:28.966390] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-21T18:28:29.320996] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:28:29.630299] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T18:28:29.751000] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-21T18:28:30.239135] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T18:28:30.303098] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-21T18:28:30.551055] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-21T18:28:31.351029] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-21T18:28:31.648255] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T18:28:31.652401] [INFO ] [REMOTE ] EDN: Full fetch complete (29885 records). [2025-10-21T18:28:31.652506] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-21T18:28:32.033860] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-21T18:28:32.033936] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-21T18:28:32.034476] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-21T18:28:32.034529] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-21T18:28:32.035291] [DEBUG] [LOCAL ] EDN: Trimmed 29885 records to 19252 (keeping 200 days of data) [2025-10-21T18:28:32.146902] [DEBUG] [LOCAL ] EDN: Primary data saved (19252 records). [2025-10-21T18:28:32.147073] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-21T18:28:32.147159] [INFO ] [MAIN ] Update Progress: 696/2366 symbols completed. EDN took 25.6s. Estimated remaining: 3h 32m 16s. Rate: 7.9 symbols/min [2025-10-21T18:28:32.158406] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-21T18:28:32.318690] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:28:32.328686] [DEBUG] [LOCAL ] EEX: Loaded 10029 existing records from primary storage. [2025-10-21T18:28:32.328900] [INFO ] [MAIN ] EEX: Loaded 10029 existing records. [2025-10-21T18:28:32.508677] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:28:32.508866] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-21T18:28:32.508911] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-21T18:28:32.509166] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-21T18:28:32.509221] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-21T18:28:32.593717] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-21T18:28:32.876933] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:28:32.957377] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-21T18:28:32.963407] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T18:28:33.571272] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-21T18:28:33.750993] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-21T18:28:34.551028] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-21T18:28:35.314118] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-21T18:28:35.321486] [INFO ] [REMOTE ] EDU: Full fetch complete (67176 records). [2025-10-21T18:28:35.321685] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-21T18:28:35.353728] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-21T18:28:35.667997] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-21T18:28:35.728629] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-21T18:28:35.728732] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-21T18:28:35.729599] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-21T18:28:35.729686] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-21T18:28:35.731092] [DEBUG] [LOCAL ] EDU: Trimmed 67176 records to 44834 (keeping 200 days of data) [2025-10-21T18:28:35.985760] [DEBUG] [LOCAL ] EDU: Primary data saved (44834 records). [2025-10-21T18:28:35.985888] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-21T18:28:35.985965] [INFO ] [MAIN ] Update Progress: 697/2366 symbols completed. EDU took 27.1s. Estimated remaining: 3h 31m 60s. Rate: 7.9 symbols/min [2025-10-21T18:28:36.150227] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:28:36.151003] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-21T18:28:36.193230] [DEBUG] [LOCAL ] EFC: Loaded 46426 existing records from primary storage. [2025-10-21T18:28:36.193537] [INFO ] [MAIN ] EFC: Loaded 46426 existing records. [2025-10-21T18:28:36.366024] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:28:36.366235] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-21T18:28:36.366286] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-21T18:28:36.366792] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-21T18:28:36.366849] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-21T18:28:36.720445] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:28:36.733775] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T18:28:36.861917] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-21T18:28:36.950984] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-21T18:28:37.750983] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-21T18:28:38.164682] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-21T18:28:38.551031] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-21T18:28:38.661408] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T18:28:39.351003] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-21T18:28:39.588279] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-21T18:28:40.150992] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-21T18:28:40.386026] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T18:28:40.951016] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-21T18:28:41.460505] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T18:28:41.751060] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-21T18:28:41.900903] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T18:28:42.120853] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-21T18:28:42.551022] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-21T18:28:43.351049] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-21T18:28:43.387838] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-21T18:28:44.151036] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-21T18:28:44.904967] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T18:28:44.950996] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-21T18:28:45.001940] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T18:28:45.751056] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-21T18:28:46.551055] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-21T18:28:46.631735] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-21T18:28:46.633183] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T18:28:47.042564] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-21T18:28:47.351032] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-21T18:28:48.151025] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-21T18:28:48.872600] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T18:28:48.951023] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-21T18:28:49.258926] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T18:28:49.431939] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T18:28:49.751028] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-21T18:28:50.258259] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-21T18:28:50.551029] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-21T18:28:51.351039] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-21T18:28:52.071497] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-21T18:28:52.151555] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-21T18:28:52.154350] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T18:28:52.632067] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-21T18:28:52.951088] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-21T18:28:53.539742] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-21T18:28:53.541422] [INFO ] [REMOTE ] EEX: Full fetch complete (18426 records). [2025-10-21T18:28:53.541491] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-21T18:28:53.756198] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-21T18:28:53.907199] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-21T18:28:53.907276] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-21T18:28:53.907718] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-21T18:28:53.907781] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-21T18:28:53.908351] [DEBUG] [LOCAL ] EEX: Trimmed 18426 records to 9972 (keeping 200 days of data) [2025-10-21T18:28:53.965679] [DEBUG] [LOCAL ] EEX: Primary data saved (9972 records). [2025-10-21T18:28:53.965821] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-21T18:28:53.965900] [INFO ] [MAIN ] Update Progress: 698/2366 symbols completed. EEX took 21.8s. Estimated remaining: 3h 32m 17s. Rate: 7.9 symbols/min [2025-10-21T18:28:54.137273] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:28:54.137479] [DEBUG] [LOCAL ] EFR: No existing data file found in primary storage. [2025-10-21T18:28:54.137542] [WARN ] [MAIN ] EFR: No existing data found, performing full refresh instead. [2025-10-21T18:28:54.137684] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-21T18:28:54.137738] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-21T18:28:54.137780] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-10-21T18:28:54.137812] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-21T18:28:54.407675] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-21T18:28:54.419349] [INFO ] [REMOTE ] EEA: Full fetch complete (3747 records). [2025-10-21T18:28:54.424969] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-21T18:28:54.558276] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-21T18:28:54.606836] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:28:54.689599] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T18:28:54.689855] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:28:54.689926] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:28:54.689977] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-21T18:28:54.690050] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-21T18:28:54.690130] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-21T18:28:54.690192] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-21T18:28:54.690254] [INFO ] [MAIN ] Update Progress: 699/2366 symbols completed. EEA took 25.9s. Estimated remaining: 3h 31m 53s. Rate: 7.9 symbols/min [2025-10-21T18:28:54.859979] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:28:54.873554] [DEBUG] [LOCAL ] EFT: Loaded 12980 existing records from primary storage. [2025-10-21T18:28:54.873799] [INFO ] [MAIN ] EFT: Loaded 12980 existing records. [2025-10-21T18:28:55.060481] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:28:55.060726] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-21T18:28:55.060801] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-21T18:28:55.061133] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-21T18:28:55.061190] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-21T18:28:55.353728] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-21T18:28:55.435074] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:28:56.129742] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T18:28:56.150988] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-21T18:28:56.951057] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-21T18:28:57.062950] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T18:28:57.503449] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T18:28:57.751047] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-21T18:28:57.849868] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T18:28:58.551029] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-21T18:28:58.598969] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-21T18:28:59.351037] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-21T18:29:00.066541] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T18:29:00.151064] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-21T18:29:00.324734] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T18:29:00.951049] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-21T18:29:01.716104] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T18:29:01.750984] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-21T18:29:01.998941] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T18:29:02.551059] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-21T18:29:03.085033] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T18:29:03.351052] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-21T18:29:03.365798] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T18:29:04.151063] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-21T18:29:04.950998] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-21T18:29:05.162342] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T18:29:05.183243] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T18:29:05.751018] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-21T18:29:06.377552] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T18:29:06.551082] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-21T18:29:07.352905] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-21T18:29:07.354113] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-21T18:29:07.588622] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-21T18:29:08.151041] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-21T18:29:08.270147] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T18:29:08.951009] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-21T18:29:09.184817] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T18:29:09.751010] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-21T18:29:10.551056] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-21T18:29:10.618346] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-21T18:29:11.098508] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T18:29:11.103552] [INFO ] [REMOTE ] EE: Full fetch complete (44050 records). [2025-10-21T18:29:11.103634] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-21T18:29:11.104217] [FATAL] [VALIDATOR ] EE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:29:11.104297] [FATAL] [MAIN ] EE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:29:11.104339] [WARN ] [MAIN ] EE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:29:11.104406] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-21T18:29:11.104466] [DEBUG] [LOCAL ] EE: No primary data file found to delete. [2025-10-21T18:29:11.104501] [INFO ] [LOCAL ] EE: Starting deletion of derivative data. [2025-10-21T18:29:11.104697] [DEBUG] [LOCAL ] EE: Deleted derivative data file. [2025-10-21T18:29:11.105059] [INFO ] [MAIN ] Update Progress: 700/2366 symbols completed. EE took 43.6s. Estimated remaining: 3h 32m 6s. Rate: 7.9 symbols/min [2025-10-21T18:29:11.271581] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:29:11.312420] [DEBUG] [LOCAL ] EFX: Loaded 44781 existing records from primary storage. [2025-10-21T18:29:11.312768] [INFO ] [MAIN ] EFX: Loaded 44781 existing records. [2025-10-21T18:29:11.374975] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-21T18:29:11.502053] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:29:11.502908] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-21T18:29:11.506544] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-21T18:29:11.506605] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-21T18:29:11.507375] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-21T18:29:11.507432] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-21T18:29:11.884221] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:29:12.151069] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-21T18:29:12.951123] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-21T18:29:13.055275] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-21T18:29:13.364716] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T18:29:13.372872] [INFO ] [REMOTE ] EFC: Full fetch complete (66643 records). [2025-10-21T18:29:13.372987] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-21T18:29:13.685191] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T18:29:13.760822] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-21T18:29:13.781848] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-21T18:29:13.782713] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-21T18:29:13.783542] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-21T18:29:13.783694] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-21T18:29:13.784968] [DEBUG] [LOCAL ] EFC: Trimmed 66643 records to 46334 (keeping 200 days of data) [2025-10-21T18:29:14.072596] [DEBUG] [LOCAL ] EFC: Primary data saved (46334 records). [2025-10-21T18:29:14.072746] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-21T18:29:14.072829] [INFO ] [MAIN ] Update Progress: 701/2366 symbols completed. EFC took 38.1s. Estimated remaining: 3h 31m 47s. Rate: 7.9 symbols/min [2025-10-21T18:29:14.242135] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:29:14.270229] [DEBUG] [LOCAL ] EFXT: Loaded 29637 existing records from primary storage. [2025-10-21T18:29:14.270488] [INFO ] [MAIN ] EFXT: Loaded 29637 existing records. [2025-10-21T18:29:14.447189] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:29:14.447378] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-21T18:29:14.447422] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-21T18:29:14.447971] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-21T18:29:14.448029] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-21T18:29:14.556228] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-21T18:29:14.821002] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:29:15.351092] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-21T18:29:15.391379] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T18:29:15.470628] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T18:29:16.151053] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-21T18:29:16.406285] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-21T18:29:16.951003] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-21T18:29:16.991603] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-21T18:29:17.690546] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T18:29:17.751020] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-21T18:29:18.508758] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T18:29:18.550983] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-21T18:29:19.350998] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-21T18:29:19.634680] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-21T18:29:20.151055] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-21T18:29:20.888508] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T18:29:20.951033] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-21T18:29:21.751053] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-21T18:29:21.877739] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T18:29:22.179861] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T18:29:22.182936] [INFO ] [REMOTE ] EFR: Full fetch complete (19590 records). [2025-10-21T18:29:22.183007] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-21T18:29:22.554086] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-21T18:29:22.554278] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-21T18:29:22.554352] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-21T18:29:22.555939] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-21T18:29:22.556013] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-21T18:29:22.556999] [DEBUG] [LOCAL ] EFR: Trimmed 19590 records to 15065 (keeping 200 days of data) [2025-10-21T18:29:22.651934] [DEBUG] [LOCAL ] EFR: Primary data saved (15065 records). [2025-10-21T18:29:22.652052] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-21T18:29:22.652119] [INFO ] [MAIN ] Update Progress: 702/2366 symbols completed. EFR took 28.7s. Estimated remaining: 3h 31m 42s. Rate: 7.9 symbols/min [2025-10-21T18:29:22.760205] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-21T18:29:22.776307] [INFO ] [REMOTE ] EFT: Full fetch complete (17720 records). [2025-10-21T18:29:22.786629] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-21T18:29:22.925210] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:29:23.157329] [DEBUG] [LOCAL ] EG: Loaded 27781 existing records from primary storage. [2025-10-21T18:29:23.186935] [INFO ] [MAIN ] EG: Loaded 27781 existing records. [2025-10-21T18:29:23.286376] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-21T18:29:23.292134] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-21T18:29:23.297692] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-21T18:29:23.308880] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-21T18:29:23.320102] [DEBUG] [LOCAL ] EFT: Trimmed 17720 records to 13016 (keeping 200 days of data) [2025-10-21T18:29:23.358990] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-21T18:29:23.440264] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:29:23.440781] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-21T18:29:23.472951] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-21T18:29:23.477517] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-21T18:29:23.478525] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-21T18:29:23.544510] [DEBUG] [LOCAL ] EFT: Primary data saved (13016 records). [2025-10-21T18:29:23.556171] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-21T18:29:23.561390] [INFO ] [MAIN ] Update Progress: 703/2366 symbols completed. EFT took 28.9s. Estimated remaining: 3h 31m 18s. Rate: 7.9 symbols/min [2025-10-21T18:29:23.942382] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:29:23.974122] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T18:29:24.056241] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:29:24.097178] [DEBUG] [LOCAL ] EGO: Loaded 51745 existing records from primary storage. [2025-10-21T18:29:24.097506] [INFO ] [MAIN ] EGO: Loaded 51745 existing records. [2025-10-21T18:29:24.158853] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-21T18:29:24.290999] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:29:24.291207] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-21T18:29:24.291255] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-21T18:29:24.292119] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-21T18:29:24.292176] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-21T18:29:24.663935] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:29:24.951019] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-21T18:29:25.074545] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T18:29:25.751024] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-21T18:29:25.785832] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T18:29:26.551076] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-21T18:29:26.793575] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T18:29:27.037774] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T18:29:27.351037] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-21T18:29:27.786590] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-21T18:29:28.151037] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-21T18:29:28.951093] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-21T18:29:29.015333] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T18:29:29.131214] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T18:29:29.751059] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-21T18:29:30.038193] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-21T18:29:30.551027] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-21T18:29:31.135022] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-21T18:29:31.351019] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-21T18:29:32.150986] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-21T18:29:32.246392] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T18:29:32.788389] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T18:29:32.951044] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-21T18:29:33.750999] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-21T18:29:33.975862] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T18:29:34.371846] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T18:29:34.551021] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-21T18:29:35.351000] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-21T18:29:35.520815] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T18:29:36.102168] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T18:29:36.158636] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-21T18:29:36.162552] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T18:29:36.951101] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-21T18:29:37.203366] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T18:29:37.751075] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-21T18:29:38.550996] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-21T18:29:38.785738] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T18:29:38.812491] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-21T18:29:39.351067] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-21T18:29:40.151010] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-21T18:29:40.367514] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-21T18:29:40.478253] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T18:29:40.951028] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-21T18:29:41.441074] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T18:29:41.751024] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-21T18:29:42.126102] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-21T18:29:42.551073] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-21T18:29:43.351074] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-21T18:29:43.428567] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T18:29:44.151020] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-21T18:29:44.401760] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-21T18:29:44.542410] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-21T18:29:44.951031] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-21T18:29:45.481690] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T18:29:45.485548] [INFO ] [REMOTE ] EG: Full fetch complete (42990 records). [2025-10-21T18:29:45.485626] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-21T18:29:45.756213] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-21T18:29:45.870109] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-21T18:29:45.870237] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-21T18:29:45.870967] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-21T18:29:45.871029] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-21T18:29:45.872006] [DEBUG] [LOCAL ] EG: Trimmed 42990 records to 27710 (keeping 200 days of data) [2025-10-21T18:29:46.062987] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T18:29:46.076925] [DEBUG] [LOCAL ] EG: Primary data saved (27710 records). [2025-10-21T18:29:46.077028] [INFO ] [MAIN ] EG: Full history saved. [2025-10-21T18:29:46.077096] [INFO ] [MAIN ] Update Progress: 704/2366 symbols completed. EG took 23.4s. Estimated remaining: 3h 31m 46s. Rate: 7.8 symbols/min [2025-10-21T18:29:46.243358] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:29:46.243518] [DEBUG] [LOCAL ] EGP: No existing data file found in primary storage. [2025-10-21T18:29:46.243554] [WARN ] [MAIN ] EGP: No existing data found, performing full refresh instead. [2025-10-21T18:29:46.243685] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-21T18:29:46.243738] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-21T18:29:46.243780] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-10-21T18:29:46.243811] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-21T18:29:46.556209] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-21T18:29:46.632387] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:29:47.351007] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-21T18:29:47.650560] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-21T18:29:47.912101] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-21T18:29:47.918013] [INFO ] [REMOTE ] EFXT: Full fetch complete (44028 records). [2025-10-21T18:29:47.918251] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-21T18:29:47.919103] [FATAL] [VALIDATOR ] EFXT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:29:47.919200] [FATAL] [MAIN ] EFXT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:29:47.919243] [WARN ] [MAIN ] EFXT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:29:47.919286] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-21T18:29:47.919355] [DEBUG] [LOCAL ] EFXT: No primary data file found to delete. [2025-10-21T18:29:47.919392] [INFO ] [LOCAL ] EFXT: Starting deletion of derivative data. [2025-10-21T18:29:47.919560] [DEBUG] [LOCAL ] EFXT: Deleted derivative data file. [2025-10-21T18:29:47.919668] [INFO ] [MAIN ] Update Progress: 705/2366 symbols completed. EFXT took 33.8s. Estimated remaining: 3h 31m 25s. Rate: 7.9 symbols/min [2025-10-21T18:29:48.114974] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:29:48.158972] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-21T18:29:48.162745] [DEBUG] [LOCAL ] EGY: Loaded 41464 existing records from primary storage. [2025-10-21T18:29:48.163274] [INFO ] [MAIN ] EGY: Loaded 41464 existing records. [2025-10-21T18:29:48.354557] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:29:48.354851] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-21T18:29:48.354902] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-21T18:29:48.355463] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-21T18:29:48.355520] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-21T18:29:48.762505] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:29:48.826690] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T18:29:48.951062] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-21T18:29:49.751003] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-21T18:29:49.901858] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T18:29:50.551047] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-21T18:29:50.591871] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T18:29:51.164507] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T18:29:51.351089] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-21T18:29:52.151024] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-21T18:29:52.245598] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T18:29:52.951051] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-21T18:29:53.027911] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T18:29:53.289569] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-21T18:29:53.751040] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-21T18:29:54.464241] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T18:29:54.550991] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-21T18:29:55.351053] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-21T18:29:55.611307] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T18:29:55.801942] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T18:29:56.151101] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-21T18:29:56.951071] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-21T18:29:57.101610] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T18:29:57.108968] [INFO ] [REMOTE ] EFX: Full fetch complete (65040 records). [2025-10-21T18:29:57.109089] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-21T18:29:57.497128] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-21T18:29:57.497268] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-21T18:29:57.498121] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-21T18:29:57.498189] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-21T18:29:57.499479] [DEBUG] [LOCAL ] EFX: Trimmed 65040 records to 44767 (keeping 200 days of data) [2025-10-21T18:29:57.764377] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-21T18:29:57.768364] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T18:29:57.811683] [DEBUG] [LOCAL ] EFX: Primary data saved (44767 records). [2025-10-21T18:29:57.812179] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-21T18:29:57.812900] [INFO ] [MAIN ] Update Progress: 706/2366 symbols completed. EFX took 46.7s. Estimated remaining: 3h 31m 22s. Rate: 7.9 symbols/min [2025-10-21T18:29:57.984302] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:29:57.984532] [DEBUG] [LOCAL ] EHAB: No existing data file found in primary storage. [2025-10-21T18:29:57.984625] [WARN ] [MAIN ] EHAB: No existing data found, performing full refresh instead. [2025-10-21T18:29:57.985010] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-21T18:29:57.985072] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-21T18:29:57.985203] [DEBUG] [LOCAL ] EHAB: No primary data file found to delete. [2025-10-21T18:29:57.985308] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-21T18:29:58.344499] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-21T18:29:58.375183] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:29:58.551008] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-21T18:29:59.351033] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-21T18:29:59.517594] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T18:29:59.598186] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T18:29:59.607277] [INFO ] [REMOTE ] EGO: Full fetch complete (74505 records). [2025-10-21T18:29:59.607429] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-21T18:30:00.013660] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-21T18:30:00.013775] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-21T18:30:00.014742] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-21T18:30:00.014807] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-21T18:30:00.016271] [DEBUG] [LOCAL ] EGO: Trimmed 74505 records to 51738 (keeping 200 days of data) [2025-10-21T18:30:00.180959] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-21T18:30:00.320263] [DEBUG] [LOCAL ] EGO: Primary data saved (51738 records). [2025-10-21T18:30:00.320408] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-21T18:30:00.320487] [INFO ] [MAIN ] Update Progress: 707/2366 symbols completed. EGO took 36.8s. Estimated remaining: 3h 31m 3s. Rate: 7.9 symbols/min [2025-10-21T18:30:00.491791] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:30:00.535171] [DEBUG] [LOCAL ] EHC: Loaded 41026 existing records from primary storage. [2025-10-21T18:30:00.535471] [INFO ] [MAIN ] EHC: Loaded 41026 existing records. [2025-10-21T18:30:00.719824] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:30:00.720044] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-21T18:30:00.720092] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-21T18:30:00.720915] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-21T18:30:00.720973] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-21T18:30:00.971476] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-21T18:30:01.096122] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:30:01.309520] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-21T18:30:01.698378] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T18:30:01.751023] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-21T18:30:02.551078] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-21T18:30:03.050895] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-21T18:30:03.351014] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-21T18:30:03.519253] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T18:30:04.150996] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-21T18:30:04.324829] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T18:30:04.635061] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-21T18:30:04.951071] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-21T18:30:05.751048] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-21T18:30:05.989901] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-21T18:30:06.066505] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T18:30:06.551058] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-21T18:30:07.333557] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T18:30:07.351012] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-21T18:30:08.156124] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-21T18:30:08.174101] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T18:30:08.756890] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T18:30:08.951139] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-21T18:30:09.436274] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-21T18:30:09.751025] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-21T18:30:10.184901] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-21T18:30:10.551036] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-21T18:30:11.351033] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-21T18:30:11.536427] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T18:30:12.139227] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T18:30:12.150987] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-21T18:30:12.854560] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T18:30:12.951039] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-21T18:30:13.385928] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T18:30:13.751027] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-21T18:30:14.347764] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T18:30:14.352700] [INFO ] [REMOTE ] EGP: Full fetch complete (45501 records). [2025-10-21T18:30:14.352846] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-21T18:30:14.556613] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-21T18:30:14.735369] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-21T18:30:14.735451] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-21T18:30:14.736106] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-21T18:30:14.736170] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-21T18:30:14.737167] [DEBUG] [LOCAL ] EGP: Trimmed 45501 records to 30323 (keeping 200 days of data) [2025-10-21T18:30:14.937175] [DEBUG] [LOCAL ] EGP: Primary data saved (30323 records). [2025-10-21T18:30:14.937371] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-21T18:30:14.937597] [INFO ] [MAIN ] Update Progress: 708/2366 symbols completed. EGP took 28.9s. Estimated remaining: 3h 31m 11s. Rate: 7.9 symbols/min [2025-10-21T18:30:15.112902] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:30:15.148951] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T18:30:15.166603] [DEBUG] [LOCAL ] EHI: Loaded 10543 existing records from primary storage. [2025-10-21T18:30:15.166889] [INFO ] [MAIN ] EHI: Loaded 10543 existing records. [2025-10-21T18:30:15.341056] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:30:15.341273] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-21T18:30:15.341321] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-21T18:30:15.341531] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-21T18:30:15.341588] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-21T18:30:15.356172] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-21T18:30:15.695664] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:30:15.938970] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T18:30:16.151078] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-21T18:30:16.913743] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-21T18:30:16.951064] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-21T18:30:17.751021] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-21T18:30:17.829983] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T18:30:17.920794] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-21T18:30:17.927194] [INFO ] [REMOTE ] EGY: Full fetch complete (60834 records). [2025-10-21T18:30:17.927343] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-21T18:30:18.305692] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-21T18:30:18.305786] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-21T18:30:18.306539] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-21T18:30:18.306578] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-21T18:30:18.309040] [DEBUG] [LOCAL ] EGY: Trimmed 60834 records to 41354 (keeping 200 days of data) [2025-10-21T18:30:18.543159] [DEBUG] [LOCAL ] EGY: Primary data saved (41354 records). [2025-10-21T18:30:18.543280] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-21T18:30:18.543354] [INFO ] [MAIN ] Update Progress: 709/2366 symbols completed. EGY took 30.6s. Estimated remaining: 3h 30m 54s. Rate: 7.9 symbols/min [2025-10-21T18:30:18.556258] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-21T18:30:18.717308] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:30:18.739339] [DEBUG] [LOCAL ] EIC: Loaded 22699 existing records from primary storage. [2025-10-21T18:30:18.739584] [INFO ] [MAIN ] EIC: Loaded 22699 existing records. [2025-10-21T18:30:18.916046] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:30:18.916282] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-21T18:30:18.916329] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-21T18:30:18.916542] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-21T18:30:18.916608] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-21T18:30:19.267873] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:30:19.351000] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-21T18:30:19.410048] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-21T18:30:19.747425] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-21T18:30:20.150995] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-21T18:30:20.525316] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T18:30:20.951059] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-21T18:30:21.458088] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-21T18:30:21.650139] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-21T18:30:21.751013] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-21T18:30:22.551039] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-21T18:30:23.266283] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T18:30:23.352071] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-21T18:30:23.353568] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-21T18:30:24.151102] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-21T18:30:24.497477] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-21T18:30:24.924015] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-21T18:30:24.951018] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-21T18:30:25.756451] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-21T18:30:25.757721] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-21T18:30:26.551049] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-21T18:30:26.849713] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-21T18:30:27.351081] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-21T18:30:27.860294] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-21T18:30:28.151063] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-21T18:30:28.273144] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-21T18:30:28.951025] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-21T18:30:29.745845] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T18:30:29.755186] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-21T18:30:30.114079] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T18:30:30.551054] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-21T18:30:30.636897] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T18:30:31.351105] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-21T18:30:31.871286] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T18:30:32.151098] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-21T18:30:32.736822] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T18:30:32.951123] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-21T18:30:33.080558] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T18:30:33.083783] [INFO ] [REMOTE ] EHI: Full fetch complete (15812 records). [2025-10-21T18:30:33.083905] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-21T18:30:33.443752] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-21T18:30:33.443825] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-21T18:30:33.444140] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-21T18:30:33.444177] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-21T18:30:33.444637] [DEBUG] [LOCAL ] EHI: Trimmed 15812 records to 10531 (keeping 200 days of data) [2025-10-21T18:30:33.501972] [DEBUG] [LOCAL ] EHI: Primary data saved (10531 records). [2025-10-21T18:30:33.502081] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-21T18:30:33.502156] [INFO ] [MAIN ] Update Progress: 710/2366 symbols completed. EHI took 18.6s. Estimated remaining: 3h 31m 4s. Rate: 7.8 symbols/min [2025-10-21T18:30:33.672823] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:30:33.673042] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-21T18:30:33.673091] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-21T18:30:33.673197] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-21T18:30:33.673260] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-21T18:30:33.673335] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-21T18:30:33.673390] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-21T18:30:33.756205] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-21T18:30:34.029774] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:30:34.346333] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T18:30:34.551081] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-21T18:30:35.058411] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T18:30:35.099337] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-21T18:30:35.351018] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-21T18:30:36.151059] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-21T18:30:36.475053] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-21T18:30:36.656737] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T18:30:36.665693] [INFO ] [REMOTE ] EHC: Full fetch complete (58766 records). [2025-10-21T18:30:36.665882] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-21T18:30:36.957749] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-21T18:30:37.055769] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-21T18:30:37.055861] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-21T18:30:37.056834] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-21T18:30:37.056901] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-21T18:30:37.058242] [DEBUG] [LOCAL ] EHC: Trimmed 58766 records to 40976 (keeping 200 days of data) [2025-10-21T18:30:37.250565] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-21T18:30:37.321377] [DEBUG] [LOCAL ] EHC: Primary data saved (40976 records). [2025-10-21T18:30:37.321510] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-21T18:30:37.322160] [INFO ] [MAIN ] Update Progress: 711/2366 symbols completed. EHC took 37.0s. Estimated remaining: 3h 30m 47s. Rate: 7.9 symbols/min [2025-10-21T18:30:37.528571] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:30:37.528907] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-21T18:30:37.528953] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-21T18:30:37.529086] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-21T18:30:37.529130] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-21T18:30:37.529169] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-21T18:30:37.529200] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-21T18:30:37.756217] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-21T18:30:37.903754] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:30:38.551044] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-21T18:30:39.031633] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T18:30:39.035851] [INFO ] [REMOTE ] EHAB: Full fetch complete (41047 records). [2025-10-21T18:30:39.035949] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-21T18:30:39.129147] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-21T18:30:39.356169] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-21T18:30:39.418529] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-21T18:30:39.418613] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-21T18:30:39.419248] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-21T18:30:39.419303] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-21T18:30:39.420264] [DEBUG] [LOCAL ] EHAB: Trimmed 41047 records to 29287 (keeping 200 days of data) [2025-10-21T18:30:39.581579] [DEBUG] [LOCAL ] EHAB: Primary data saved (29287 records). [2025-10-21T18:30:39.581758] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-21T18:30:39.581839] [INFO ] [MAIN ] Update Progress: 712/2366 symbols completed. EHAB took 41.8s. Estimated remaining: 3h 30m 27s. Rate: 7.9 symbols/min [2025-10-21T18:30:39.750061] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:30:39.750241] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-21T18:30:39.750277] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-21T18:30:39.750384] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-21T18:30:39.750425] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-21T18:30:39.750465] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-21T18:30:39.750513] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-21T18:30:40.105594] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:30:40.150991] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-21T18:30:40.606427] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T18:30:40.737036] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-21T18:30:40.951014] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-21T18:30:41.522331] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T18:30:41.751011] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-21T18:30:42.380947] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-21T18:30:42.551058] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-21T18:30:42.977785] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-21T18:30:43.351035] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-21T18:30:44.151093] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-21T18:30:44.489519] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-21T18:30:44.706037] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T18:30:44.951052] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-21T18:30:45.382578] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-21T18:30:45.751057] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-21T18:30:46.450271] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-21T18:30:46.551056] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-21T18:30:47.351006] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-21T18:30:47.687375] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T18:30:47.806881] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-21T18:30:48.151017] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-21T18:30:48.591878] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-21T18:30:48.951074] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-21T18:30:49.300153] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-21T18:30:49.751023] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-21T18:30:50.285863] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-21T18:30:50.551035] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-21T18:30:51.281524] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T18:30:51.350988] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-21T18:30:52.151010] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-21T18:30:52.539576] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-21T18:30:52.677952] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T18:30:52.951048] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-21T18:30:53.288539] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-21T18:30:53.751009] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-21T18:30:54.101612] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-21T18:30:54.551097] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-21T18:30:55.351047] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-21T18:30:55.773913] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T18:30:55.777291] [INFO ] [REMOTE ] EIC: Full fetch complete (34278 records). [2025-10-21T18:30:55.777367] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-21T18:30:56.039819] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-21T18:30:56.154590] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-21T18:30:56.154854] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-21T18:30:56.154940] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-21T18:30:56.156277] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-21T18:30:56.156359] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-21T18:30:56.157250] [DEBUG] [LOCAL ] EIC: Trimmed 34278 records to 22643 (keeping 200 days of data) [2025-10-21T18:30:56.290377] [DEBUG] [LOCAL ] EIC: Primary data saved (22643 records). [2025-10-21T18:30:56.290491] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-21T18:30:56.290583] [INFO ] [MAIN ] Update Progress: 713/2366 symbols completed. EIC took 37.7s. Estimated remaining: 3h 30m 40s. Rate: 7.8 symbols/min [2025-10-21T18:30:56.455310] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:30:56.455469] [DEBUG] [LOCAL ] EIG: No existing data file found in primary storage. [2025-10-21T18:30:56.455504] [WARN ] [MAIN ] EIG: No existing data found, performing full refresh instead. [2025-10-21T18:30:56.455607] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-21T18:30:56.455671] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-21T18:30:56.455735] [DEBUG] [LOCAL ] EIG: No primary data file found to delete. [2025-10-21T18:30:56.455768] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-21T18:30:56.788980] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-21T18:30:56.820145] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:30:56.951014] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-21T18:30:57.751065] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-21T18:30:58.092372] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T18:30:58.414580] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-21T18:30:58.551023] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-21T18:30:59.270126] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-21T18:30:59.351042] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-21T18:30:59.974964] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-21T18:30:59.976479] [INFO ] [REMOTE ] EICC: Full fetch complete (8452 records). [2025-10-21T18:30:59.976546] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-21T18:30:59.976932] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:30:59.977015] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:30:59.977056] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:30:59.977095] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-21T18:30:59.977148] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-21T18:30:59.977183] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-21T18:30:59.977267] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-21T18:30:59.977326] [INFO ] [MAIN ] Update Progress: 714/2366 symbols completed. EICC took 20.4s. Estimated remaining: 3h 30m 24s. Rate: 7.9 symbols/min [2025-10-21T18:31:00.152875] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:31:00.151131] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-21T18:31:00.153788] [DEBUG] [LOCAL ] EIX: No existing data file found in primary storage. [2025-10-21T18:31:00.153838] [WARN ] [MAIN ] EIX: No existing data found, performing full refresh instead. [2025-10-21T18:31:00.153942] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-21T18:31:00.153983] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-21T18:31:00.154022] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-10-21T18:31:00.154054] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-21T18:31:00.511430] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:31:00.951041] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-21T18:31:01.055613] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-21T18:31:01.751071] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-21T18:31:02.551083] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-21T18:31:02.828113] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-21T18:31:03.195664] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-21T18:31:03.196376] [INFO ] [REMOTE ] EICA: Full fetch complete (1251 records). [2025-10-21T18:31:03.196441] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-21T18:31:03.196796] [FATAL] [VALIDATOR ] EICA: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:31:03.196877] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:31:03.196919] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:31:03.196955] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-21T18:31:03.197005] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-21T18:31:03.197039] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-21T18:31:03.197077] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-21T18:31:03.197125] [INFO ] [MAIN ] Update Progress: 715/2366 symbols completed. EICA took 29.7s. Estimated remaining: 3h 30m 6s. Rate: 7.9 symbols/min [2025-10-21T18:31:03.377145] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:31:03.358259] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-21T18:31:03.427815] [DEBUG] [LOCAL ] EL: Loaded 53387 existing records from primary storage. [2025-10-21T18:31:03.428177] [INFO ] [MAIN ] EL: Loaded 53387 existing records. [2025-10-21T18:31:03.612493] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:31:03.612735] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-21T18:31:03.612796] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-21T18:31:03.623320] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-21T18:31:03.638133] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-21T18:31:03.719658] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (2.77 seconds). [2025-10-21T18:31:03.910334] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-21T18:31:04.018188] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:31:04.151040] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-21T18:31:04.727945] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-21T18:31:04.951114] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-21T18:31:05.751055] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-21T18:31:06.211722] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-21T18:31:06.551054] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-21T18:31:06.966567] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-21T18:31:07.139162] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-21T18:31:07.140107] [INFO ] [REMOTE ] EICB: Full fetch complete (2697 records). [2025-10-21T18:31:07.140174] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-21T18:31:07.319953] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-21T18:31:07.320137] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:31:07.320225] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:31:07.320297] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-21T18:31:07.320359] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-21T18:31:07.320395] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-21T18:31:07.320434] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-21T18:31:07.320487] [INFO ] [MAIN ] Update Progress: 716/2366 symbols completed. EICB took 30.0s. Estimated remaining: 3h 29m 50s. Rate: 7.9 symbols/min [2025-10-21T18:31:07.356176] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-21T18:31:07.496303] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:31:07.547156] [DEBUG] [LOCAL ] ELAN: Loaded 53315 existing records from primary storage. [2025-10-21T18:31:07.547477] [INFO ] [MAIN ] ELAN: Loaded 53315 existing records. [2025-10-21T18:31:07.728990] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:31:07.729199] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-21T18:31:07.729281] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-21T18:31:07.730323] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-21T18:31:07.730388] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-21T18:31:08.088809] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:31:08.151006] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-21T18:31:08.951042] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-21T18:31:09.534271] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-21T18:31:09.751029] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-21T18:31:09.853784] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T18:31:10.173063] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-21T18:31:10.551094] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-21T18:31:11.351051] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-21T18:31:11.455368] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T18:31:11.860302] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T18:31:12.151060] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-21T18:31:12.753749] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T18:31:12.951054] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-21T18:31:13.750997] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-21T18:31:14.159032] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-21T18:31:14.189085] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T18:31:14.551060] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-21T18:31:15.351071] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-21T18:31:15.616067] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-21T18:31:15.869968] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-21T18:31:16.151036] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-21T18:31:16.951070] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-21T18:31:17.300930] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T18:31:17.751013] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-21T18:31:18.059167] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T18:31:18.092747] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T18:31:18.551075] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-21T18:31:19.282253] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T18:31:19.351101] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-21T18:31:20.151082] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-21T18:31:20.695614] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T18:31:20.849173] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-21T18:31:20.951001] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-21T18:31:21.714037] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T18:31:21.750985] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-21T18:31:22.551084] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-21T18:31:23.136940] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-21T18:31:23.277133] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-21T18:31:23.350993] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-21T18:31:23.438258] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T18:31:24.151024] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-21T18:31:24.951003] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-21T18:31:25.228797] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-21T18:31:25.751167] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-21T18:31:25.953987] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T18:31:25.973608] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T18:31:25.976874] [INFO ] [REMOTE ] EIG: Full fetch complete (27275 records). [2025-10-21T18:31:25.976967] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-21T18:31:26.369366] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-21T18:31:26.369448] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-21T18:31:26.370035] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-21T18:31:26.370098] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-21T18:31:26.370876] [DEBUG] [LOCAL ] EIG: Trimmed 27275 records to 20185 (keeping 200 days of data) [2025-10-21T18:31:26.491662] [DEBUG] [LOCAL ] EIG: Primary data saved (20185 records). [2025-10-21T18:31:26.491785] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-21T18:31:26.491850] [INFO ] [MAIN ] Update Progress: 717/2366 symbols completed. EIG took 30.2s. Estimated remaining: 3h 30m 9s. Rate: 7.8 symbols/min [2025-10-21T18:31:26.550982] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-21T18:31:27.351079] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-21T18:31:27.929329] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-21T18:31:28.150992] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-21T18:31:28.186905] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T18:31:28.951056] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-21T18:31:29.371990] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-21T18:31:29.751072] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-21T18:31:30.829416] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T18:31:30.840686] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-21T18:31:31.143627] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.99 seconds). [2025-10-21T18:31:31.351072] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-21T18:31:31.604129] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T18:31:32.151023] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-21T18:31:33.173030] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-21T18:31:33.184839] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-21T18:31:33.875773] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-21T18:31:33.888586] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-21T18:31:34.236888] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-21T18:31:34.247208] [INFO ] [REMOTE ] ELAN: Full fetch complete (77096 records). [2025-10-21T18:31:34.247484] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-21T18:31:34.699105] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-21T18:31:34.699321] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-21T18:31:34.700896] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-21T18:31:34.701096] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-21T18:31:34.703366] [DEBUG] [LOCAL ] ELAN: Trimmed 77096 records to 53313 (keeping 200 days of data) [2025-10-21T18:31:34.866132] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T18:31:34.939133] [INFO ] [REMOTE ] EL: Full fetch complete (77051 records). [2025-10-21T18:31:34.967288] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-21T18:31:35.017607] [FATAL] [VALIDATOR ] EL: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:31:35.058604] [FATAL] [MAIN ] EL: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:31:35.077530] [WARN ] [MAIN ] EL: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:31:35.079949] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-21T18:31:35.091756] [DEBUG] [LOCAL ] EL: No primary data file found to delete. [2025-10-21T18:31:35.094537] [INFO ] [LOCAL ] EL: Starting deletion of derivative data. [2025-10-21T18:31:35.096252] [DEBUG] [LOCAL ] EL: Deleted derivative data file. [2025-10-21T18:31:35.096889] [INFO ] [MAIN ] Update Progress: 718/2366 symbols completed. EL took 31.9s. Estimated remaining: 3h 30m 3s. Rate: 7.8 symbols/min [2025-10-21T18:31:35.112892] [DEBUG] [LOCAL ] ELAN: Primary data saved (53313 records). [2025-10-21T18:31:35.113082] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-21T18:31:35.113623] [INFO ] [MAIN ] Update Progress: 719/2366 symbols completed. ELAN took 27.8s. Estimated remaining: 3h 29m 38s. Rate: 7.9 symbols/min [2025-10-21T18:31:35.149107] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-21T18:31:35.160746] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-21T18:31:36.613425] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T18:31:36.625108] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-21T18:31:37.412085] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T18:31:37.420074] [INFO ] [REMOTE ] EIX: Full fetch complete (77068 records). [2025-10-21T18:31:37.420205] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-21T18:31:37.421022] [FATAL] [VALIDATOR ] EIX: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:31:37.421131] [FATAL] [MAIN ] EIX: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:31:37.421175] [WARN ] [MAIN ] EIX: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:31:37.421240] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-21T18:31:37.421306] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-10-21T18:31:37.421342] [INFO ] [LOCAL ] EIX: Starting deletion of derivative data. [2025-10-21T18:31:37.421382] [DEBUG] [LOCAL ] EIX: No derivative data file found to delete. [2025-10-21T18:31:37.421437] [INFO ] [MAIN ] Update Progress: 720/2366 symbols completed. EIX took 37.4s. Estimated remaining: 3h 29m 18s. Rate: 7.9 symbols/min [2025-10-21T18:31:37.998303] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:31:38.008901] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:31:38.075052] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:31:38.131979] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:31:38.132176] [DEBUG] [LOCAL ] ELF: No existing data file found in primary storage. [2025-10-21T18:31:38.132354] [WARN ] [MAIN ] ELF: No existing data found, performing full refresh instead. [2025-10-21T18:31:38.132795] [DEBUG] [LOCAL ] ELP: No existing data file found in primary storage. [2025-10-21T18:31:38.132955] [WARN ] [MAIN ] ELP: No existing data found, performing full refresh instead. [2025-10-21T18:31:38.132905] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-21T18:31:38.133101] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-21T18:31:38.136769] [DEBUG] [LOCAL ] ELC: Loaded 3476 existing records from primary storage. [2025-10-21T18:31:38.134225] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-21T18:31:38.137329] [INFO ] [MAIN ] ELC: Loaded 3476 existing records. [2025-10-21T18:31:38.137454] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-21T18:31:38.137104] [DEBUG] [LOCAL ] ELF: No primary data file found to delete. [2025-10-21T18:31:38.158368] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-21T18:31:38.189553] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-10-21T18:31:38.200695] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-21T18:31:38.536098] [DEBUG] [LOCAL ] ELME: Loaded 39361 existing records from primary storage. [2025-10-21T18:31:38.590814] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:31:38.615451] [INFO ] [MAIN ] ELME: Loaded 39361 existing records. [2025-10-21T18:31:38.705679] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-21T18:31:38.706043] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-21T18:31:38.874556] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-21T18:31:38.887240] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-21T18:31:39.287797] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:31:39.334234] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:31:39.339742] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-21T18:31:39.363250] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-21T18:31:39.372829] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-21T18:31:39.408621] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:31:39.449984] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-21T18:31:39.459154] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-21T18:31:39.458848] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-21T18:31:39.880013] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:31:39.905480] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-21T18:31:40.033961] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:31:40.034279] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-21T18:31:40.587849] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-21T18:31:40.589728] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-21T18:31:40.827175] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T18:31:40.833293] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-21T18:31:41.216416] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-21T18:31:41.217780] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-21T18:31:41.460537] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-21T18:31:41.501611] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T18:31:41.756211] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-21T18:31:41.774745] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-21T18:31:41.795685] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-21T18:31:42.551083] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-21T18:31:43.351053] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-21T18:31:43.687566] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-21T18:31:43.867593] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-21T18:31:44.151070] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-21T18:31:44.323623] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T18:31:44.951126] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-21T18:31:45.331696] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T18:31:45.751064] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-21T18:31:46.551066] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-21T18:31:47.021229] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-21T18:31:47.126502] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-21T18:31:47.172620] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-21T18:31:47.351059] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-21T18:31:48.151033] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-21T18:31:48.717373] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-21T18:31:48.838795] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T18:31:48.951038] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-21T18:31:49.751045] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-21T18:31:50.313221] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-21T18:31:50.440541] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-21T18:31:50.551004] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-21T18:31:51.351078] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-21T18:31:52.037428] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-21T18:31:52.070175] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T18:31:52.151028] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-21T18:31:52.951021] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-21T18:31:53.751052] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-21T18:31:54.242780] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-21T18:31:54.354960] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T18:31:54.551054] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-21T18:31:55.066195] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T18:31:55.109005] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T18:31:55.351067] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-21T18:31:56.151059] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-21T18:31:56.720402] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-21T18:31:56.854786] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T18:31:56.951053] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-21T18:31:57.751010] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-21T18:31:58.360978] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-21T18:31:58.362460] [INFO ] [REMOTE ] ELC: Full fetch complete (4894 records). [2025-10-21T18:31:58.362546] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-21T18:31:58.363009] [FATAL] [VALIDATOR ] ELC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:31:58.363095] [FATAL] [MAIN ] ELC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:31:58.363143] [WARN ] [MAIN ] ELC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:31:58.363205] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-21T18:31:58.363279] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-10-21T18:31:58.363346] [INFO ] [LOCAL ] ELC: Starting deletion of derivative data. [2025-10-21T18:31:58.363548] [DEBUG] [LOCAL ] ELC: Deleted derivative data file. [2025-10-21T18:31:58.363637] [INFO ] [MAIN ] Update Progress: 721/2366 symbols completed. ELC took 20.9s. Estimated remaining: 3h 29m 41s. Rate: 7.8 symbols/min [2025-10-21T18:31:58.546490] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:31:58.546724] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-21T18:31:58.546794] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-21T18:31:58.546938] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-21T18:31:58.547091] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-21T18:31:58.547178] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-21T18:31:58.547231] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-21T18:31:58.558167] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-21T18:31:58.665265] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T18:31:59.008436] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:31:59.351025] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-21T18:32:00.151024] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-21T18:32:00.898800] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-21T18:32:00.951011] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-21T18:32:01.089215] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-21T18:32:01.336023] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T18:32:01.751030] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-21T18:32:02.139440] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T18:32:02.551059] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-21T18:32:03.331922] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T18:32:03.340439] [INFO ] [REMOTE ] ELME: Full fetch complete (55681 records). [2025-10-21T18:32:03.340556] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-21T18:32:03.341389] [FATAL] [VALIDATOR ] ELME: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:32:03.341492] [FATAL] [MAIN ] ELME: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:32:03.341546] [WARN ] [MAIN ] ELME: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:32:03.341588] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-21T18:32:03.341752] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-21T18:32:03.341822] [INFO ] [LOCAL ] ELME: Starting deletion of derivative data. [2025-10-21T18:32:03.341986] [DEBUG] [LOCAL ] ELME: Deleted derivative data file. [2025-10-21T18:32:03.342082] [INFO ] [MAIN ] Update Progress: 722/2366 symbols completed. ELME took 25.9s. Estimated remaining: 3h 29m 27s. Rate: 7.8 symbols/min [2025-10-21T18:32:03.356105] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-21T18:32:03.519735] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:32:03.563779] [DEBUG] [LOCAL ] ELS: Loaded 49903 existing records from primary storage. [2025-10-21T18:32:03.564112] [INFO ] [MAIN ] ELS: Loaded 49903 existing records. [2025-10-21T18:32:03.747178] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-21T18:32:03.784091] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:32:03.785039] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-21T18:32:03.785102] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-21T18:32:03.785991] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-21T18:32:03.786048] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-21T18:32:04.130401] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:32:04.150988] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-21T18:32:04.951122] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-21T18:32:05.297112] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-21T18:32:05.746518] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T18:32:05.755551] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-21T18:32:06.035630] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-10-21T18:32:06.551011] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-21T18:32:06.865622] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T18:32:07.351084] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-21T18:32:08.150997] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-21T18:32:08.459338] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T18:32:08.463001] [INFO ] [REMOTE ] ELP: Full fetch complete (36700 records). [2025-10-21T18:32:08.463088] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-21T18:32:08.463615] [FATAL] [VALIDATOR ] ELP: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:32:08.463719] [FATAL] [MAIN ] ELP: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:32:08.463783] [WARN ] [MAIN ] ELP: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:32:08.463854] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-21T18:32:08.463916] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-10-21T18:32:08.463951] [INFO ] [LOCAL ] ELP: Starting deletion of derivative data. [2025-10-21T18:32:08.463988] [DEBUG] [LOCAL ] ELP: No derivative data file found to delete. [2025-10-21T18:32:08.464041] [INFO ] [MAIN ] Update Progress: 723/2366 symbols completed. ELP took 31.0s. Estimated remaining: 3h 29m 14s. Rate: 7.9 symbols/min [2025-10-21T18:32:08.638686] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:32:08.671828] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-21T18:32:08.724218] [DEBUG] [LOCAL ] ELV: Loaded 50756 existing records from primary storage. [2025-10-21T18:32:08.724524] [INFO ] [MAIN ] ELV: Loaded 50756 existing records. [2025-10-21T18:32:08.897087] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:32:08.897300] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-21T18:32:08.897345] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-21T18:32:08.898293] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-21T18:32:08.898350] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-21T18:32:08.960718] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-21T18:32:09.252162] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:32:09.751060] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-21T18:32:09.832215] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T18:32:10.109016] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-21T18:32:10.551094] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-21T18:32:11.008819] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-21T18:32:11.017275] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-21T18:32:11.351063] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-21T18:32:12.151060] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-21T18:32:12.951030] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-21T18:32:13.055326] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T18:32:13.751048] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-21T18:32:14.028414] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T18:32:14.157902] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-21T18:32:14.551033] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-21T18:32:14.690364] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T18:32:15.351132] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-21T18:32:15.726993] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-21T18:32:16.151100] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-21T18:32:16.855314] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-21T18:32:16.868123] [INFO ] [REMOTE ] ELF: Full fetch complete (75497 records). [2025-10-21T18:32:16.868328] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-21T18:32:16.956164] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-21T18:32:17.279055] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-21T18:32:17.279136] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-21T18:32:17.280027] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-21T18:32:17.280091] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-21T18:32:17.281459] [DEBUG] [LOCAL ] ELF: Trimmed 75497 records to 51917 (keeping 200 days of data) [2025-10-21T18:32:17.380049] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-21T18:32:17.599667] [DEBUG] [LOCAL ] ELF: Primary data saved (51917 records). [2025-10-21T18:32:17.599845] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-21T18:32:17.599949] [INFO ] [MAIN ] Update Progress: 724/2366 symbols completed. ELF took 40.2s. Estimated remaining: 3h 29m 10s. Rate: 7.9 symbols/min [2025-10-21T18:32:17.751854] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-21T18:32:17.774095] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:32:17.775389] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-21T18:32:17.775464] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-21T18:32:17.799595] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-21T18:32:17.800970] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T18:32:17.801075] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-21T18:32:17.810804] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-21T18:32:17.811266] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-21T18:32:18.179755] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:32:18.551023] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-21T18:32:18.888097] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-21T18:32:19.351089] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-21T18:32:19.642946] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T18:32:20.151157] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-21T18:32:20.874306] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T18:32:20.951044] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-21T18:32:21.751045] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-21T18:32:22.202693] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-21T18:32:22.251793] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-21T18:32:22.550999] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-21T18:32:22.755251] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T18:32:23.016436] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-21T18:32:23.017192] [INFO ] [REMOTE ] ELPC: Full fetch complete (1375 records). [2025-10-21T18:32:23.017263] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-21T18:32:23.017589] [FATAL] [VALIDATOR ] ELPC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:32:23.017691] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:32:23.017759] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:32:23.017830] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-21T18:32:23.017891] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-21T18:32:23.017951] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-21T18:32:23.018014] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-21T18:32:23.018068] [INFO ] [MAIN ] Update Progress: 725/2366 symbols completed. ELPC took 24.7s. Estimated remaining: 3h 28m 57s. Rate: 7.9 symbols/min [2025-10-21T18:32:23.200085] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:32:23.219541] [DEBUG] [LOCAL ] EMD: Loaded 20926 existing records from primary storage. [2025-10-21T18:32:23.219828] [INFO ] [MAIN ] EMD: Loaded 20926 existing records. [2025-10-21T18:32:23.356164] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-21T18:32:23.414516] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:32:23.414934] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-21T18:32:23.414990] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-21T18:32:23.415433] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-21T18:32:23.415489] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-21T18:32:23.792941] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:32:24.151029] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-21T18:32:24.951064] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-10-21T18:32:25.276622] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T18:32:25.277155] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-10-21T18:32:25.277249] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:32:25.277304] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-21T18:32:25.277375] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:32:25.277460] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-21T18:32:25.277539] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-21T18:32:25.277594] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-21T18:32:25.277702] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-21T18:32:25.277787] [INFO ] [MAIN ] Update Progress: 726/2366 symbols completed. EMA took 7.7s. Estimated remaining: 3h 28m 37s. Rate: 7.9 symbols/min [2025-10-21T18:32:25.404415] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T18:32:25.481819] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:32:25.517528] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-21T18:32:25.553220] [DEBUG] [LOCAL ] EME: Loaded 30809 existing records from primary storage. [2025-10-21T18:32:25.553583] [INFO ] [MAIN ] EME: Loaded 30809 existing records. [2025-10-21T18:32:25.731945] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:32:25.732156] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-21T18:32:25.732203] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-21T18:32:25.732800] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-21T18:32:25.732857] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-21T18:32:25.761488] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-21T18:32:26.089125] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:32:26.551066] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-21T18:32:26.936732] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T18:32:27.351037] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-21T18:32:28.151114] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-21T18:32:28.352680] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T18:32:28.951032] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-21T18:32:29.253282] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-21T18:32:29.750996] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-21T18:32:29.847296] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T18:32:30.465858] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T18:32:30.551001] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-21T18:32:31.274692] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T18:32:31.325146] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-21T18:32:31.350986] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-21T18:32:32.151000] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-21T18:32:32.452421] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T18:32:32.951053] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-21T18:32:33.688876] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T18:32:33.751030] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-21T18:32:34.551022] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-21T18:32:35.162457] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-21T18:32:35.209097] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T18:32:35.350994] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-21T18:32:35.649956] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T18:32:36.151026] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-21T18:32:36.951005] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-21T18:32:37.077513] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T18:32:37.751023] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-21T18:32:38.197215] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-21T18:32:38.551011] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-21T18:32:38.738362] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T18:32:38.855386] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-21T18:32:39.351040] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-21T18:32:39.928453] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T18:32:40.151038] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-21T18:32:40.951062] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-21T18:32:41.018203] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-21T18:32:41.750994] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-21T18:32:42.001287] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T18:32:42.068185] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-21T18:32:42.551034] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-21T18:32:43.351041] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-21T18:32:43.584986] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T18:32:43.592496] [INFO ] [REMOTE ] ELS: Full fetch complete (70892 records). [2025-10-21T18:32:43.592623] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-21T18:32:43.593418] [FATAL] [VALIDATOR ] ELS: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:32:43.593506] [FATAL] [MAIN ] ELS: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:32:43.593565] [WARN ] [MAIN ] ELS: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:32:43.593683] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-21T18:32:43.593774] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-10-21T18:32:43.593827] [INFO ] [LOCAL ] ELS: Starting deletion of derivative data. [2025-10-21T18:32:43.594007] [DEBUG] [LOCAL ] ELS: Deleted derivative data file. [2025-10-21T18:32:43.594483] [INFO ] [MAIN ] Update Progress: 727/2366 symbols completed. ELS took 40.3s. Estimated remaining: 3h 28m 54s. Rate: 7.8 symbols/min [2025-10-21T18:32:43.770734] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:32:43.776751] [DEBUG] [LOCAL ] EMF: Loaded 3172 existing records from primary storage. [2025-10-21T18:32:43.776978] [INFO ] [MAIN ] EMF: Loaded 3172 existing records. [2025-10-21T18:32:43.991935] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:32:43.992160] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-21T18:32:43.992220] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-21T18:32:43.992426] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-21T18:32:43.992484] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-21T18:32:44.156918] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-21T18:32:44.384732] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:32:44.508176] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T18:32:44.540092] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T18:32:44.548628] [INFO ] [REMOTE ] ELV: Full fetch complete (72929 records). [2025-10-21T18:32:44.548846] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-21T18:32:44.549810] [FATAL] [VALIDATOR ] ELV: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:32:44.549921] [FATAL] [MAIN ] ELV: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:32:44.550001] [WARN ] [MAIN ] ELV: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:32:44.550114] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-21T18:32:44.550212] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-10-21T18:32:44.550282] [INFO ] [LOCAL ] ELV: Starting deletion of derivative data. [2025-10-21T18:32:44.550475] [DEBUG] [LOCAL ] ELV: Deleted derivative data file. [2025-10-21T18:32:44.551111] [INFO ] [MAIN ] Update Progress: 728/2366 symbols completed. ELV took 36.1s. Estimated remaining: 3h 28m 31s. Rate: 7.9 symbols/min [2025-10-21T18:32:44.729385] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:32:44.776462] [DEBUG] [LOCAL ] EMN: Loaded 50838 existing records from primary storage. [2025-10-21T18:32:44.776785] [INFO ] [MAIN ] EMN: Loaded 50838 existing records. [2025-10-21T18:32:44.950408] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:32:44.950634] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-21T18:32:44.950714] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-21T18:32:44.951034] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-21T18:32:44.952108] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-21T18:32:44.952166] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-21T18:32:45.307850] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:32:45.321638] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-21T18:32:45.751041] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-21T18:32:46.170007] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-21T18:32:46.551047] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-21T18:32:47.353630] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-21T18:32:47.356821] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T18:32:48.016078] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-21T18:32:48.039833] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-21T18:32:48.151030] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-21T18:32:48.566709] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-21T18:32:48.951121] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-21T18:32:49.751102] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-21T18:32:50.521610] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T18:32:50.526461] [INFO ] [REMOTE ] EME: Full fetch complete (47018 records). [2025-10-21T18:32:50.526598] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-21T18:32:50.557756] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-21T18:32:50.917800] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-21T18:32:50.917887] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-21T18:32:50.918639] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-21T18:32:50.918728] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-21T18:32:50.919771] [DEBUG] [LOCAL ] EME: Trimmed 47018 records to 30734 (keeping 200 days of data) [2025-10-21T18:32:51.135469] [DEBUG] [LOCAL ] EME: Primary data saved (30734 records). [2025-10-21T18:32:51.135788] [INFO ] [MAIN ] EME: Full history saved. [2025-10-21T18:32:51.135908] [INFO ] [MAIN ] Update Progress: 729/2366 symbols completed. EME took 25.9s. Estimated remaining: 3h 28m 21s. Rate: 7.9 symbols/min [2025-10-21T18:32:51.326914] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:32:51.340460] [DEBUG] [LOCAL ] EMO: Loaded 13342 existing records from primary storage. [2025-10-21T18:32:51.346680] [INFO ] [MAIN ] EMO: Loaded 13342 existing records. [2025-10-21T18:32:51.377992] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-21T18:32:51.378197] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-21T18:32:51.550017] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T18:32:51.570974] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:32:51.580423] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-21T18:32:51.580894] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-21T18:32:51.581345] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-21T18:32:51.581405] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-21T18:32:52.020495] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:32:52.151037] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-21T18:32:52.722264] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-21T18:32:52.951048] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-21T18:32:53.000596] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-21T18:32:53.751045] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-21T18:32:54.459981] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-21T18:32:54.551071] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-21T18:32:54.961549] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T18:32:55.351086] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-21T18:32:55.937836] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-21T18:32:56.067286] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-21T18:32:56.070880] [INFO ] [REMOTE ] EMD: Full fetch complete (32037 records). [2025-10-21T18:32:56.070955] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-21T18:32:56.156252] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-21T18:32:56.435709] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-21T18:32:56.435792] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-21T18:32:56.436327] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-21T18:32:56.436369] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-21T18:32:56.437124] [DEBUG] [LOCAL ] EMD: Trimmed 32037 records to 20913 (keeping 200 days of data) [2025-10-21T18:32:56.559359] [DEBUG] [LOCAL ] EMD: Primary data saved (20913 records). [2025-10-21T18:32:56.559484] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-21T18:32:56.559559] [INFO ] [MAIN ] Update Progress: 730/2366 symbols completed. EMD took 33.5s. Estimated remaining: 3h 28m 9s. Rate: 7.9 symbols/min [2025-10-21T18:32:56.728823] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:32:56.732955] [DEBUG] [LOCAL ] EMP: Loaded 2945 existing records from primary storage. [2025-10-21T18:32:56.733101] [INFO ] [MAIN ] EMP: Loaded 2945 existing records. [2025-10-21T18:32:56.915107] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:32:56.915343] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-21T18:32:56.915449] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-21T18:32:56.915681] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-21T18:32:56.915738] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-21T18:32:56.956318] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-21T18:32:57.280192] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:32:57.678776] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T18:32:57.704352] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T18:32:57.750999] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-21T18:32:58.551088] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-21T18:32:59.224035] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-21T18:32:59.340879] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T18:32:59.351003] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-21T18:33:00.151081] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-21T18:33:00.951068] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-21T18:33:01.282255] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-21T18:33:01.751095] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-21T18:33:02.095759] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-10-21T18:33:02.551066] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-21T18:33:03.209026] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-21T18:33:03.350997] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-21T18:33:03.384526] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-21T18:33:03.411878] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T18:33:04.151064] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-21T18:33:04.724312] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-21T18:33:04.950998] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-21T18:33:05.073024] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T18:33:05.607300] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-21T18:33:05.751057] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-21T18:33:06.551089] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-21T18:33:06.665903] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-21T18:33:07.195620] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-21T18:33:07.351018] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-21T18:33:07.965177] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-21T18:33:08.151071] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-21T18:33:08.801567] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-21T18:33:08.802750] [INFO ] [REMOTE ] EMF: Full fetch complete (6115 records). [2025-10-21T18:33:08.802821] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-21T18:33:08.956142] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-21T18:33:09.315987] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-21T18:33:09.316096] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-21T18:33:09.316322] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-21T18:33:09.316362] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-21T18:33:09.316987] [DEBUG] [LOCAL ] EMF: Trimmed 6115 records to 3131 (keeping 200 days of data) [2025-10-21T18:33:09.339218] [DEBUG] [LOCAL ] EMF: Primary data saved (3131 records). [2025-10-21T18:33:09.339360] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-21T18:33:09.339443] [INFO ] [MAIN ] Update Progress: 731/2366 symbols completed. EMF took 25.7s. Estimated remaining: 3h 28m 12s. Rate: 7.9 symbols/min [2025-10-21T18:33:09.572251] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:33:09.637729] [DEBUG] [LOCAL ] EMR: Loaded 53176 existing records from primary storage. [2025-10-21T18:33:09.638149] [INFO ] [MAIN ] EMR: Loaded 53176 existing records. [2025-10-21T18:33:09.754266] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-21T18:33:09.857737] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:33:09.858082] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-21T18:33:09.858146] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-21T18:33:09.859583] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-21T18:33:09.859693] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-21T18:33:10.134515] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T18:33:10.275680] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:33:10.450039] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-21T18:33:10.551034] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-21T18:33:11.351039] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-21T18:33:11.866169] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-21T18:33:12.151043] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-21T18:33:12.366344] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-21T18:33:12.674497] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-21T18:33:12.951025] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-21T18:33:13.518260] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-21T18:33:13.751045] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-21T18:33:14.267845] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-21T18:33:14.551056] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-21T18:33:15.350998] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-21T18:33:15.433476] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-21T18:33:16.151078] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-21T18:33:16.951009] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-21T18:33:17.354250] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-21T18:33:17.515624] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-21T18:33:17.517127] [INFO ] [REMOTE ] EMP: Full fetch complete (4055 records). [2025-10-21T18:33:17.517260] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-21T18:33:17.518503] [FATAL] [VALIDATOR ] EMP: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:33:17.518813] [FATAL] [MAIN ] EMP: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:33:17.518881] [WARN ] [MAIN ] EMP: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:33:17.518978] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-21T18:33:17.519048] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-10-21T18:33:17.519087] [INFO ] [LOCAL ] EMP: Starting deletion of derivative data. [2025-10-21T18:33:17.519201] [DEBUG] [LOCAL ] EMP: Deleted derivative data file. [2025-10-21T18:33:17.519293] [INFO ] [MAIN ] Update Progress: 732/2366 symbols completed. EMP took 21.0s. Estimated remaining: 3h 28m 6s. Rate: 7.9 symbols/min [2025-10-21T18:33:17.697312] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:33:17.746061] [DEBUG] [LOCAL ] ENB: Loaded 53511 existing records from primary storage. [2025-10-21T18:33:17.746372] [INFO ] [MAIN ] ENB: Loaded 53511 existing records. [2025-10-21T18:33:17.757898] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-21T18:33:17.941882] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:33:17.942182] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-21T18:33:17.942247] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-21T18:33:17.943252] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-21T18:33:17.943313] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-21T18:33:18.154620] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-21T18:33:18.353203] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:33:18.551028] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-21T18:33:18.886117] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T18:33:19.351021] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-21T18:33:20.151082] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-21T18:33:20.914211] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-21T18:33:20.950996] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-21T18:33:21.166504] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T18:33:21.166992] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T18:33:21.182163] [INFO ] [REMOTE ] EMO: Full fetch complete (17696 records). [2025-10-21T18:33:21.182327] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-21T18:33:21.556090] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-21T18:33:21.556171] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-21T18:33:21.556604] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-21T18:33:21.556663] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-21T18:33:21.557168] [DEBUG] [LOCAL ] EMO: Trimmed 17696 records to 13345 (keeping 200 days of data) [2025-10-21T18:33:21.634292] [DEBUG] [LOCAL ] EMO: Primary data saved (13345 records). [2025-10-21T18:33:21.634420] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-21T18:33:21.634510] [INFO ] [MAIN ] Update Progress: 733/2366 symbols completed. EMO took 30.5s. Estimated remaining: 3h 27m 50s. Rate: 7.9 symbols/min [2025-10-21T18:33:21.756210] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-21T18:33:21.802709] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:33:21.840823] [DEBUG] [LOCAL ] ENIC: Loaded 36571 existing records from primary storage. [2025-10-21T18:33:21.841147] [INFO ] [MAIN ] ENIC: Loaded 36571 existing records. [2025-10-21T18:33:22.015338] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:33:22.015592] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-21T18:33:22.015639] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-21T18:33:22.016291] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-21T18:33:22.016348] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-21T18:33:22.443707] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:33:22.473139] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T18:33:22.550987] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-21T18:33:23.351043] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-21T18:33:23.700628] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T18:33:24.151032] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-21T18:33:24.410995] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T18:33:24.442283] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-21T18:33:24.951020] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-21T18:33:25.751076] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-21T18:33:25.912302] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T18:33:26.551040] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-21T18:33:26.615091] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T18:33:27.200172] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T18:33:27.208243] [INFO ] [REMOTE ] EMN: Full fetch complete (72411 records). [2025-10-21T18:33:27.208374] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-21T18:33:27.360685] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-21T18:33:27.604235] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-21T18:33:27.604313] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-21T18:33:27.605168] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-21T18:33:27.605230] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-21T18:33:27.606557] [DEBUG] [LOCAL ] EMN: Trimmed 72411 records to 50825 (keeping 200 days of data) [2025-10-21T18:33:27.917191] [DEBUG] [LOCAL ] EMN: Primary data saved (50825 records). [2025-10-21T18:33:27.917317] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-21T18:33:27.917973] [INFO ] [MAIN ] Update Progress: 734/2366 symbols completed. EMN took 43.4s. Estimated remaining: 3h 27m 40s. Rate: 7.9 symbols/min [2025-10-21T18:33:28.092315] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:33:28.092513] [DEBUG] [LOCAL ] ENO: No existing data file found in primary storage. [2025-10-21T18:33:28.092609] [WARN ] [MAIN ] ENO: No existing data found, performing full refresh instead. [2025-10-21T18:33:28.092751] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-21T18:33:28.092823] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-21T18:33:28.093032] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-10-21T18:33:28.093140] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-21T18:33:28.156404] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-21T18:33:28.482037] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:33:28.524797] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T18:33:28.763019] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T18:33:28.951070] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-21T18:33:29.751012] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-21T18:33:30.013935] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T18:33:30.406155] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-21T18:33:30.551067] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-21T18:33:30.609299] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-21T18:33:31.351041] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-21T18:33:31.936779] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-21T18:33:32.151049] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-21T18:33:32.619155] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-21T18:33:32.951047] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-21T18:33:33.148050] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T18:33:33.751055] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-21T18:33:34.454137] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T18:33:34.551016] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-21T18:33:35.351013] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-21T18:33:35.665210] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T18:33:35.801946] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-21T18:33:36.045597] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T18:33:36.151032] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-21T18:33:36.951065] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-21T18:33:37.595526] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T18:33:37.751017] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-21T18:33:38.551027] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-21T18:33:39.055701] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-21T18:33:39.090117] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T18:33:39.351038] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-21T18:33:40.151026] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-21T18:33:40.468965] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T18:33:40.579114] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-21T18:33:40.711052] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T18:33:40.951067] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-21T18:33:41.751077] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-21T18:33:42.551090] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-21T18:33:42.737491] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T18:33:43.227226] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T18:33:43.232313] [INFO ] [REMOTE ] ENIC: Full fetch complete (51154 records). [2025-10-21T18:33:43.232406] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-21T18:33:43.232994] [FATAL] [VALIDATOR ] ENIC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:33:43.233076] [FATAL] [MAIN ] ENIC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:33:43.233161] [WARN ] [MAIN ] ENIC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:33:43.233232] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-21T18:33:43.233294] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-10-21T18:33:43.233329] [INFO ] [LOCAL ] ENIC: Starting deletion of derivative data. [2025-10-21T18:33:43.233464] [DEBUG] [LOCAL ] ENIC: Deleted derivative data file. [2025-10-21T18:33:43.233556] [INFO ] [MAIN ] Update Progress: 735/2366 symbols completed. ENIC took 21.6s. Estimated remaining: 3h 27m 49s. Rate: 7.8 symbols/min [2025-10-21T18:33:43.356121] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-21T18:33:43.406267] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:33:43.444464] [DEBUG] [LOCAL ] ENOV: Loaded 44779 existing records from primary storage. [2025-10-21T18:33:43.444762] [INFO ] [MAIN ] ENOV: Loaded 44779 existing records. [2025-10-21T18:33:43.618974] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:33:43.619148] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-21T18:33:43.619193] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-21T18:33:43.619881] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-21T18:33:43.619965] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-21T18:33:43.971258] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:33:44.151063] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-21T18:33:44.673601] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-21T18:33:44.950998] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-21T18:33:45.305989] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-21T18:33:45.751001] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-21T18:33:45.971267] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T18:33:46.357060] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-21T18:33:46.550993] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-21T18:33:47.080221] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-21T18:33:47.218824] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-21T18:33:47.351068] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-21T18:33:48.151069] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-21T18:33:48.590628] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-21T18:33:48.950999] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-21T18:33:49.438929] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-21T18:33:49.447408] [INFO ] [REMOTE ] ENB: Full fetch complete (77658 records). [2025-10-21T18:33:49.447573] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-21T18:33:49.756285] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-21T18:33:49.884432] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-21T18:33:49.884538] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-21T18:33:49.885624] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-21T18:33:49.885738] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-21T18:33:49.887331] [DEBUG] [LOCAL ] ENB: Trimmed 77658 records to 53511 (keeping 200 days of data) [2025-10-21T18:33:50.219065] [DEBUG] [LOCAL ] ENB: Primary data saved (53511 records). [2025-10-21T18:33:50.219207] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-21T18:33:50.220049] [INFO ] [MAIN ] Update Progress: 736/2366 symbols completed. ENB took 32.7s. Estimated remaining: 3h 27m 40s. Rate: 7.8 symbols/min [2025-10-21T18:33:50.395405] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:33:50.436384] [DEBUG] [LOCAL ] ENR: Loaded 43825 existing records from primary storage. [2025-10-21T18:33:50.436725] [INFO ] [MAIN ] ENR: Loaded 43825 existing records. [2025-10-21T18:33:50.554924] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-21T18:33:50.628821] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:33:50.629137] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-21T18:33:50.629331] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-21T18:33:50.630195] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-21T18:33:50.630257] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-21T18:33:50.938910] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-21T18:33:51.061123] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:33:51.170054] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-21T18:33:51.231625] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T18:33:51.350990] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-21T18:33:51.791664] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-21T18:33:52.151082] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-21T18:33:52.951102] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-21T18:33:53.423309] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-21T18:33:53.424118] [INFO ] [REMOTE ] ENO: Full fetch complete (2985 records). [2025-10-21T18:33:53.424184] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-21T18:33:53.424507] [FATAL] [VALIDATOR ] ENO: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:33:53.424591] [FATAL] [MAIN ] ENO: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:33:53.424632] [WARN ] [MAIN ] ENO: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:33:53.424720] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-21T18:33:53.424780] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-10-21T18:33:53.424814] [INFO ] [LOCAL ] ENO: Starting deletion of derivative data. [2025-10-21T18:33:53.424858] [DEBUG] [LOCAL ] ENO: No derivative data file found to delete. [2025-10-21T18:33:53.424911] [INFO ] [MAIN ] Update Progress: 737/2366 symbols completed. ENO took 25.5s. Estimated remaining: 3h 27m 23s. Rate: 7.9 symbols/min [2025-10-21T18:33:53.601753] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:33:53.601997] [DEBUG] [LOCAL ] ENS: No existing data file found in primary storage. [2025-10-21T18:33:53.602049] [WARN ] [MAIN ] ENS: No existing data found, performing full refresh instead. [2025-10-21T18:33:53.602157] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-21T18:33:53.602199] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-21T18:33:53.602241] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-10-21T18:33:53.602271] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-21T18:33:53.754538] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-21T18:33:53.974281] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:33:54.005482] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T18:33:54.551125] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-21T18:33:55.359336] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-21T18:33:55.382065] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T18:33:55.420226] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T18:33:55.430020] [INFO ] [REMOTE ] EMR: Full fetch complete (77215 records). [2025-10-21T18:33:55.430195] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-21T18:33:55.838002] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-21T18:33:55.838092] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-21T18:33:55.839005] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-21T18:33:55.839068] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-21T18:33:55.840696] [DEBUG] [LOCAL ] EMR: Trimmed 77215 records to 53171 (keeping 200 days of data) [2025-10-21T18:33:56.158731] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-21T18:33:56.168679] [DEBUG] [LOCAL ] EMR: Primary data saved (53171 records). [2025-10-21T18:33:56.168814] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-21T18:33:56.169612] [INFO ] [MAIN ] Update Progress: 738/2366 symbols completed. EMR took 46.8s. Estimated remaining: 3h 27m 4s. Rate: 7.9 symbols/min [2025-10-21T18:33:56.372065] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:33:56.397217] [DEBUG] [LOCAL ] ENVA: Loaded 25413 existing records from primary storage. [2025-10-21T18:33:56.397461] [INFO ] [MAIN ] ENVA: Loaded 25413 existing records. [2025-10-21T18:33:56.571629] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:33:56.571889] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-21T18:33:56.571944] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-21T18:33:56.572371] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-21T18:33:56.572425] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-21T18:33:56.931395] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:33:56.950986] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-21T18:33:57.109545] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-21T18:33:57.680291] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T18:33:57.751000] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-21T18:33:58.225091] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T18:33:58.551015] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-21T18:33:59.350987] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-21T18:33:59.459210] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-21T18:33:59.888315] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T18:34:00.151022] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-21T18:34:00.272630] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T18:34:00.951017] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-21T18:34:01.751074] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-21T18:34:02.149284] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-21T18:34:02.551006] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-21T18:34:02.727851] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T18:34:03.289578] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T18:34:03.350986] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-21T18:34:03.978760] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T18:34:04.151032] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-21T18:34:04.951077] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-21T18:34:05.135799] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-21T18:34:05.751041] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-21T18:34:05.941369] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T18:34:06.497339] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T18:34:06.551022] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-21T18:34:07.320170] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T18:34:07.351000] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-21T18:34:08.151083] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-21T18:34:08.258865] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T18:34:08.747247] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T18:34:08.951029] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-21T18:34:09.751013] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-21T18:34:09.857532] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T18:34:10.551051] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-21T18:34:10.638680] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T18:34:11.222175] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-21T18:34:11.351041] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-21T18:34:12.021744] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T18:34:12.151048] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-21T18:34:12.937668] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T18:34:12.951328] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-21T18:34:13.530795] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-21T18:34:13.702572] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-21T18:34:13.750988] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-21T18:34:14.551102] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-21T18:34:14.893451] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T18:34:15.351094] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-21T18:34:16.122143] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T18:34:16.127987] [INFO ] [REMOTE ] ENOV: Full fetch complete (63174 records). [2025-10-21T18:34:16.128097] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-21T18:34:16.128705] [FATAL] [VALIDATOR ] ENOV: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:34:16.128803] [FATAL] [MAIN ] ENOV: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:34:16.128864] [WARN ] [MAIN ] ENOV: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:34:16.128930] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-21T18:34:16.128993] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-10-21T18:34:16.129028] [INFO ] [LOCAL ] ENOV: Starting deletion of derivative data. [2025-10-21T18:34:16.129181] [DEBUG] [LOCAL ] ENOV: Deleted derivative data file. [2025-10-21T18:34:16.129268] [INFO ] [MAIN ] Update Progress: 739/2366 symbols completed. ENOV took 32.9s. Estimated remaining: 3h 27m 24s. Rate: 7.8 symbols/min [2025-10-21T18:34:16.159870] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-21T18:34:16.298941] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:34:16.314180] [DEBUG] [LOCAL ] EOD: Loaded 15056 existing records from primary storage. [2025-10-21T18:34:16.314392] [INFO ] [MAIN ] EOD: Loaded 15056 existing records. [2025-10-21T18:34:16.493570] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:34:16.493747] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-21T18:34:16.493796] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-21T18:34:16.493933] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-21T18:34:16.493969] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-21T18:34:16.859124] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:34:16.950991] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-21T18:34:16.953102] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T18:34:17.654243] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T18:34:17.751061] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-21T18:34:18.468583] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T18:34:18.551074] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-21T18:34:19.351134] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-21T18:34:19.616192] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T18:34:19.770544] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-21T18:34:20.151036] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-21T18:34:20.714463] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T18:34:20.951017] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-21T18:34:21.075465] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T18:34:21.751023] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-21T18:34:22.324299] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T18:34:22.551002] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-21T18:34:22.966168] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-21T18:34:23.333982] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-21T18:34:23.351025] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-21T18:34:24.151025] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-21T18:34:24.897026] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-21T18:34:24.902389] [INFO ] [REMOTE ] ENS: Full fetch complete (42720 records). [2025-10-21T18:34:24.902475] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-21T18:34:24.956719] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-21T18:34:25.281731] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-21T18:34:25.281807] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-21T18:34:25.282383] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-21T18:34:25.282422] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-21T18:34:25.283706] [DEBUG] [LOCAL ] ENS: Trimmed 42720 records to 29741 (keeping 200 days of data) [2025-10-21T18:34:25.463363] [DEBUG] [LOCAL ] ENS: Primary data saved (29741 records). [2025-10-21T18:34:25.463477] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-21T18:34:25.463543] [INFO ] [MAIN ] Update Progress: 740/2366 symbols completed. ENS took 32.0s. Estimated remaining: 3h 27m 20s. Rate: 7.8 symbols/min [2025-10-21T18:34:25.632197] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:34:25.686338] [DEBUG] [LOCAL ] EOG: Loaded 53391 existing records from primary storage. [2025-10-21T18:34:25.686671] [INFO ] [MAIN ] EOG: Loaded 53391 existing records. [2025-10-21T18:34:25.753935] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-21T18:34:25.872857] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:34:25.873289] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-21T18:34:25.873570] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-21T18:34:25.880161] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-21T18:34:25.881511] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-21T18:34:25.903945] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T18:34:26.015896] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T18:34:26.271733] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:34:26.551023] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-21T18:34:27.056320] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T18:34:27.060044] [INFO ] [REMOTE ] ENVA: Full fetch complete (36497 records). [2025-10-21T18:34:27.060120] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-21T18:34:27.356185] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-21T18:34:27.431764] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-21T18:34:27.431863] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-21T18:34:27.432450] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-21T18:34:27.432510] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-21T18:34:27.433296] [DEBUG] [LOCAL ] ENVA: Trimmed 36497 records to 25267 (keeping 200 days of data) [2025-10-21T18:34:27.578427] [DEBUG] [LOCAL ] ENVA: Primary data saved (25267 records). [2025-10-21T18:34:27.578557] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-21T18:34:27.578636] [INFO ] [MAIN ] Update Progress: 741/2366 symbols completed. ENVA took 31.4s. Estimated remaining: 3h 27m 0s. Rate: 7.9 symbols/min [2025-10-21T18:34:27.749906] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:34:27.760158] [DEBUG] [LOCAL ] EOI: Loaded 10601 existing records from primary storage. [2025-10-21T18:34:27.760315] [INFO ] [MAIN ] EOI: Loaded 10601 existing records. [2025-10-21T18:34:27.940468] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:34:27.940696] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-21T18:34:27.940788] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-21T18:34:27.941114] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-21T18:34:27.941171] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-21T18:34:28.161357] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-21T18:34:28.306946] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:34:28.916913] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-21T18:34:28.951003] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-21T18:34:28.950946] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-21T18:34:29.160741] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-21T18:34:29.751018] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-21T18:34:30.551022] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-21T18:34:30.785014] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T18:34:31.248381] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-21T18:34:31.261100] [INFO ] [REMOTE ] ENR: Full fetch complete (59632 records). [2025-10-21T18:34:31.265492] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-21T18:34:31.265837] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-21T18:34:31.356103] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-21T18:34:31.681089] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-21T18:34:31.681184] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-21T18:34:31.681966] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-21T18:34:31.682031] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-21T18:34:31.683347] [DEBUG] [LOCAL ] ENR: Trimmed 59632 records to 43882 (keeping 200 days of data) [2025-10-21T18:34:31.957151] [DEBUG] [LOCAL ] ENR: Primary data saved (43882 records). [2025-10-21T18:34:31.957460] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-21T18:34:31.957558] [INFO ] [MAIN ] Update Progress: 742/2366 symbols completed. ENR took 41.7s. Estimated remaining: 3h 26m 45s. Rate: 7.9 symbols/min [2025-10-21T18:34:32.126963] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:34:32.141912] [DEBUG] [LOCAL ] EOS: Loaded 14852 existing records from primary storage. [2025-10-21T18:34:32.142140] [INFO ] [MAIN ] EOS: Loaded 14852 existing records. [2025-10-21T18:34:32.156330] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-21T18:34:32.335548] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:34:32.335881] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-21T18:34:32.335936] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-21T18:34:32.336640] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-21T18:34:32.336728] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-21T18:34:32.636886] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T18:34:32.741729] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:34:32.951032] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-21T18:34:33.245874] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-21T18:34:33.751013] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-21T18:34:34.305069] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-21T18:34:34.551051] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-21T18:34:34.765393] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T18:34:35.351036] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-21T18:34:35.361980] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T18:34:36.150986] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-21T18:34:36.322938] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-21T18:34:36.951013] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-21T18:34:37.751024] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-21T18:34:37.864247] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T18:34:38.097270] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T18:34:38.551111] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-21T18:34:39.185510] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T18:34:39.351012] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-21T18:34:39.597208] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T18:34:40.151001] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-21T18:34:40.288632] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-21T18:34:40.951029] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-21T18:34:41.750994] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-21T18:34:42.026543] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T18:34:42.029545] [INFO ] [REMOTE ] EOD: Full fetch complete (20821 records). [2025-10-21T18:34:42.029614] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-21T18:34:42.428790] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-21T18:34:42.438211] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-21T18:34:42.449067] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-21T18:34:42.450754] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-21T18:34:42.450948] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-21T18:34:42.452711] [DEBUG] [LOCAL ] EOD: Trimmed 20821 records to 15024 (keeping 200 days of data) [2025-10-21T18:34:42.537964] [DEBUG] [LOCAL ] EOD: Primary data saved (15024 records). [2025-10-21T18:34:42.544559] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-21T18:34:42.544830] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T18:34:42.547425] [INFO ] [MAIN ] Update Progress: 743/2366 symbols completed. EOD took 26.4s. Estimated remaining: 3h 26m 44s. Rate: 7.9 symbols/min [2025-10-21T18:34:42.558183] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-21T18:34:42.723318] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:34:42.723498] [DEBUG] [LOCAL ] EOT: No existing data file found in primary storage. [2025-10-21T18:34:42.723536] [WARN ] [MAIN ] EOT: No existing data found, performing full refresh instead. [2025-10-21T18:34:42.723673] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-21T18:34:42.723744] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-21T18:34:42.723809] [DEBUG] [LOCAL ] EOT: No primary data file found to delete. [2025-10-21T18:34:42.723853] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-21T18:34:43.081780] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:34:43.351014] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-21T18:34:44.097802] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T18:34:44.151011] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-21T18:34:44.453822] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-21T18:34:44.951020] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-21T18:34:45.330095] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T18:34:45.751086] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-21T18:34:45.813860] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T18:34:46.521806] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T18:34:46.551003] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-21T18:34:47.270310] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-21T18:34:47.351001] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-21T18:34:48.069976] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-21T18:34:48.151056] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-21T18:34:48.800259] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-21T18:34:48.951061] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-21T18:34:49.563749] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-21T18:34:49.751039] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-21T18:34:50.469927] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-21T18:34:50.551033] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-21T18:34:51.245169] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-21T18:34:51.351037] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-21T18:34:52.125846] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T18:34:52.150990] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-21T18:34:52.938456] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-21T18:34:52.950984] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-21T18:34:53.751056] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-21T18:34:53.889259] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T18:34:53.891623] [INFO ] [REMOTE ] EOI: Full fetch complete (16108 records). [2025-10-21T18:34:53.891753] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-21T18:34:54.272155] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-21T18:34:54.272229] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-21T18:34:54.272573] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-21T18:34:54.272612] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-21T18:34:54.273099] [DEBUG] [LOCAL ] EOI: Trimmed 16108 records to 10545 (keeping 200 days of data) [2025-10-21T18:34:54.335460] [DEBUG] [LOCAL ] EOI: Primary data saved (10545 records). [2025-10-21T18:34:54.335575] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-21T18:34:54.335669] [INFO ] [MAIN ] Update Progress: 744/2366 symbols completed. EOI took 26.8s. Estimated remaining: 3h 26m 45s. Rate: 7.8 symbols/min [2025-10-21T18:34:54.530135] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:34:54.553971] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-21T18:34:54.554451] [DEBUG] [LOCAL ] EPAC: Loaded 26516 existing records from primary storage. [2025-10-21T18:34:54.555401] [INFO ] [MAIN ] EPAC: Loaded 26516 existing records. [2025-10-21T18:34:54.659824] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-21T18:34:54.740696] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:34:54.740925] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-21T18:34:54.740970] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-21T18:34:54.741398] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-21T18:34:54.741453] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-21T18:34:55.086824] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:34:55.351042] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-21T18:34:56.151057] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-21T18:34:56.573228] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-21T18:34:56.704181] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T18:34:56.951074] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-21T18:34:57.170634] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-21T18:34:57.746009] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-21T18:34:57.750970] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-21T18:34:58.551521] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-21T18:34:58.553953] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T18:34:58.556372] [INFO ] [REMOTE ] EOT: Full fetch complete (10663 records). [2025-10-21T18:34:58.556450] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-21T18:34:58.980500] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-21T18:34:58.980582] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-21T18:34:58.980858] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-21T18:34:58.980918] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-21T18:34:58.981339] [DEBUG] [LOCAL ] EOT: Trimmed 10663 records to 7050 (keeping 200 days of data) [2025-10-21T18:34:59.023365] [DEBUG] [LOCAL ] EOT: Primary data saved (7050 records). [2025-10-21T18:34:59.023498] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-21T18:34:59.023576] [INFO ] [MAIN ] Update Progress: 745/2366 symbols completed. EOT took 16.5s. Estimated remaining: 3h 26m 31s. Rate: 7.8 symbols/min [2025-10-21T18:34:59.187770] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:34:59.226182] [DEBUG] [LOCAL ] EPAM: Loaded 39399 existing records from primary storage. [2025-10-21T18:34:59.226456] [INFO ] [MAIN ] EPAM: Loaded 39399 existing records. [2025-10-21T18:34:59.352532] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-21T18:34:59.403022] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:34:59.403517] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-21T18:34:59.403621] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-21T18:34:59.403908] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-21T18:34:59.403968] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-21T18:34:59.500547] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-21T18:34:59.771895] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:35:00.151065] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-21T18:35:00.405073] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T18:35:00.951091] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-21T18:35:01.751032] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-21T18:35:01.944575] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T18:35:02.551083] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-21T18:35:03.138626] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-21T18:35:03.290552] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T18:35:03.350997] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-21T18:35:03.516578] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T18:35:04.151083] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-21T18:35:04.762597] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T18:35:04.951049] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-21T18:35:05.512821] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-21T18:35:05.751016] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-21T18:35:05.986522] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-21T18:35:06.551059] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-21T18:35:07.351053] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-21T18:35:07.462670] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-21T18:35:07.629266] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T18:35:08.151025] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-21T18:35:08.670924] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-21T18:35:08.951051] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-21T18:35:09.016885] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-21T18:35:09.751053] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-21T18:35:10.488971] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T18:35:10.551016] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-21T18:35:10.656026] [DEBUG] [REMOTE ] EPAM: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-21T18:35:10.656320] [WARN ] [REMOTE ] EPAM: No data returned for month 2025-05 [2025-10-21T18:35:10.656418] [FATAL] [REMOTE ] EPAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:35:10.656493] [FATAL] [MAIN ] EPAM: Failed to fetch primary data. [2025-10-21T18:35:10.656555] [WARN ] [MAIN ] EPAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:35:10.656637] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-21T18:35:10.656751] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-10-21T18:35:10.656808] [INFO ] [LOCAL ] EPAM: Starting deletion of derivative data. [2025-10-21T18:35:10.656937] [DEBUG] [LOCAL ] EPAM: Deleted derivative data file. [2025-10-21T18:35:10.657001] [INFO ] [MAIN ] Update Progress: 746/2366 symbols completed. EPAM took 11.6s. Estimated remaining: 3h 26m 32s. Rate: 7.8 symbols/min [2025-10-21T18:35:10.858686] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:35:10.855931] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T18:35:10.871881] [INFO ] [REMOTE ] EOG: Full fetch complete (77466 records). [2025-10-21T18:35:10.872159] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-21T18:35:11.189239] [DEBUG] [LOCAL ] EPC: Loaded 39805 existing records from primary storage. [2025-10-21T18:35:11.211073] [INFO ] [MAIN ] EPC: Loaded 39805 existing records. [2025-10-21T18:35:11.356089] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-21T18:35:11.433274] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-21T18:35:11.433435] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-21T18:35:11.434539] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-21T18:35:11.434628] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-21T18:35:11.507746] [DEBUG] [LOCAL ] EOG: Trimmed 77466 records to 53390 (keeping 200 days of data) [2025-10-21T18:35:11.534856] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:35:11.535417] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-21T18:35:11.535475] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-21T18:35:11.535742] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-21T18:35:11.535844] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-21T18:35:12.160000] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:35:12.160126] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-21T18:35:12.494090] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T18:35:12.519074] [DEBUG] [LOCAL ] EOG: Primary data saved (53390 records). [2025-10-21T18:35:12.519243] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-21T18:35:12.520158] [INFO ] [MAIN ] Update Progress: 747/2366 symbols completed. EOG took 47.1s. Estimated remaining: 3h 26m 12s. Rate: 7.9 symbols/min [2025-10-21T18:35:12.715197] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:35:12.769201] [DEBUG] [LOCAL ] EPD: Loaded 53612 existing records from primary storage. [2025-10-21T18:35:12.769523] [INFO ] [MAIN ] EPD: Loaded 53612 existing records. [2025-10-21T18:35:12.956212] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-21T18:35:12.993994] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:35:12.994776] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-21T18:35:12.994886] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-21T18:35:12.995278] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-21T18:35:12.995352] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-21T18:35:13.349014] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T18:35:13.381797] [INFO ] [REMOTE ] EOS: Full fetch complete (22888 records). [2025-10-21T18:35:13.396141] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:35:13.396347] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-21T18:35:13.756142] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-21T18:35:13.766364] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-21T18:35:13.766415] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-21T18:35:13.766926] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-21T18:35:13.766987] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-21T18:35:13.767589] [DEBUG] [LOCAL ] EOS: Trimmed 22888 records to 14817 (keeping 200 days of data) [2025-10-21T18:35:13.858015] [DEBUG] [LOCAL ] EOS: Primary data saved (14817 records). [2025-10-21T18:35:13.858122] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-21T18:35:13.858199] [INFO ] [MAIN ] Update Progress: 748/2366 symbols completed. EOS took 41.9s. Estimated remaining: 3h 25m 51s. Rate: 7.9 symbols/min [2025-10-21T18:35:14.025964] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:35:14.064377] [DEBUG] [LOCAL ] EPR: Loaded 43859 existing records from primary storage. [2025-10-21T18:35:14.064834] [INFO ] [MAIN ] EPR: Loaded 43859 existing records. [2025-10-21T18:35:14.261570] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:35:14.256427] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T18:35:14.266912] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-21T18:35:14.266980] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-21T18:35:14.267538] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-21T18:35:14.267591] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-21T18:35:14.556150] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-21T18:35:14.624713] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:35:15.351045] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-21T18:35:16.151089] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-21T18:35:16.189803] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-21T18:35:16.517717] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-21T18:35:16.789942] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T18:35:16.951002] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-21T18:35:17.751020] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-21T18:35:18.156372] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-21T18:35:18.551070] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-21T18:35:18.784138] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T18:35:18.865568] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T18:35:19.351077] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-21T18:35:19.902211] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T18:35:20.151061] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-21T18:35:20.951024] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-21T18:35:21.359554] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T18:35:21.751058] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-21T18:35:21.787694] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T18:35:22.070234] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T18:35:22.551022] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-21T18:35:23.350996] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-21T18:35:23.755707] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-21T18:35:24.151010] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-21T18:35:24.179349] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T18:35:24.648411] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T18:35:24.951021] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-21T18:35:25.590103] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T18:35:25.751013] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-21T18:35:26.551046] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-21T18:35:26.705827] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T18:35:27.351004] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-21T18:35:27.444963] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T18:35:28.150988] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-21T18:35:28.491748] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T18:35:28.605401] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T18:35:28.609750] [INFO ] [REMOTE ] EPAC: Full fetch complete (38884 records). [2025-10-21T18:35:28.609841] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-21T18:35:28.957152] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-21T18:35:29.006606] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-21T18:35:29.006698] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-21T18:35:29.007288] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-21T18:35:29.007327] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-21T18:35:29.008142] [DEBUG] [LOCAL ] EPAC: Trimmed 38884 records to 26483 (keeping 200 days of data) [2025-10-21T18:35:29.161406] [DEBUG] [LOCAL ] EPAC: Primary data saved (26483 records). [2025-10-21T18:35:29.161535] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-21T18:35:29.161614] [INFO ] [MAIN ] Update Progress: 749/2366 symbols completed. EPAC took 34.8s. Estimated remaining: 3h 25m 60s. Rate: 7.8 symbols/min [2025-10-21T18:35:29.362256] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:35:29.407243] [DEBUG] [LOCAL ] EPRT: Loaded 48488 existing records from primary storage. [2025-10-21T18:35:29.407541] [INFO ] [MAIN ] EPRT: Loaded 48488 existing records. [2025-10-21T18:35:29.599058] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:35:29.599254] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-21T18:35:29.599300] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-21T18:35:29.599478] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-21T18:35:29.599515] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-21T18:35:29.752146] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-21T18:35:29.947373] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:35:30.128886] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T18:35:30.415183] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-21T18:35:30.550991] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-21T18:35:31.351003] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-21T18:35:31.751681] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-21T18:35:32.070636] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T18:35:32.151000] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-21T18:35:32.951026] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-21T18:35:33.274604] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-21T18:35:33.752181] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-21T18:35:33.754352] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T18:35:34.512130] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T18:35:34.550975] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-21T18:35:35.264180] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T18:35:35.350989] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-21T18:35:35.777262] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-21T18:35:36.151018] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-21T18:35:36.951031] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-21T18:35:37.004478] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T18:35:37.751020] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-21T18:35:38.243296] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T18:35:38.551083] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-21T18:35:38.611598] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T18:35:39.351006] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-21T18:35:39.562696] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T18:35:39.568860] [INFO ] [REMOTE ] EPC: Full fetch complete (57313 records). [2025-10-21T18:35:39.569008] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-21T18:35:39.982495] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-21T18:35:39.982575] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-21T18:35:39.983335] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-21T18:35:39.983396] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-21T18:35:39.984563] [DEBUG] [LOCAL ] EPC: Trimmed 57313 records to 39777 (keeping 200 days of data) [2025-10-21T18:35:40.157311] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-21T18:35:40.230012] [DEBUG] [LOCAL ] EPC: Primary data saved (39777 records). [2025-10-21T18:35:40.230157] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-21T18:35:40.230233] [INFO ] [MAIN ] Update Progress: 750/2366 symbols completed. EPC took 29.6s. Estimated remaining: 3h 25m 60s. Rate: 7.8 symbols/min [2025-10-21T18:35:40.401316] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:35:40.412358] [DEBUG] [LOCAL ] EQBK: Loaded 11425 existing records from primary storage. [2025-10-21T18:35:40.412574] [INFO ] [MAIN ] EQBK: Loaded 11425 existing records. [2025-10-21T18:35:40.596118] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:35:40.596450] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-21T18:35:40.596508] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-21T18:35:40.622378] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-21T18:35:40.625493] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-21T18:35:40.672057] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-21T18:35:40.955093] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-21T18:35:41.025213] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:35:41.070516] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T18:35:41.751056] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-21T18:35:41.822984] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T18:35:42.551069] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-21T18:35:43.130512] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-21T18:35:43.239572] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-21T18:35:43.285958] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-21T18:35:43.350984] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-21T18:35:44.123353] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T18:35:44.150991] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-21T18:35:44.951036] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-21T18:35:45.730428] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T18:35:45.737049] [INFO ] [REMOTE ] EPR: Full fetch complete (63280 records). [2025-10-21T18:35:45.737146] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-21T18:35:45.758476] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-21T18:35:46.126035] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-21T18:35:46.126111] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-21T18:35:46.126867] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-21T18:35:46.126927] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-21T18:35:46.129102] [DEBUG] [LOCAL ] EPR: Trimmed 63280 records to 43777 (keeping 200 days of data) [2025-10-21T18:35:46.386782] [DEBUG] [LOCAL ] EPR: Primary data saved (43777 records). [2025-10-21T18:35:46.386933] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-21T18:35:46.387010] [INFO ] [MAIN ] Update Progress: 751/2366 symbols completed. EPR took 32.5s. Estimated remaining: 3h 25m 49s. Rate: 7.8 symbols/min [2025-10-21T18:35:46.554093] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-21T18:35:46.555697] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:35:46.556752] [DEBUG] [LOCAL ] EQH: No existing data file found in primary storage. [2025-10-21T18:35:46.556803] [WARN ] [MAIN ] EQH: No existing data found, performing full refresh instead. [2025-10-21T18:35:46.556950] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-21T18:35:46.557023] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-21T18:35:46.557079] [DEBUG] [LOCAL ] EQH: No primary data file found to delete. [2025-10-21T18:35:46.557112] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-21T18:35:46.914913] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:35:46.941078] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-21T18:35:47.350999] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-21T18:35:47.387243] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-21T18:35:47.575959] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-21T18:35:47.584271] [INFO ] [REMOTE ] EPD: Full fetch complete (77777 records). [2025-10-21T18:35:47.584399] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-21T18:35:47.990115] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-21T18:35:47.990202] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-21T18:35:47.991151] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-21T18:35:47.991218] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-21T18:35:47.992677] [DEBUG] [LOCAL ] EPD: Trimmed 77777 records to 53609 (keeping 200 days of data) [2025-10-21T18:35:48.164316] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-21T18:35:48.313821] [DEBUG] [LOCAL ] EPD: Primary data saved (53609 records). [2025-10-21T18:35:48.313952] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-21T18:35:48.314688] [INFO ] [MAIN ] Update Progress: 752/2366 symbols completed. EPD took 35.8s. Estimated remaining: 3h 25m 29s. Rate: 7.9 symbols/min [2025-10-21T18:35:48.478098] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:35:48.529252] [DEBUG] [LOCAL ] EQNR: Loaded 53058 existing records from primary storage. [2025-10-21T18:35:48.529599] [INFO ] [MAIN ] EQNR: Loaded 53058 existing records. [2025-10-21T18:35:48.701175] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:35:48.701379] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-21T18:35:48.701426] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-21T18:35:48.701637] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-21T18:35:48.701729] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-21T18:35:48.964530] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-21T18:35:49.075911] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:35:49.178344] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-21T18:35:49.305427] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-21T18:35:49.751023] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-21T18:35:50.449068] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T18:35:50.551043] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-21T18:35:51.293672] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-21T18:35:51.350991] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-21T18:35:51.549928] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T18:35:52.151027] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-21T18:35:52.951590] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-21T18:35:52.961831] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T18:35:52.960107] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T18:35:53.751055] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-21T18:35:54.551009] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-21T18:35:54.909096] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-21T18:35:54.952720] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-21T18:35:55.351023] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-21T18:35:56.143061] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T18:35:56.152551] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-21T18:35:56.858128] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T18:35:56.950986] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-21T18:35:57.112526] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-21T18:35:57.751023] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-21T18:35:58.551092] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-21T18:35:58.637607] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T18:35:59.304028] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-21T18:35:59.350984] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-21T18:35:59.595875] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T18:36:00.150994] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-21T18:36:00.296492] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-21T18:36:00.299416] [INFO ] [REMOTE ] EQBK: Full fetch complete (15738 records). [2025-10-21T18:36:00.299489] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-21T18:36:00.687243] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-21T18:36:00.687319] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-21T18:36:00.687673] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-21T18:36:00.687738] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-21T18:36:00.688264] [DEBUG] [LOCAL ] EQBK: Trimmed 15738 records to 11388 (keeping 200 days of data) [2025-10-21T18:36:00.756735] [DEBUG] [LOCAL ] EQBK: Primary data saved (11388 records). [2025-10-21T18:36:00.756869] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-21T18:36:00.756947] [INFO ] [MAIN ] Update Progress: 753/2366 symbols completed. EQBK took 20.5s. Estimated remaining: 3h 25m 31s. Rate: 7.8 symbols/min [2025-10-21T18:36:00.922819] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:36:00.951037] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-21T18:36:00.969830] [DEBUG] [LOCAL ] EQR: Loaded 51795 existing records from primary storage. [2025-10-21T18:36:00.970140] [INFO ] [MAIN ] EQR: Loaded 51795 existing records. [2025-10-21T18:36:01.149011] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:36:01.149219] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-21T18:36:01.149272] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-21T18:36:01.149704] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-21T18:36:01.149760] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-21T18:36:01.533608] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:36:01.751057] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-21T18:36:02.200621] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-21T18:36:02.551011] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-21T18:36:03.010054] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-21T18:36:03.351057] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-21T18:36:03.651448] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T18:36:04.151079] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-21T18:36:04.193002] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T18:36:04.958441] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-21T18:36:04.967541] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-21T18:36:05.751058] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-21T18:36:05.825715] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T18:36:06.551109] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-21T18:36:06.905508] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-21T18:36:07.351005] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-21T18:36:07.391160] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-21T18:36:08.150995] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-21T18:36:08.550139] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-21T18:36:08.558103] [INFO ] [REMOTE ] EPRT: Full fetch complete (69483 records). [2025-10-21T18:36:08.558316] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-21T18:36:08.956565] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-21T18:36:08.956848] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-21T18:36:08.956944] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-21T18:36:08.958813] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-21T18:36:08.959000] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-21T18:36:08.960437] [DEBUG] [LOCAL ] EPRT: Trimmed 69483 records to 48476 (keeping 200 days of data) [2025-10-21T18:36:09.282957] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T18:36:09.300520] [DEBUG] [LOCAL ] EPRT: Primary data saved (48476 records). [2025-10-21T18:36:09.301047] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-21T18:36:09.301534] [INFO ] [MAIN ] Update Progress: 754/2366 symbols completed. EPRT took 40.1s. Estimated remaining: 3h 25m 26s. Rate: 7.8 symbols/min [2025-10-21T18:36:09.490473] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:36:09.490723] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-21T18:36:09.490779] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-21T18:36:09.490887] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-21T18:36:09.490930] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-21T18:36:09.490972] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-21T18:36:09.491004] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-21T18:36:09.754524] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-21T18:36:09.859732] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:36:09.888749] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T18:36:10.558091] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-21T18:36:10.576806] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T18:36:11.275059] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-21T18:36:11.278991] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T18:36:11.351026] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-21T18:36:12.151086] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-21T18:36:12.951027] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-21T18:36:13.530329] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-21T18:36:13.629198] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T18:36:13.751030] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-21T18:36:14.095511] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-21T18:36:14.478248] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T18:36:14.551063] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-21T18:36:15.351025] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-21T18:36:16.151027] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-21T18:36:16.244693] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T18:36:16.514070] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-21T18:36:16.747745] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T18:36:16.951069] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-21T18:36:17.313603] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-21T18:36:17.751017] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-21T18:36:18.551061] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-21T18:36:18.934249] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-21T18:36:19.351023] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-21T18:36:19.450570] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-21T18:36:19.459038] [INFO ] [REMOTE ] EQH: Full fetch complete (76646 records). [2025-10-21T18:36:19.459197] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-21T18:36:19.786670] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-21T18:36:19.878704] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-21T18:36:19.878807] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-21T18:36:19.879815] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-21T18:36:19.879883] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-21T18:36:19.881733] [DEBUG] [LOCAL ] EQH: Trimmed 76646 records to 52705 (keeping 200 days of data) [2025-10-21T18:36:20.151796] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-21T18:36:20.197849] [DEBUG] [LOCAL ] EQH: Primary data saved (52705 records). [2025-10-21T18:36:20.198048] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-21T18:36:20.198154] [INFO ] [MAIN ] Update Progress: 755/2366 symbols completed. EQH took 33.8s. Estimated remaining: 3h 25m 25s. Rate: 7.8 symbols/min [2025-10-21T18:36:20.379791] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:36:20.434835] [DEBUG] [LOCAL ] EQT: Loaded 53685 existing records from primary storage. [2025-10-21T18:36:20.435324] [INFO ] [MAIN ] EQT: Loaded 53685 existing records. [2025-10-21T18:36:20.620247] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:36:20.620549] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-21T18:36:20.620595] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-21T18:36:20.621393] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-21T18:36:20.621454] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-21T18:36:20.953671] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-21T18:36:20.973726] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:36:21.751014] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-21T18:36:21.925930] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T18:36:22.551052] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-21T18:36:22.800588] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T18:36:23.351048] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-21T18:36:23.677126] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T18:36:24.061456] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T18:36:24.150986] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-21T18:36:24.951063] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-21T18:36:25.391718] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-21T18:36:25.399794] [INFO ] [REMOTE ] EQNR: Full fetch complete (77011 records). [2025-10-21T18:36:25.399917] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-21T18:36:25.502925] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-21T18:36:25.758234] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-21T18:36:25.797509] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-21T18:36:25.797603] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-21T18:36:25.798547] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-21T18:36:25.798712] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-21T18:36:25.800564] [DEBUG] [LOCAL ] EQNR: Trimmed 77011 records to 53055 (keeping 200 days of data) [2025-10-21T18:36:26.038951] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T18:36:26.161964] [DEBUG] [LOCAL ] EQNR: Primary data saved (53055 records). [2025-10-21T18:36:26.162099] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-21T18:36:26.162701] [INFO ] [MAIN ] Update Progress: 756/2366 symbols completed. EQNR took 37.8s. Estimated remaining: 3h 25m 14s. Rate: 7.8 symbols/min [2025-10-21T18:36:26.333962] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:36:26.340425] [DEBUG] [LOCAL ] EQV: Loaded 2745 existing records from primary storage. [2025-10-21T18:36:26.340636] [INFO ] [MAIN ] EQV: Loaded 2745 existing records. [2025-10-21T18:36:26.498744] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-21T18:36:26.537757] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:36:26.538045] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-21T18:36:26.538095] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-21T18:36:26.538264] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-21T18:36:26.538320] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-21T18:36:26.558588] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-21T18:36:26.889246] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:36:27.351026] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-21T18:36:28.151014] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-21T18:36:28.502146] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T18:36:28.951027] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-21T18:36:29.224691] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-21T18:36:29.254974] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T18:36:29.565532] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-21T18:36:29.751026] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-21T18:36:30.551054] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-21T18:36:31.351087] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-21T18:36:31.597841] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T18:36:31.919456] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-21T18:36:31.920328] [INFO ] [REMOTE ] EQS: Full fetch complete (2373 records). [2025-10-21T18:36:31.920402] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-21T18:36:31.920784] [FATAL] [VALIDATOR ] EQS: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:36:31.920923] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:36:31.920992] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:36:31.921062] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-21T18:36:31.921140] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-21T18:36:31.921194] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-21T18:36:31.921238] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-21T18:36:31.921289] [INFO ] [MAIN ] Update Progress: 757/2366 symbols completed. EQS took 22.6s. Estimated remaining: 3h 25m 2s. Rate: 7.8 symbols/min [2025-10-21T18:36:32.151018] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-21T18:36:32.449971] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T18:36:32.458580] [INFO ] [REMOTE ] EQR: Full fetch complete (74575 records). [2025-10-21T18:36:32.458806] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-21T18:36:32.767075] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-21T18:36:32.865131] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-21T18:36:32.865236] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-21T18:36:32.866160] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-21T18:36:32.866221] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-21T18:36:32.867588] [DEBUG] [LOCAL ] EQR: Trimmed 74575 records to 51808 (keeping 200 days of data) [2025-10-21T18:36:32.955895] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-21T18:36:33.185218] [DEBUG] [LOCAL ] EQR: Primary data saved (51808 records). [2025-10-21T18:36:33.185351] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-21T18:36:33.185429] [INFO ] [MAIN ] Update Progress: 758/2366 symbols completed. EQR took 32.4s. Estimated remaining: 3h 24m 41s. Rate: 7.9 symbols/min [2025-10-21T18:36:33.525579] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-21T18:36:33.751019] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-21T18:36:34.551038] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-21T18:36:34.661865] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T18:36:35.351022] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-21T18:36:36.134495] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T18:36:36.151018] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-21T18:36:36.362344] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T18:36:36.779783] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-21T18:36:36.951013] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-21T18:36:37.751016] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-21T18:36:38.201841] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-21T18:36:38.551001] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-21T18:36:38.771800] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T18:36:39.260592] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-21T18:36:39.351051] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-21T18:36:40.151132] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-21T18:36:40.581803] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-21T18:36:40.951053] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-21T18:36:41.323638] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-21T18:36:41.530071] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-21T18:36:41.531065] [INFO ] [REMOTE ] EQV: Full fetch complete (4965 records). [2025-10-21T18:36:41.531134] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-21T18:36:41.764437] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-21T18:36:41.890561] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-21T18:36:41.890633] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-21T18:36:41.890822] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-21T18:36:41.890867] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-21T18:36:41.891218] [DEBUG] [LOCAL ] EQV: Trimmed 4965 records to 2740 (keeping 200 days of data) [2025-10-21T18:36:41.907466] [DEBUG] [LOCAL ] EQV: Primary data saved (2740 records). [2025-10-21T18:36:41.907527] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-21T18:36:41.907591] [INFO ] [MAIN ] Update Progress: 759/2366 symbols completed. EQV took 15.7s. Estimated remaining: 3h 24m 36s. Rate: 7.9 symbols/min [2025-10-21T18:36:44.301005] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-21T18:36:44.312487] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-21T18:36:46.291123] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-21T18:36:46.302441] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-21T18:36:48.349935] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-21T18:36:48.361441] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-21T18:36:49.046970] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-21T18:36:49.055418] [INFO ] [REMOTE ] EQT: Full fetch complete (77860 records). [2025-10-21T18:36:49.055580] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-21T18:36:49.453191] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-21T18:36:49.453287] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-21T18:36:49.454224] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-21T18:36:49.454301] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-21T18:36:49.455776] [DEBUG] [LOCAL ] EQT: Trimmed 77860 records to 53685 (keeping 200 days of data) [2025-10-21T18:36:49.777548] [DEBUG] [LOCAL ] EQT: Primary data saved (53685 records). [2025-10-21T18:36:49.777707] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-21T18:36:49.778569] [INFO ] [MAIN ] Update Progress: 760/2366 symbols completed. EQT took 29.6s. Estimated remaining: 3h 24m 28s. Rate: 7.9 symbols/min [2025-10-21T18:36:50.403294] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:36:50.455494] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:36:50.525969] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:36:50.524250] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:36:50.597319] [DEBUG] [LOCAL ] ESAB: Loaded 26063 existing records from primary storage. [2025-10-21T18:36:50.597752] [INFO ] [MAIN ] ESAB: Loaded 26063 existing records. [2025-10-21T18:36:50.750347] [DEBUG] [LOCAL ] ERO: Loaded 42144 existing records from primary storage. [2025-10-21T18:36:50.753431] [INFO ] [MAIN ] ERO: Loaded 42144 existing records. [2025-10-21T18:36:50.751362] [DEBUG] [LOCAL ] ES: Loaded 52707 existing records from primary storage. [2025-10-21T18:36:50.753243] [DEBUG] [LOCAL ] ERJ: Loaded 50301 existing records from primary storage. [2025-10-21T18:36:50.800761] [INFO ] [MAIN ] ES: Loaded 52707 existing records. [2025-10-21T18:36:50.883581] [INFO ] [MAIN ] ERJ: Loaded 50301 existing records. [2025-10-21T18:36:50.996252] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:36:51.036081] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-21T18:36:51.066766] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-21T18:36:51.133161] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-21T18:36:51.158618] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-21T18:36:51.386948] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:36:51.427802] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-21T18:36:51.459881] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-21T18:36:51.492569] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-21T18:36:51.496890] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:36:51.544474] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-21T18:36:51.532602] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:36:51.544744] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-21T18:36:51.562243] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-21T18:36:51.608149] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-21T18:36:51.582196] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-21T18:36:51.618592] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-21T18:36:51.726324] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-21T18:36:51.910721] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-21T18:36:51.941895] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-21T18:36:52.591120] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:36:52.657734] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-21T18:36:52.907346] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:36:52.925161] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-21T18:36:52.982347] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:36:52.982771] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-21T18:36:53.070745] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:36:53.071072] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-21T18:36:53.998268] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T18:36:54.002481] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-21T18:36:54.579339] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T18:36:54.590572] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-21T18:36:54.671618] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T18:36:54.679363] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-21T18:36:55.032781] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T18:36:55.037286] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-21T18:36:55.069681] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-21T18:36:55.079262] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-21T18:36:56.090984] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T18:36:56.099398] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-21T18:36:56.133673] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T18:36:56.143576] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-21T18:36:56.209397] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-21T18:36:56.215449] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-21T18:36:56.758151] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T18:36:56.767460] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-21T18:36:57.529467] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T18:36:57.536387] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-21T18:36:57.625384] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T18:36:57.635173] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-21T18:36:58.072288] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-21T18:36:58.089920] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-21T18:36:58.646223] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T18:36:58.658216] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-21T18:36:58.684113] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T18:36:58.690338] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-21T18:36:58.764680] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-21T18:36:59.351033] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-21T18:36:59.560508] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-21T18:37:00.004595] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T18:37:00.151028] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-21T18:37:00.484687] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T18:37:00.728930] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-21T18:37:00.951070] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-21T18:37:01.412521] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-21T18:37:01.751087] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-21T18:37:02.551001] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-21T18:37:02.981438] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-21T18:37:03.228439] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T18:37:03.351061] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-21T18:37:04.151076] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-21T18:37:04.391310] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-21T18:37:04.951010] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-21T18:37:05.173325] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-21T18:37:05.658575] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T18:37:05.751079] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-21T18:37:06.551034] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-21T18:37:06.769294] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-21T18:37:07.004857] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T18:37:07.351022] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-21T18:37:07.975478] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T18:37:08.151016] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-21T18:37:08.951020] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-21T18:37:09.114173] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T18:37:09.382329] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-21T18:37:09.751030] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-21T18:37:10.432085] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T18:37:10.551027] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-21T18:37:10.685360] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T18:37:10.689914] [INFO ] [REMOTE ] ESAB: Full fetch complete (36407 records). [2025-10-21T18:37:10.690021] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-21T18:37:11.062574] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-21T18:37:11.062669] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-21T18:37:11.063256] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-21T18:37:11.063296] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-21T18:37:11.064105] [DEBUG] [LOCAL ] ESAB: Trimmed 36407 records to 25989 (keeping 200 days of data) [2025-10-21T18:37:11.225460] [DEBUG] [LOCAL ] ESAB: Primary data saved (25989 records). [2025-10-21T18:37:11.225593] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-21T18:37:11.225701] [INFO ] [MAIN ] Update Progress: 761/2366 symbols completed. ESAB took 21.4s. Estimated remaining: 3h 24m 50s. Rate: 7.8 symbols/min [2025-10-21T18:37:11.362735] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-21T18:37:11.394887] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:37:11.411827] [DEBUG] [LOCAL ] ESE: Loaded 16467 existing records from primary storage. [2025-10-21T18:37:11.412056] [INFO ] [MAIN ] ESE: Loaded 16467 existing records. [2025-10-21T18:37:11.585096] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:37:11.585322] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-21T18:37:11.585381] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-21T18:37:11.585582] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-21T18:37:11.585621] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-21T18:37:11.953755] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:37:12.150996] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-21T18:37:12.951050] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-21T18:37:14.680983] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T18:37:14.690632] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-21T18:37:15.229549] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (4.68 seconds). [2025-10-21T18:37:15.240592] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-21T18:37:16.862011] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-21T18:37:16.869575] [INFO ] [REMOTE ] ERO: Full fetch complete (60581 records). [2025-10-21T18:37:16.869734] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-21T18:37:17.278250] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (5.92 seconds). [2025-10-21T18:37:17.306831] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-21T18:37:17.307420] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-21T18:37:17.308523] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-21T18:37:17.308958] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-21T18:37:17.308634] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-21T18:37:17.310872] [DEBUG] [LOCAL ] ERO: Trimmed 60581 records to 42158 (keeping 200 days of data) [2025-10-21T18:37:17.433013] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (5.28 seconds). [2025-10-21T18:37:17.498552] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-21T18:37:17.562775] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-21T18:37:17.578971] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-21T18:37:17.616310] [DEBUG] [LOCAL ] ERO: Primary data saved (42158 records). [2025-10-21T18:37:17.616436] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-21T18:37:17.616515] [INFO ] [MAIN ] Update Progress: 762/2366 symbols completed. ERO took 27.8s. Estimated remaining: 3h 24m 40s. Rate: 7.8 symbols/min [2025-10-21T18:37:17.797172] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:37:17.846076] [DEBUG] [LOCAL ] ESI: Loaded 50643 existing records from primary storage. [2025-10-21T18:37:17.846438] [INFO ] [MAIN ] ESI: Loaded 50643 existing records. [2025-10-21T18:37:18.030187] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:37:18.030419] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-21T18:37:18.030469] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-21T18:37:18.030708] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-21T18:37:18.030764] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-21T18:37:18.403851] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:37:18.404201] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-21T18:37:18.425440] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-21T18:37:18.433720] [INFO ] [REMOTE ] ES: Full fetch complete (76091 records). [2025-10-21T18:37:18.433841] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-21T18:37:18.434614] [FATAL] [VALIDATOR ] ES: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:37:18.434787] [FATAL] [MAIN ] ES: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:37:18.434862] [WARN ] [MAIN ] ES: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:37:18.434978] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-21T18:37:18.435040] [DEBUG] [LOCAL ] ES: No primary data file found to delete. [2025-10-21T18:37:18.435074] [INFO ] [LOCAL ] ES: Starting deletion of derivative data. [2025-10-21T18:37:18.435221] [DEBUG] [LOCAL ] ES: Deleted derivative data file. [2025-10-21T18:37:18.435310] [INFO ] [MAIN ] Update Progress: 763/2366 symbols completed. ES took 28.6s. Estimated remaining: 3h 24m 18s. Rate: 7.8 symbols/min [2025-10-21T18:37:18.629909] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:37:18.627671] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T18:37:18.633679] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-21T18:37:18.667835] [DEBUG] [LOCAL ] ESNT: Loaded 38177 existing records from primary storage. [2025-10-21T18:37:18.668127] [INFO ] [MAIN ] ESNT: Loaded 38177 existing records. [2025-10-21T18:37:18.847261] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:37:18.847467] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-21T18:37:18.847525] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-21T18:37:18.847724] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-21T18:37:18.847781] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-21T18:37:19.206840] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:37:19.236144] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T18:37:19.350997] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-21T18:37:19.878744] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T18:37:20.151044] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-21T18:37:20.355308] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-21T18:37:20.951036] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-21T18:37:21.024468] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T18:37:21.032195] [INFO ] [REMOTE ] ERJ: Full fetch complete (72998 records). [2025-10-21T18:37:21.032329] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-21T18:37:21.315745] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T18:37:21.455169] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-21T18:37:21.455259] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-21T18:37:21.456131] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-21T18:37:21.456195] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-21T18:37:21.457613] [DEBUG] [LOCAL ] ERJ: Trimmed 72998 records to 50293 (keeping 200 days of data) [2025-10-21T18:37:21.749776] [DEBUG] [LOCAL ] ERJ: Primary data saved (50293 records). [2025-10-21T18:37:21.749946] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-21T18:37:21.750415] [INFO ] [MAIN ] Update Progress: 764/2366 symbols completed. ERJ took 32.0s. Estimated remaining: 3h 24m 1s. Rate: 7.9 symbols/min [2025-10-21T18:37:21.761875] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-21T18:37:21.927550] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:37:21.969914] [DEBUG] [LOCAL ] ESRT: Loaded 46564 existing records from primary storage. [2025-10-21T18:37:21.970221] [INFO ] [MAIN ] ESRT: Loaded 46564 existing records. [2025-10-21T18:37:22.176018] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:37:22.176231] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-21T18:37:22.176277] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-21T18:37:22.176453] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-21T18:37:22.176503] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-21T18:37:22.562225] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:37:22.556364] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-21T18:37:22.589169] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T18:37:22.818550] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-21T18:37:23.351024] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-21T18:37:24.148676] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T18:37:24.156623] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-21T18:37:24.709825] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T18:37:24.951025] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-21T18:37:25.751023] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-21T18:37:26.399305] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-21T18:37:26.551073] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-21T18:37:26.634535] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T18:37:26.867483] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T18:37:27.351080] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-21T18:37:27.969820] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T18:37:28.151038] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-21T18:37:28.951071] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-21T18:37:28.994712] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T18:37:29.689573] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T18:37:29.751032] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-21T18:37:30.005162] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T18:37:30.551077] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-21T18:37:31.315482] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T18:37:31.351018] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-21T18:37:32.151001] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-21T18:37:32.248213] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T18:37:32.803973] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T18:37:32.950999] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-21T18:37:33.756269] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-21T18:37:33.762003] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T18:37:33.784370] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-21T18:37:34.551021] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-21T18:37:35.351052] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-21T18:37:35.655333] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-21T18:37:36.106591] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T18:37:36.150980] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-21T18:37:36.232025] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T18:37:36.951017] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-21T18:37:37.700168] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T18:37:37.751000] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-21T18:37:38.550995] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-21T18:37:38.757445] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T18:37:39.107712] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T18:37:39.350998] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-21T18:37:39.765237] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T18:37:39.768015] [INFO ] [REMOTE ] ESE: Full fetch complete (22897 records). [2025-10-21T18:37:39.768090] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-21T18:37:40.121751] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-21T18:37:40.121820] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-21T18:37:40.122292] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-21T18:37:40.122329] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-21T18:37:40.122943] [DEBUG] [LOCAL ] ESE: Trimmed 22897 records to 16514 (keeping 200 days of data) [2025-10-21T18:37:40.166532] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-21T18:37:40.226631] [DEBUG] [LOCAL ] ESE: Primary data saved (16514 records). [2025-10-21T18:37:40.226775] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-21T18:37:40.226852] [INFO ] [MAIN ] Update Progress: 765/2366 symbols completed. ESE took 29.0s. Estimated remaining: 3h 24m 16s. Rate: 7.8 symbols/min [2025-10-21T18:37:40.389984] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:37:40.390202] [DEBUG] [LOCAL ] ESS: No existing data file found in primary storage. [2025-10-21T18:37:40.390243] [WARN ] [MAIN ] ESS: No existing data found, performing full refresh instead. [2025-10-21T18:37:40.390350] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-21T18:37:40.390391] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-21T18:37:40.390430] [DEBUG] [LOCAL ] ESS: No primary data file found to delete. [2025-10-21T18:37:40.390461] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-21T18:37:40.737411] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:37:40.951074] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-21T18:37:41.139740] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T18:37:41.627631] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T18:37:41.751015] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-21T18:37:42.551001] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-21T18:37:42.667256] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T18:37:43.351038] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-21T18:37:43.619006] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T18:37:44.044166] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T18:37:44.050219] [INFO ] [REMOTE ] ESNT: Full fetch complete (57179 records). [2025-10-21T18:37:44.050320] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-21T18:37:44.152258] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-21T18:37:44.437484] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-21T18:37:44.437563] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-21T18:37:44.438405] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-21T18:37:44.438470] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-21T18:37:44.439699] [DEBUG] [LOCAL ] ESNT: Trimmed 57179 records to 38064 (keeping 200 days of data) [2025-10-21T18:37:44.664730] [DEBUG] [LOCAL ] ESNT: Primary data saved (38064 records). [2025-10-21T18:37:44.664869] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-21T18:37:44.665437] [INFO ] [MAIN ] Update Progress: 766/2366 symbols completed. ESNT took 26.2s. Estimated remaining: 3h 24m 1s. Rate: 7.8 symbols/min [2025-10-21T18:37:44.837497] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:37:44.883992] [DEBUG] [LOCAL ] ESTC: Loaded 50306 existing records from primary storage. [2025-10-21T18:37:44.884322] [INFO ] [MAIN ] ESTC: Loaded 50306 existing records. [2025-10-21T18:37:44.956092] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-21T18:37:45.072507] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:37:45.072822] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-21T18:37:45.072967] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-21T18:37:45.073336] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-21T18:37:45.073453] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-21T18:37:45.263756] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T18:37:45.468699] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:37:45.751007] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-21T18:37:45.991009] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T18:37:46.003373] [INFO ] [REMOTE ] ESI: Full fetch complete (73220 records). [2025-10-21T18:37:46.003612] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-21T18:37:46.442992] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-21T18:37:46.443131] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-21T18:37:46.444347] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-21T18:37:46.444424] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-21T18:37:46.446043] [DEBUG] [LOCAL ] ESI: Trimmed 73220 records to 50624 (keeping 200 days of data) [2025-10-21T18:37:46.558341] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-21T18:37:46.754595] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T18:37:46.803404] [DEBUG] [LOCAL ] ESI: Primary data saved (50624 records). [2025-10-21T18:37:46.803593] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-21T18:37:46.803730] [INFO ] [MAIN ] Update Progress: 767/2366 symbols completed. ESI took 29.2s. Estimated remaining: 3h 23m 42s. Rate: 7.8 symbols/min [2025-10-21T18:37:46.996497] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:37:47.048489] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-21T18:37:47.048979] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-10-21T18:37:47.228904] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:37:47.229111] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-21T18:37:47.229157] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-21T18:37:47.229345] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-21T18:37:47.229383] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-21T18:37:47.356164] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-21T18:37:47.593108] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:37:47.758028] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-21T18:37:48.151012] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-21T18:37:48.449949] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-21T18:37:48.608340] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T18:37:48.951021] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-21T18:37:49.751052] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-21T18:37:50.395639] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-21T18:37:50.556209] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-21T18:37:50.578230] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-21T18:37:51.219136] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T18:37:51.351058] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-21T18:37:51.966205] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T18:37:52.151048] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-21T18:37:52.507935] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-21T18:37:52.951045] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-21T18:37:53.751135] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-21T18:37:54.068573] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-21T18:37:54.350038] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-21T18:37:54.551036] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-21T18:37:55.351039] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-21T18:37:55.609408] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T18:37:56.065093] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-21T18:37:56.150983] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-21T18:37:56.951019] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-21T18:37:57.533390] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-21T18:37:57.758106] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-21T18:37:57.763138] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T18:37:58.551013] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-21T18:37:58.788951] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T18:37:59.351021] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-21T18:38:00.049862] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-21T18:38:00.141145] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-21T18:38:00.148409] [INFO ] [REMOTE ] ESRT: Full fetch complete (66646 records). [2025-10-21T18:38:00.148569] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-21T18:38:00.160270] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-21T18:38:00.531218] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-21T18:38:00.531298] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-21T18:38:00.532126] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-21T18:38:00.532221] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-21T18:38:00.533482] [DEBUG] [LOCAL ] ESRT: Trimmed 66646 records to 46538 (keeping 200 days of data) [2025-10-21T18:38:00.792909] [DEBUG] [LOCAL ] ESRT: Primary data saved (46538 records). [2025-10-21T18:38:00.793031] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-21T18:38:00.793407] [INFO ] [MAIN ] Update Progress: 768/2366 symbols completed. ESRT took 39.0s. Estimated remaining: 3h 23m 48s. Rate: 7.8 symbols/min [2025-10-21T18:38:00.958253] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-21T18:38:00.960823] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:38:00.976618] [DEBUG] [LOCAL ] ETB: Loaded 11975 existing records from primary storage. [2025-10-21T18:38:00.976881] [INFO ] [MAIN ] ETB: Loaded 11975 existing records. [2025-10-21T18:38:01.157011] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:38:01.157395] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-21T18:38:01.157469] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-21T18:38:01.157746] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-21T18:38:01.157819] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-21T18:38:01.414982] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-21T18:38:01.564824] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:38:01.584127] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T18:38:01.751066] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-21T18:38:02.551076] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-21T18:38:02.921899] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T18:38:03.351062] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-21T18:38:03.486122] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-21T18:38:04.057301] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T18:38:04.151083] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-21T18:38:04.789759] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-21T18:38:04.953974] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-21T18:38:04.959533] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T18:38:05.751075] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-21T18:38:06.398695] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-21T18:38:06.551089] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-21T18:38:07.351068] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-21T18:38:07.561072] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T18:38:08.151070] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-21T18:38:08.429962] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T18:38:08.508633] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T18:38:08.951183] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-21T18:38:09.751111] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-21T18:38:09.943007] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T18:38:10.043030] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T18:38:10.551034] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-21T18:38:11.351064] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-21T18:38:11.591093] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-21T18:38:12.096778] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-21T18:38:12.151057] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-21T18:38:12.951010] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-21T18:38:13.063550] [DEBUG] [REMOTE ] ETB: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-21T18:38:13.063957] [WARN ] [REMOTE ] ETB: No data returned for month 2025-05 [2025-10-21T18:38:13.064195] [FATAL] [REMOTE ] ETB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:38:13.065821] [FATAL] [MAIN ] ETB: Failed to fetch primary data. [2025-10-21T18:38:13.065737] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-21T18:38:13.065973] [WARN ] [MAIN ] ETB: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:38:13.076198] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-21T18:38:13.076390] [DEBUG] [LOCAL ] ETB: No primary data file found to delete. [2025-10-21T18:38:13.076447] [INFO ] [LOCAL ] ETB: Starting deletion of derivative data. [2025-10-21T18:38:13.076613] [DEBUG] [LOCAL ] ETB: Deleted derivative data file. [2025-10-21T18:38:13.077024] [INFO ] [MAIN ] Update Progress: 769/2366 symbols completed. ETB took 12.3s. Estimated remaining: 3h 23m 50s. Rate: 7.8 symbols/min [2025-10-21T18:38:13.255636] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:38:13.282837] [DEBUG] [LOCAL ] ETD: Loaded 27370 existing records from primary storage. [2025-10-21T18:38:13.283103] [INFO ] [MAIN ] ETD: Loaded 27370 existing records. [2025-10-21T18:38:13.458439] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:38:13.458696] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-21T18:38:13.458763] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-21T18:38:13.458963] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-21T18:38:13.459017] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-21T18:38:13.756127] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-21T18:38:13.810733] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:38:14.551040] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-21T18:38:14.666697] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-21T18:38:15.128306] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T18:38:15.136438] [INFO ] [REMOTE ] ESTC: Full fetch complete (72130 records). [2025-10-21T18:38:15.136573] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-21T18:38:15.137412] [FATAL] [VALIDATOR ] ESTC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:38:15.137497] [FATAL] [MAIN ] ESTC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:38:15.137538] [WARN ] [MAIN ] ESTC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:38:15.137577] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-21T18:38:15.137633] [DEBUG] [LOCAL ] ESTC: No primary data file found to delete. [2025-10-21T18:38:15.137709] [INFO ] [LOCAL ] ESTC: Starting deletion of derivative data. [2025-10-21T18:38:15.137860] [DEBUG] [LOCAL ] ESTC: Deleted derivative data file. [2025-10-21T18:38:15.138223] [INFO ] [MAIN ] Update Progress: 770/2366 symbols completed. ESTC took 30.5s. Estimated remaining: 3h 23m 31s. Rate: 7.8 symbols/min [2025-10-21T18:38:15.318115] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:38:15.337325] [DEBUG] [LOCAL ] ETG: Loaded 16667 existing records from primary storage. [2025-10-21T18:38:15.337562] [INFO ] [MAIN ] ETG: Loaded 16667 existing records. [2025-10-21T18:38:15.359557] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-21T18:38:15.519526] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:38:15.519793] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-21T18:38:15.519846] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-21T18:38:15.520018] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-21T18:38:15.520073] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-21T18:38:15.874749] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:38:16.115599] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T18:38:16.151077] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-21T18:38:16.951012] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-21T18:38:17.500800] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-21T18:38:17.678480] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T18:38:17.751034] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-21T18:38:17.995180] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T18:38:18.000522] [INFO ] [REMOTE ] ESS: Full fetch complete (43792 records). [2025-10-21T18:38:18.000690] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-21T18:38:18.383765] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-21T18:38:18.383838] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-21T18:38:18.384468] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-21T18:38:18.384506] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-21T18:38:18.385373] [DEBUG] [LOCAL ] ESS: Trimmed 43792 records to 30188 (keeping 200 days of data) [2025-10-21T18:38:18.552628] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-21T18:38:18.571720] [DEBUG] [LOCAL ] ESS: Primary data saved (30188 records). [2025-10-21T18:38:18.571844] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-21T18:38:18.571911] [INFO ] [MAIN ] Update Progress: 771/2366 symbols completed. ESS took 38.3s. Estimated remaining: 3h 23m 14s. Rate: 7.8 symbols/min [2025-10-21T18:38:18.712390] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-21T18:38:18.760997] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:38:18.778223] [DEBUG] [LOCAL ] ETJ: Loaded 16676 existing records from primary storage. [2025-10-21T18:38:18.778451] [INFO ] [MAIN ] ETJ: Loaded 16676 existing records. [2025-10-21T18:38:18.953607] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:38:18.953829] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-21T18:38:18.953877] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-21T18:38:18.954030] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-21T18:38:18.954069] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-21T18:38:19.307132] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:38:19.351017] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-21T18:38:19.442540] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T18:38:20.151034] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-21T18:38:20.277565] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-21T18:38:20.951025] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-21T18:38:21.277080] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-21T18:38:21.751027] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-21T18:38:21.777176] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-21T18:38:22.551086] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-21T18:38:23.084211] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T18:38:23.351047] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-21T18:38:24.151008] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-21T18:38:24.358099] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T18:38:24.601520] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-21T18:38:24.609423] [INFO ] [REMOTE ] ET: Full fetch complete (77579 records). [2025-10-21T18:38:24.609571] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-21T18:38:24.610396] [FATAL] [VALIDATOR ] ET: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:38:24.610517] [FATAL] [MAIN ] ET: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:38:24.610558] [WARN ] [MAIN ] ET: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:38:24.610595] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-21T18:38:24.610684] [DEBUG] [LOCAL ] ET: No primary data file found to delete. [2025-10-21T18:38:24.610738] [INFO ] [LOCAL ] ET: Starting deletion of derivative data. [2025-10-21T18:38:24.610904] [DEBUG] [LOCAL ] ET: Deleted derivative data file. [2025-10-21T18:38:24.610992] [INFO ] [MAIN ] Update Progress: 772/2366 symbols completed. ET took 37.8s. Estimated remaining: 3h 23m 3s. Rate: 7.9 symbols/min [2025-10-21T18:38:24.780267] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:38:24.829491] [DEBUG] [LOCAL ] ETN: Loaded 52584 existing records from primary storage. [2025-10-21T18:38:24.829843] [INFO ] [MAIN ] ETN: Loaded 52584 existing records. [2025-10-21T18:38:24.956144] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-21T18:38:25.015210] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:38:25.015389] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-21T18:38:25.015436] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-21T18:38:25.015635] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-21T18:38:25.015715] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-21T18:38:25.376574] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:38:25.447296] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-21T18:38:25.751034] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-21T18:38:26.050558] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T18:38:26.551043] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-21T18:38:27.190164] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-21T18:38:27.244493] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T18:38:27.351034] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-21T18:38:28.151005] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-21T18:38:28.521180] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T18:38:28.951082] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-21T18:38:29.751096] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-21T18:38:30.042704] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-21T18:38:30.111184] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T18:38:30.551030] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-21T18:38:30.759482] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-21T18:38:31.351027] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-21T18:38:31.876067] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T18:38:32.151056] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-21T18:38:32.348689] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T18:38:32.951018] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-21T18:38:33.751021] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-21T18:38:34.108380] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-21T18:38:34.133755] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T18:38:34.551040] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-21T18:38:34.650723] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-21T18:38:35.351005] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-21T18:38:35.409166] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-21T18:38:36.151015] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-21T18:38:36.951033] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-21T18:38:37.670910] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-21T18:38:37.708381] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T18:38:37.750988] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-21T18:38:38.263807] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T18:38:38.386575] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-21T18:38:38.551007] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-21T18:38:39.351004] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-21T18:38:39.711288] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T18:38:39.715471] [INFO ] [REMOTE ] ETD: Full fetch complete (38608 records). [2025-10-21T18:38:39.715565] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-21T18:38:40.125079] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-21T18:38:40.125557] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-21T18:38:40.126261] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-21T18:38:40.126324] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-21T18:38:40.127187] [DEBUG] [LOCAL ] ETD: Trimmed 38608 records to 27258 (keeping 200 days of data) [2025-10-21T18:38:40.179356] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-21T18:38:40.289272] [DEBUG] [LOCAL ] ETD: Primary data saved (27258 records). [2025-10-21T18:38:40.289395] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-21T18:38:40.289471] [INFO ] [MAIN ] Update Progress: 773/2366 symbols completed. ETD took 27.2s. Estimated remaining: 3h 23m 12s. Rate: 7.8 symbols/min [2025-10-21T18:38:40.421522] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-21T18:38:40.477808] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:38:40.475000] [INFO ] [REMOTE ] ETG: Full fetch complete (24722 records). [2025-10-21T18:38:40.478065] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-21T18:38:40.617397] [DEBUG] [LOCAL ] ETO: Loaded 7007 existing records from primary storage. [2025-10-21T18:38:40.639706] [INFO ] [MAIN ] ETO: Loaded 7007 existing records. [2025-10-21T18:38:40.978849] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-21T18:38:40.978756] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:38:41.003981] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-21T18:38:41.051048] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-21T18:38:41.052722] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-21T18:38:41.052842] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-21T18:38:41.053441] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-21T18:38:41.053549] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-21T18:38:41.053928] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-21T18:38:41.054123] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-21T18:38:41.059832] [DEBUG] [LOCAL ] ETG: Trimmed 24722 records to 16586 (keeping 200 days of data) [2025-10-21T18:38:41.452154] [DEBUG] [LOCAL ] ETG: Primary data saved (16586 records). [2025-10-21T18:38:41.462511] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-21T18:38:41.467733] [INFO ] [MAIN ] Update Progress: 774/2366 symbols completed. ETG took 26.3s. Estimated remaining: 3h 22m 51s. Rate: 7.8 symbols/min [2025-10-21T18:38:41.626717] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:38:41.695441] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:38:41.741292] [DEBUG] [LOCAL ] ETR: Loaded 53196 existing records from primary storage. [2025-10-21T18:38:41.741581] [INFO ] [MAIN ] ETR: Loaded 53196 existing records. [2025-10-21T18:38:41.774213] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-21T18:38:41.932689] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:38:41.932895] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-21T18:38:41.932947] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-21T18:38:41.933277] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-21T18:38:41.933313] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-21T18:38:42.160519] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T18:38:42.330763] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:38:42.368389] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-21T18:38:42.368570] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-21T18:38:42.550986] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-21T18:38:43.351019] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-21T18:38:44.151032] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-21T18:38:44.584698] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-21T18:38:44.584925] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-21T18:38:44.951005] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-21T18:38:45.200730] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-21T18:38:45.558863] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-21T18:38:45.751051] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-21T18:38:46.551032] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-21T18:38:47.351015] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-21T18:38:47.539067] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T18:38:47.619405] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T18:38:48.151035] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-21T18:38:48.905938] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T18:38:48.950993] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-21T18:38:49.751032] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-21T18:38:49.872413] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-21T18:38:50.484193] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-21T18:38:50.550995] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-21T18:38:50.783840] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T18:38:51.350992] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-21T18:38:51.546440] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T18:38:52.151016] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-21T18:38:52.951016] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-21T18:38:53.013360] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T18:38:53.750985] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-21T18:38:53.914056] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-21T18:38:53.916972] [INFO ] [REMOTE ] ETJ: Full fetch complete (25582 records). [2025-10-21T18:38:53.917045] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-21T18:38:54.290367] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-21T18:38:54.290496] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-21T18:38:54.291143] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-21T18:38:54.291207] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-21T18:38:54.291930] [DEBUG] [LOCAL ] ETJ: Trimmed 25582 records to 16565 (keeping 200 days of data) [2025-10-21T18:38:54.392505] [DEBUG] [LOCAL ] ETJ: Primary data saved (16565 records). [2025-10-21T18:38:54.392621] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-21T18:38:54.392739] [INFO ] [MAIN ] Update Progress: 775/2366 symbols completed. ETJ took 35.8s. Estimated remaining: 3h 22m 54s. Rate: 7.8 symbols/min [2025-10-21T18:38:54.564919] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-21T18:38:54.564787] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:38:54.598552] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-21T18:38:54.656004] [DEBUG] [LOCAL ] ETSY: Loaded 53569 existing records from primary storage. [2025-10-21T18:38:54.656320] [INFO ] [MAIN ] ETSY: Loaded 53569 existing records. [2025-10-21T18:38:54.829487] [WARN ] [MAIN ] ETSY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:38:54.829744] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-21T18:38:54.829799] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-21T18:38:54.830009] [DEBUG] [LOCAL ] ETSY: Deleted primary data file. [2025-10-21T18:38:54.830066] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-21T18:38:55.182974] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:38:55.188547] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-21T18:38:55.351002] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-21T18:38:55.674399] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T18:38:56.151026] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-21T18:38:56.874890] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T18:38:56.951043] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-21T18:38:57.483415] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-21T18:38:57.751014] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-21T18:38:58.420390] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-21T18:38:58.551043] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-21T18:38:58.912104] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-21T18:38:59.222605] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-21T18:38:59.234440] [INFO ] [REMOTE ] ETN: Full fetch complete (76638 records). [2025-10-21T18:38:59.234666] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-21T18:38:59.356134] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-21T18:38:59.631465] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-21T18:38:59.631545] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-21T18:38:59.632533] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-21T18:38:59.632599] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-21T18:38:59.634079] [DEBUG] [LOCAL ] ETN: Trimmed 76638 records to 52573 (keeping 200 days of data) [2025-10-21T18:38:59.957869] [DEBUG] [LOCAL ] ETN: Primary data saved (52573 records). [2025-10-21T18:38:59.958025] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-21T18:38:59.958107] [INFO ] [MAIN ] Update Progress: 776/2366 symbols completed. ETN took 35.3s. Estimated remaining: 3h 22m 42s. Rate: 7.8 symbols/min [2025-10-21T18:39:00.064021] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-21T18:39:00.136104] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:39:00.156890] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-21T18:39:00.159129] [DEBUG] [LOCAL ] ETV: Loaded 22127 existing records from primary storage. [2025-10-21T18:39:00.159324] [INFO ] [MAIN ] ETV: Loaded 22127 existing records. [2025-10-21T18:39:00.379283] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:39:00.379522] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-21T18:39:00.379574] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-21T18:39:00.379754] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-21T18:39:00.379810] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-21T18:39:00.742717] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:39:00.950995] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-21T18:39:01.751104] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-21T18:39:02.207617] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-21T18:39:02.363306] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-21T18:39:02.551060] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-21T18:39:02.615789] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T18:39:03.351057] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-21T18:39:04.151014] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-21T18:39:04.172899] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T18:39:04.174876] [INFO ] [REMOTE ] ETO: Full fetch complete (9741 records). [2025-10-21T18:39:04.174968] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-21T18:39:04.538529] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-21T18:39:04.538609] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-21T18:39:04.538962] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-21T18:39:04.539062] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-21T18:39:04.539769] [DEBUG] [LOCAL ] ETO: Trimmed 9741 records to 6981 (keeping 200 days of data) [2025-10-21T18:39:04.608623] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-21T18:39:04.628824] [DEBUG] [LOCAL ] ETO: Primary data saved (6981 records). [2025-10-21T18:39:04.628932] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-21T18:39:04.629006] [INFO ] [MAIN ] Update Progress: 777/2366 symbols completed. ETO took 24.3s. Estimated remaining: 3h 22m 29s. Rate: 7.8 symbols/min [2025-10-21T18:39:04.796454] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:39:04.820287] [DEBUG] [LOCAL ] ETW: Loaded 25419 existing records from primary storage. [2025-10-21T18:39:04.820527] [INFO ] [MAIN ] ETW: Loaded 25419 existing records. [2025-10-21T18:39:04.960528] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-21T18:39:05.003323] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:39:05.003633] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-21T18:39:05.003715] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-21T18:39:05.003877] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-21T18:39:05.003915] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-21T18:39:05.226502] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-21T18:39:05.375713] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:39:05.751043] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-21T18:39:06.551044] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-21T18:39:07.004255] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-21T18:39:07.350996] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-21T18:39:07.487412] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T18:39:07.653266] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T18:39:08.151059] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-21T18:39:08.886809] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T18:39:08.951050] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-21T18:39:09.751009] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-21T18:39:09.941218] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T18:39:10.551023] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-21T18:39:10.886942] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T18:39:10.983459] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-21T18:39:11.351025] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-21T18:39:11.371628] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T18:39:12.151035] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-21T18:39:12.951024] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-21T18:39:13.458111] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-21T18:39:13.467769] [INFO ] [REMOTE ] ETR: Full fetch complete (77277 records). [2025-10-21T18:39:13.468044] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-21T18:39:13.753976] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-21T18:39:13.885300] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-21T18:39:13.885404] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-21T18:39:13.886378] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-21T18:39:13.886537] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-21T18:39:13.888189] [DEBUG] [LOCAL ] ETR: Trimmed 77277 records to 53193 (keeping 200 days of data) [2025-10-21T18:39:14.014379] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T18:39:14.049311] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T18:39:14.273221] [DEBUG] [LOCAL ] ETR: Primary data saved (53193 records). [2025-10-21T18:39:14.273356] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-21T18:39:14.274028] [INFO ] [MAIN ] Update Progress: 778/2366 symbols completed. ETR took 32.8s. Estimated remaining: 3h 22m 25s. Rate: 7.8 symbols/min [2025-10-21T18:39:14.441418] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:39:14.449200] [DEBUG] [LOCAL ] ETX: Loaded 5277 existing records from primary storage. [2025-10-21T18:39:14.449414] [INFO ] [MAIN ] ETX: Loaded 5277 existing records. [2025-10-21T18:39:14.552444] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-21T18:39:14.635951] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:39:14.636166] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-21T18:39:14.636225] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-21T18:39:14.636405] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-21T18:39:14.636460] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-21T18:39:14.989900] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T18:39:15.017537] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:39:15.351006] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-21T18:39:15.580235] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T18:39:16.151024] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-21T18:39:16.951002] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-21T18:39:17.106452] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-21T18:39:17.217822] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T18:39:17.751006] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-21T18:39:18.057754] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T18:39:18.550990] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-21T18:39:19.189318] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T18:39:19.351015] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-21T18:39:19.566211] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-21T18:39:20.151053] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-21T18:39:20.453967] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T18:39:20.511475] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-21T18:39:20.951069] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-21T18:39:21.751055] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-21T18:39:22.067088] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-21T18:39:22.244594] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-21T18:39:22.551039] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-21T18:39:23.350995] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-21T18:39:23.737060] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T18:39:23.741160] [INFO ] [REMOTE ] ETV: Full fetch complete (32233 records). [2025-10-21T18:39:23.741240] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-21T18:39:23.741774] [FATAL] [VALIDATOR ] ETV: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:39:23.741856] [FATAL] [MAIN ] ETV: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:39:23.741899] [WARN ] [MAIN ] ETV: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:39:23.741964] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-21T18:39:23.742027] [DEBUG] [LOCAL ] ETV: No primary data file found to delete. [2025-10-21T18:39:23.742063] [INFO ] [LOCAL ] ETV: Starting deletion of derivative data. [2025-10-21T18:39:23.742216] [DEBUG] [LOCAL ] ETV: Deleted derivative data file. [2025-10-21T18:39:23.742302] [INFO ] [MAIN ] Update Progress: 779/2366 symbols completed. ETV took 23.8s. Estimated remaining: 3h 22m 21s. Rate: 7.8 symbols/min [2025-10-21T18:39:23.918434] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:39:23.942050] [DEBUG] [LOCAL ] ETY: Loaded 22685 existing records from primary storage. [2025-10-21T18:39:23.942358] [INFO ] [MAIN ] ETY: Loaded 22685 existing records. [2025-10-21T18:39:24.125640] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:39:24.125866] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-21T18:39:24.125927] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-21T18:39:24.126124] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-21T18:39:24.126180] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-21T18:39:24.156754] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-21T18:39:24.487103] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:39:24.951052] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-21T18:39:25.120370] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T18:39:25.306464] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T18:39:25.751083] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-21T18:39:25.859157] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T18:39:26.551063] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-21T18:39:27.105226] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T18:39:27.350995] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-21T18:39:27.417542] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-21T18:39:28.150989] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-21T18:39:28.393303] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-21T18:39:28.951018] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-21T18:39:29.750996] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-21T18:39:30.112617] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-21T18:39:30.148749] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-21T18:39:30.302705] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-21T18:39:30.551021] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-21T18:39:31.351029] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-21T18:39:32.048911] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-21T18:39:32.150982] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-21T18:39:32.454321] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T18:39:32.710085] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-21T18:39:32.951012] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-21T18:39:33.750988] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-21T18:39:34.120152] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T18:39:34.554158] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-21T18:39:34.555045] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T18:39:35.351070] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-21T18:39:36.151012] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-21T18:39:36.349891] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-21T18:39:36.544227] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-21T18:39:36.575480] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-21T18:39:36.951020] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-21T18:39:37.751012] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-21T18:39:38.093608] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T18:39:38.551023] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-21T18:39:39.030399] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T18:39:39.036751] [INFO ] [REMOTE ] ETW: Full fetch complete (36545 records). [2025-10-21T18:39:39.036940] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-21T18:39:39.354496] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-21T18:39:39.438501] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-21T18:39:39.438672] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-21T18:39:39.439853] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-21T18:39:39.439920] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-21T18:39:39.441225] [DEBUG] [LOCAL ] ETW: Trimmed 36545 records to 25249 (keeping 200 days of data) [2025-10-21T18:39:39.608187] [DEBUG] [LOCAL ] ETW: Primary data saved (25249 records). [2025-10-21T18:39:39.608463] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-21T18:39:39.608594] [INFO ] [MAIN ] Update Progress: 780/2366 symbols completed. ETW took 35.0s. Estimated remaining: 3h 22m 30s. Rate: 7.8 symbols/min [2025-10-21T18:39:39.771174] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-21T18:39:39.854816] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:39:39.873530] [DEBUG] [LOCAL ] EVC: Loaded 18043 existing records from primary storage. [2025-10-21T18:39:39.873814] [INFO ] [MAIN ] EVC: Loaded 18043 existing records. [2025-10-21T18:39:40.048324] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:39:40.048533] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-21T18:39:40.048579] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-21T18:39:40.048828] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-21T18:39:40.048888] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-21T18:39:40.156144] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-21T18:39:40.397916] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:39:40.951956] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-21T18:39:40.952240] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T18:39:40.954887] [INFO ] [REMOTE ] ETX: Full fetch complete (6797 records). [2025-10-21T18:39:40.955100] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-21T18:39:41.321476] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-21T18:39:41.321575] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-21T18:39:41.321807] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-21T18:39:41.321919] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-21T18:39:41.330345] [DEBUG] [LOCAL ] ETX: Trimmed 6797 records to 5311 (keeping 200 days of data) [2025-10-21T18:39:41.345563] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T18:39:41.380915] [INFO ] [REMOTE ] ETSY: Full fetch complete (77662 records). [2025-10-21T18:39:41.383728] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-21T18:39:41.433154] [DEBUG] [LOCAL ] ETX: Primary data saved (5311 records). [2025-10-21T18:39:41.462793] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-21T18:39:41.473936] [INFO ] [MAIN ] Update Progress: 781/2366 symbols completed. ETX took 27.2s. Estimated remaining: 3h 22m 11s. Rate: 7.8 symbols/min [2025-10-21T18:39:41.755351] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-21T18:39:41.839713] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:39:42.036322] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-10-21T18:39:42.037367] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-10-21T18:39:42.038398] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-10-21T18:39:42.038511] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-10-21T18:39:42.039087] [DEBUG] [LOCAL ] EVEX: Loaded 32891 existing records from primary storage. [2025-10-21T18:39:42.039542] [INFO ] [MAIN ] EVEX: Loaded 32891 existing records. [2025-10-21T18:39:42.145211] [DEBUG] [LOCAL ] ETSY: Trimmed 77662 records to 53569 (keeping 200 days of data) [2025-10-21T18:39:42.179133] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T18:39:42.298802] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:39:42.334812] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-21T18:39:42.337679] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-21T18:39:42.346922] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-21T18:39:42.347009] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-21T18:39:42.551698] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-21T18:39:42.920404] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:39:42.956267] [DEBUG] [LOCAL ] ETSY: Primary data saved (53569 records). [2025-10-21T18:39:42.956413] [INFO ] [MAIN ] ETSY: Full history saved. [2025-10-21T18:39:42.957115] [INFO ] [MAIN ] Update Progress: 782/2366 symbols completed. ETSY took 48.6s. Estimated remaining: 3h 21m 51s. Rate: 7.8 symbols/min [2025-10-21T18:39:43.127670] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:39:43.139669] [DEBUG] [LOCAL ] EVF: Loaded 9820 existing records from primary storage. [2025-10-21T18:39:43.139893] [INFO ] [MAIN ] EVF: Loaded 9820 existing records. [2025-10-21T18:39:43.328291] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T18:39:43.333596] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:39:43.339074] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-21T18:39:43.339131] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-21T18:39:43.339276] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-21T18:39:43.339315] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-21T18:39:43.360020] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-21T18:39:43.713517] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:39:43.727624] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T18:39:44.151006] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-21T18:39:44.483530] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T18:39:44.951034] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-21T18:39:45.400759] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T18:39:45.751021] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-21T18:39:46.128880] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-21T18:39:46.551034] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-21T18:39:46.602802] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-21T18:39:47.351062] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-21T18:39:47.662709] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-21T18:39:48.151138] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-21T18:39:48.566893] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-21T18:39:48.951076] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-21T18:39:49.297788] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-21T18:39:49.751032] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-21T18:39:50.214233] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T18:39:50.550994] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-21T18:39:50.836143] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-21T18:39:51.351008] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-21T18:39:51.699524] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T18:39:52.151031] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-21T18:39:52.419793] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-21T18:39:52.423638] [INFO ] [REMOTE ] ETY: Full fetch complete (34041 records). [2025-10-21T18:39:52.423748] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-21T18:39:52.788587] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-21T18:39:52.788687] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-21T18:39:52.789248] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-21T18:39:52.789288] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-21T18:39:52.790020] [DEBUG] [LOCAL ] ETY: Trimmed 34041 records to 22546 (keeping 200 days of data) [2025-10-21T18:39:52.924909] [DEBUG] [LOCAL ] ETY: Primary data saved (22546 records). [2025-10-21T18:39:52.925034] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-21T18:39:52.925113] [INFO ] [MAIN ] Update Progress: 783/2366 symbols completed. ETY took 29.2s. Estimated remaining: 3h 21m 48s. Rate: 7.8 symbols/min [2025-10-21T18:39:52.956065] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-21T18:39:53.105619] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:39:53.113561] [DEBUG] [LOCAL ] EVG: Loaded 5867 existing records from primary storage. [2025-10-21T18:39:53.113756] [INFO ] [MAIN ] EVG: Loaded 5867 existing records. [2025-10-21T18:39:53.298522] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:39:53.298802] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-21T18:39:53.298855] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-21T18:39:53.299028] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-21T18:39:53.299093] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-21T18:39:53.418998] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-21T18:39:53.664636] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:39:53.750985] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-21T18:39:54.136977] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T18:39:54.551081] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-21T18:39:54.748709] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T18:39:55.351082] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-21T18:39:55.795460] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-21T18:39:55.884624] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-21T18:39:56.151096] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-21T18:39:56.951030] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-21T18:39:57.143697] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-21T18:39:57.559314] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-21T18:39:57.751015] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-21T18:39:58.451549] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-21T18:39:58.551075] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-21T18:39:59.351016] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-21T18:39:59.548818] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T18:40:00.151072] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-21T18:40:00.359836] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T18:40:00.866992] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-21T18:40:00.951007] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-21T18:40:01.751065] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-21T18:40:01.926925] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-21T18:40:02.532200] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-21T18:40:02.551089] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-21T18:40:03.351117] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-21T18:40:03.940087] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T18:40:03.961088] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-21T18:40:04.151023] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-21T18:40:04.951048] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-21T18:40:05.326518] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-21T18:40:05.329254] [INFO ] [REMOTE ] EVC: Full fetch complete (28804 records). [2025-10-21T18:40:05.329334] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-21T18:40:05.698707] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-21T18:40:05.698786] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-21T18:40:05.699303] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-21T18:40:05.699374] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-21T18:40:05.700031] [DEBUG] [LOCAL ] EVC: Trimmed 28804 records to 17976 (keeping 200 days of data) [2025-10-21T18:40:05.771956] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-21T18:40:05.804758] [DEBUG] [LOCAL ] EVC: Primary data saved (17976 records). [2025-10-21T18:40:05.804906] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-21T18:40:05.804985] [INFO ] [MAIN ] Update Progress: 784/2366 symbols completed. EVC took 26.2s. Estimated remaining: 3h 21m 51s. Rate: 7.8 symbols/min [2025-10-21T18:40:05.926606] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T18:40:05.986255] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:40:06.029372] [DEBUG] [LOCAL ] EVH: Loaded 49646 existing records from primary storage. [2025-10-21T18:40:06.029673] [INFO ] [MAIN ] EVH: Loaded 49646 existing records. [2025-10-21T18:40:06.205942] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:40:06.206102] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-21T18:40:06.206148] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-21T18:40:06.206313] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-21T18:40:06.206354] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-21T18:40:06.556690] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-21T18:40:06.562372] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:40:07.278829] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-21T18:40:07.351028] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-21T18:40:07.484911] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T18:40:08.122424] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T18:40:08.150978] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-21T18:40:08.905110] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-21T18:40:08.951045] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-21T18:40:09.699750] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T18:40:09.750994] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-21T18:40:10.551043] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-21T18:40:11.333671] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T18:40:11.350988] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-21T18:40:12.151028] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-21T18:40:12.360848] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T18:40:12.900413] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-21T18:40:12.931501] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T18:40:12.951004] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-21T18:40:13.662277] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T18:40:13.663764] [INFO ] [REMOTE ] EVG: Full fetch complete (8136 records). [2025-10-21T18:40:13.663832] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-21T18:40:13.760331] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-21T18:40:14.019847] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-21T18:40:14.019924] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-21T18:40:14.020126] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-21T18:40:14.020163] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-21T18:40:14.020553] [DEBUG] [LOCAL ] EVG: Trimmed 8136 records to 5831 (keeping 200 days of data) [2025-10-21T18:40:14.054481] [DEBUG] [LOCAL ] EVG: Primary data saved (5831 records). [2025-10-21T18:40:14.054554] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-21T18:40:14.054622] [INFO ] [MAIN ] Update Progress: 785/2366 symbols completed. EVG took 21.1s. Estimated remaining: 3h 21m 44s. Rate: 7.8 symbols/min [2025-10-21T18:40:14.221931] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:40:14.234031] [DEBUG] [LOCAL ] EVN: Loaded 10724 existing records from primary storage. [2025-10-21T18:40:14.234228] [INFO ] [MAIN ] EVN: Loaded 10724 existing records. [2025-10-21T18:40:14.409487] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:40:14.409769] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-21T18:40:14.409822] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-21T18:40:14.409970] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-21T18:40:14.410005] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-21T18:40:14.556162] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-21T18:40:14.760726] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:40:15.351025] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-21T18:40:15.396424] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T18:40:15.501343] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-21T18:40:16.151018] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-21T18:40:16.951033] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-21T18:40:17.134897] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T18:40:17.143479] [INFO ] [REMOTE ] EVEX: Full fetch complete (44005 records). [2025-10-21T18:40:17.143676] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-21T18:40:17.551481] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-21T18:40:17.551602] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-21T18:40:17.552545] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-21T18:40:17.552628] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-21T18:40:17.554193] [DEBUG] [LOCAL ] EVEX: Trimmed 44005 records to 33007 (keeping 200 days of data) [2025-10-21T18:40:17.756091] [DEBUG] [LOCAL ] EVEX: Primary data saved (33007 records). [2025-10-21T18:40:17.756176] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-21T18:40:17.756353] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-21T18:40:17.757284] [INFO ] [MAIN ] Update Progress: 786/2366 symbols completed. EVEX took 36.3s. Estimated remaining: 3h 21m 29s. Rate: 7.8 symbols/min [2025-10-21T18:40:17.931218] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:40:17.967193] [DEBUG] [LOCAL ] EVR: Loaded 34068 existing records from primary storage. [2025-10-21T18:40:17.967475] [INFO ] [MAIN ] EVR: Loaded 34068 existing records. [2025-10-21T18:40:18.145960] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:40:18.146153] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-21T18:40:18.146199] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-21T18:40:18.146456] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-21T18:40:18.146494] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-21T18:40:18.506671] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:40:18.551028] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-21T18:40:18.632163] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-21T18:40:18.711757] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T18:40:19.350994] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-21T18:40:19.844593] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-21T18:40:20.081704] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T18:40:20.147548] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T18:40:20.150971] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-21T18:40:20.951020] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-21T18:40:21.356674] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T18:40:21.359072] [INFO ] [REMOTE ] EVF: Full fetch complete (12852 records). [2025-10-21T18:40:21.359217] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-21T18:40:21.661428] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-21T18:40:21.748181] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-21T18:40:21.748260] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-21T18:40:21.748627] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-21T18:40:21.748713] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-21T18:40:21.749185] [DEBUG] [LOCAL ] EVF: Trimmed 12852 records to 9793 (keeping 200 days of data) [2025-10-21T18:40:21.771472] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-21T18:40:21.807847] [DEBUG] [LOCAL ] EVF: Primary data saved (9793 records). [2025-10-21T18:40:21.807983] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-21T18:40:21.808068] [INFO ] [MAIN ] Update Progress: 787/2366 symbols completed. EVF took 38.9s. Estimated remaining: 3h 21m 14s. Rate: 7.8 symbols/min [2025-10-21T18:40:21.990120] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:40:22.006381] [DEBUG] [LOCAL ] EVT: Loaded 16762 existing records from primary storage. [2025-10-21T18:40:22.006639] [INFO ] [MAIN ] EVT: Loaded 16762 existing records. [2025-10-21T18:40:22.178052] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:40:22.178254] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-21T18:40:22.178299] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-21T18:40:22.178464] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-21T18:40:22.178501] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-21T18:40:22.536854] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:40:22.550991] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-21T18:40:22.681304] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-21T18:40:23.351023] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-21T18:40:24.151002] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-21T18:40:24.177634] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-21T18:40:24.248271] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T18:40:24.951022] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-21T18:40:25.745867] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T18:40:25.750970] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-21T18:40:26.551012] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-21T18:40:26.646960] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T18:40:26.715603] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-21T18:40:27.351024] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-21T18:40:28.057487] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T18:40:28.150999] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-21T18:40:28.158809] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T18:40:28.951022] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-21T18:40:29.186097] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T18:40:29.751002] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-21T18:40:29.786944] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T18:40:30.551016] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-21T18:40:30.670024] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-21T18:40:31.351019] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-21T18:40:32.151046] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-21T18:40:32.324631] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T18:40:32.357748] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T18:40:32.951035] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-21T18:40:33.034673] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-21T18:40:33.724536] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-21T18:40:33.751046] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-21T18:40:34.551066] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-21T18:40:35.351014] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-21T18:40:35.513089] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-21T18:40:35.565341] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T18:40:36.151028] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-21T18:40:36.342231] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T18:40:36.951002] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-21T18:40:36.967185] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-21T18:40:37.751000] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-21T18:40:37.982713] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T18:40:38.551021] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-21T18:40:39.197320] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-21T18:40:39.351026] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-21T18:40:39.440261] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-21T18:40:39.442834] [INFO ] [REMOTE ] EVN: Full fetch complete (17091 records). [2025-10-21T18:40:39.442916] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-21T18:40:39.858332] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-21T18:40:39.858414] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-21T18:40:39.858873] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-21T18:40:39.858935] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-21T18:40:39.859439] [DEBUG] [LOCAL ] EVN: Trimmed 17091 records to 10747 (keeping 200 days of data) [2025-10-21T18:40:39.924743] [DEBUG] [LOCAL ] EVN: Primary data saved (10747 records). [2025-10-21T18:40:39.924880] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-21T18:40:39.924962] [INFO ] [MAIN ] Update Progress: 788/2366 symbols completed. EVN took 25.9s. Estimated remaining: 3h 21m 27s. Rate: 7.8 symbols/min [2025-10-21T18:40:40.097319] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:40:40.123215] [DEBUG] [LOCAL ] EVTC: Loaded 26895 existing records from primary storage. [2025-10-21T18:40:40.123461] [INFO ] [MAIN ] EVTC: Loaded 26895 existing records. [2025-10-21T18:40:40.156153] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-21T18:40:40.299566] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:40:40.299784] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-21T18:40:40.299835] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-21T18:40:40.300003] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-21T18:40:40.300040] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-21T18:40:40.653209] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:40:40.827385] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T18:40:40.951045] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-21T18:40:41.751047] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-21T18:40:41.984470] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T18:40:42.022620] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T18:40:42.551030] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-21T18:40:42.923387] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T18:40:43.351124] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-21T18:40:43.670567] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-21T18:40:43.673124] [INFO ] [REMOTE ] EVT: Full fetch complete (25039 records). [2025-10-21T18:40:43.673222] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-21T18:40:43.673815] [FATAL] [VALIDATOR ] EVT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:40:43.673945] [FATAL] [MAIN ] EVT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:40:43.674017] [WARN ] [MAIN ] EVT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:40:43.674104] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-21T18:40:43.674177] [DEBUG] [LOCAL ] EVT: No primary data file found to delete. [2025-10-21T18:40:43.674216] [INFO ] [LOCAL ] EVT: Starting deletion of derivative data. [2025-10-21T18:40:43.674406] [DEBUG] [LOCAL ] EVT: Deleted derivative data file. [2025-10-21T18:40:43.674494] [INFO ] [MAIN ] Update Progress: 789/2366 symbols completed. EVT took 21.9s. Estimated remaining: 3h 21m 12s. Rate: 7.8 symbols/min [2025-10-21T18:40:43.845399] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:40:43.882558] [DEBUG] [LOCAL ] EVTL: Loaded 41005 existing records from primary storage. [2025-10-21T18:40:43.882868] [INFO ] [MAIN ] EVTL: Loaded 41005 existing records. [2025-10-21T18:40:44.061478] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:40:44.061691] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-21T18:40:44.061748] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-21T18:40:44.062229] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-21T18:40:44.062268] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-21T18:40:44.158813] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-21T18:40:44.423208] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:40:44.942942] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T18:40:44.950968] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-21T18:40:45.562069] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-21T18:40:45.751049] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-21T18:40:46.489612] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T18:40:46.551027] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-21T18:40:47.230119] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T18:40:47.351054] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-21T18:40:47.452964] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-21T18:40:48.151034] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-21T18:40:48.490018] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-21T18:40:48.951098] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-21T18:40:49.480454] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T18:40:49.751065] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-21T18:40:50.025984] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-21T18:40:50.551052] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-21T18:40:51.350996] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-21T18:40:51.594515] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T18:40:51.927723] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T18:40:51.935499] [INFO ] [REMOTE ] EVH: Full fetch complete (71830 records). [2025-10-21T18:40:51.935635] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-21T18:40:52.159799] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-21T18:40:52.323492] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-21T18:40:52.323564] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-21T18:40:52.324423] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-21T18:40:52.324484] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-21T18:40:52.325802] [DEBUG] [LOCAL ] EVH: Trimmed 71830 records to 49597 (keeping 200 days of data) [2025-10-21T18:40:52.599144] [DEBUG] [LOCAL ] EVH: Primary data saved (49597 records). [2025-10-21T18:40:52.599270] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-21T18:40:52.599344] [INFO ] [MAIN ] Update Progress: 790/2366 symbols completed. EVH took 46.8s. Estimated remaining: 3h 21m 6s. Rate: 7.8 symbols/min [2025-10-21T18:40:52.779810] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:40:52.781108] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T18:40:52.786041] [INFO ] [REMOTE ] EVR: Full fetch complete (50729 records). [2025-10-21T18:40:52.786169] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-21T18:40:52.974378] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-21T18:40:52.981321] [DEBUG] [LOCAL ] EVTR: Loaded 25188 existing records from primary storage. [2025-10-21T18:40:52.997088] [INFO ] [MAIN ] EVTR: Loaded 25188 existing records. [2025-10-21T18:40:53.347879] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-21T18:40:53.348281] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-21T18:40:53.349972] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-21T18:40:53.370429] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-21T18:40:53.370343] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:40:53.370725] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-21T18:40:53.370780] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-21T18:40:53.370997] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-21T18:40:53.371098] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-21T18:40:53.453139] [DEBUG] [LOCAL ] EVR: Trimmed 50729 records to 33850 (keeping 200 days of data) [2025-10-21T18:40:53.915216] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T18:40:53.943983] [DEBUG] [LOCAL ] EVR: Primary data saved (33850 records). [2025-10-21T18:40:53.957459] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-21T18:40:53.967680] [INFO ] [MAIN ] Update Progress: 791/2366 symbols completed. EVR took 36.2s. Estimated remaining: 3h 20m 46s. Rate: 7.8 symbols/min [2025-10-21T18:40:53.975831] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-21T18:40:54.047868] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:40:54.179188] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:40:54.227635] [DEBUG] [LOCAL ] EW: Loaded 53400 existing records from primary storage. [2025-10-21T18:40:54.227993] [INFO ] [MAIN ] EW: Loaded 53400 existing records. [2025-10-21T18:40:54.408603] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:40:54.408933] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-21T18:40:54.409123] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-21T18:40:54.409528] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-21T18:40:54.409589] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-21T18:40:54.542765] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T18:40:54.553381] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-21T18:40:54.803794] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:40:55.199144] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-21T18:40:55.351038] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-21T18:40:55.823366] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T18:40:56.101456] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-21T18:40:56.150989] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-21T18:40:56.951056] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-21T18:40:57.637550] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T18:40:57.751011] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-21T18:40:58.148726] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T18:40:58.551046] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-21T18:40:59.351005] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-21T18:40:59.550178] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T18:41:00.083008] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-21T18:41:00.151054] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-21T18:41:00.246215] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T18:41:00.951028] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-21T18:41:01.751081] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-21T18:41:02.152186] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-21T18:41:02.201019] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T18:41:02.551062] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-21T18:41:03.064627] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-21T18:41:03.351140] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-21T18:41:04.151050] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-21T18:41:04.330283] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-21T18:41:04.919166] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-21T18:41:04.951048] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-21T18:41:05.751083] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-21T18:41:05.970718] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T18:41:06.185630] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T18:41:06.551036] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-21T18:41:07.350984] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-21T18:41:07.702011] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-21T18:41:07.753758] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-21T18:41:08.151043] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-21T18:41:08.951014] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-21T18:41:09.364151] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-21T18:41:09.518835] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-21T18:41:09.751018] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-21T18:41:10.551009] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-21T18:41:10.793725] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T18:41:11.351101] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-21T18:41:11.652085] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-21T18:41:11.849152] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T18:41:11.854250] [INFO ] [REMOTE ] EVTC: Full fetch complete (38427 records). [2025-10-21T18:41:11.854358] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-21T18:41:12.156125] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-21T18:41:12.253829] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-21T18:41:12.253915] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-21T18:41:12.254520] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-21T18:41:12.254560] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-21T18:41:12.255494] [DEBUG] [LOCAL ] EVTC: Trimmed 38427 records to 26869 (keeping 200 days of data) [2025-10-21T18:41:12.420796] [DEBUG] [LOCAL ] EVTC: Primary data saved (26869 records). [2025-10-21T18:41:12.420930] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-21T18:41:12.421007] [INFO ] [MAIN ] Update Progress: 792/2366 symbols completed. EVTC took 32.5s. Estimated remaining: 3h 21m 0s. Rate: 7.8 symbols/min [2025-10-21T18:41:12.606430] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T18:41:12.632004] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:41:12.664970] [DEBUG] [LOCAL ] EXG: Loaded 33887 existing records from primary storage. [2025-10-21T18:41:12.665309] [INFO ] [MAIN ] EXG: Loaded 33887 existing records. [2025-10-21T18:41:12.868144] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:41:12.868443] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-21T18:41:12.868513] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-21T18:41:12.868823] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-21T18:41:12.868892] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-21T18:41:12.956159] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-21T18:41:13.243270] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:41:13.751063] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-21T18:41:14.334996] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-21T18:41:14.345680] [INFO ] [REMOTE ] EVTL: Full fetch complete (54773 records). [2025-10-21T18:41:14.345789] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-21T18:41:14.552534] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-21T18:41:14.767771] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-21T18:41:14.767969] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-21T18:41:14.768933] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-21T18:41:14.769037] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-21T18:41:14.798025] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T18:41:14.815565] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T18:41:14.813827] [DEBUG] [LOCAL ] EVTL: Trimmed 54773 records to 41214 (keeping 200 days of data) [2025-10-21T18:41:15.050477] [DEBUG] [LOCAL ] EVTL: Primary data saved (41214 records). [2025-10-21T18:41:15.050584] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-21T18:41:15.050682] [INFO ] [MAIN ] Update Progress: 793/2366 symbols completed. EVTL took 31.4s. Estimated remaining: 3h 20m 42s. Rate: 7.8 symbols/min [2025-10-21T18:41:15.216196] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:41:15.265012] [DEBUG] [LOCAL ] EXK: Loaded 53185 existing records from primary storage. [2025-10-21T18:41:15.265327] [INFO ] [MAIN ] EXK: Loaded 53185 existing records. [2025-10-21T18:41:15.360933] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-21T18:41:15.440084] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:41:15.440240] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-21T18:41:15.440285] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-21T18:41:15.440472] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-21T18:41:15.440527] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-21T18:41:15.789368] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:41:16.151052] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-21T18:41:16.360673] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T18:41:16.951054] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-21T18:41:17.199155] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T18:41:17.282336] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-21T18:41:17.751021] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-21T18:41:18.489353] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T18:41:18.551019] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-21T18:41:19.351004] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-21T18:41:19.623742] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T18:41:20.151032] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-21T18:41:20.223541] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T18:41:20.753299] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T18:41:20.951122] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-21T18:41:21.748581] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-21T18:41:21.759425] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-21T18:41:22.227200] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T18:41:22.551051] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-21T18:41:23.351005] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-21T18:41:23.382974] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T18:41:23.520262] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-21T18:41:23.529202] [INFO ] [REMOTE ] EW: Full fetch complete (77514 records). [2025-10-21T18:41:23.529358] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-21T18:41:23.934979] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-21T18:41:23.935073] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-21T18:41:23.935998] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-21T18:41:23.936061] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-21T18:41:23.937574] [DEBUG] [LOCAL ] EW: Trimmed 77514 records to 53399 (keeping 200 days of data) [2025-10-21T18:41:24.151120] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-21T18:41:24.259817] [DEBUG] [LOCAL ] EW: Primary data saved (53399 records). [2025-10-21T18:41:24.259958] [INFO ] [MAIN ] EW: Full history saved. [2025-10-21T18:41:24.260885] [INFO ] [MAIN ] Update Progress: 794/2366 symbols completed. EW took 30.3s. Estimated remaining: 3h 20m 38s. Rate: 7.8 symbols/min [2025-10-21T18:41:24.431399] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:41:24.462021] [DEBUG] [LOCAL ] EXP: Loaded 29414 existing records from primary storage. [2025-10-21T18:41:24.462289] [INFO ] [MAIN ] EXP: Loaded 29414 existing records. [2025-10-21T18:41:24.669781] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:41:24.670006] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-21T18:41:24.670053] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-21T18:41:24.670273] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-21T18:41:24.670331] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-21T18:41:24.956694] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-21T18:41:24.993388] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T18:41:25.086215] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:41:25.751116] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-21T18:41:25.917863] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T18:41:25.974712] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T18:41:26.551027] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-21T18:41:27.039039] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-21T18:41:27.351088] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-21T18:41:27.892863] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T18:41:27.898395] [INFO ] [REMOTE ] EVTR: Full fetch complete (33792 records). [2025-10-21T18:41:27.898486] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-21T18:41:28.162090] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-21T18:41:28.292958] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-21T18:41:28.293053] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-21T18:41:28.293698] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-21T18:41:28.293761] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-21T18:41:28.294560] [DEBUG] [LOCAL ] EVTR: Trimmed 33792 records to 25297 (keeping 200 days of data) [2025-10-21T18:41:28.451694] [DEBUG] [LOCAL ] EVTR: Primary data saved (25297 records). [2025-10-21T18:41:28.451821] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-21T18:41:28.451900] [INFO ] [MAIN ] Update Progress: 795/2366 symbols completed. EVTR took 35.9s. Estimated remaining: 3h 20m 23s. Rate: 7.8 symbols/min [2025-10-21T18:41:28.628798] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:41:28.629005] [DEBUG] [LOCAL ] EXPD: No existing data file found in primary storage. [2025-10-21T18:41:28.629061] [WARN ] [MAIN ] EXPD: No existing data found, performing full refresh instead. [2025-10-21T18:41:28.629167] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-21T18:41:28.629221] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-21T18:41:28.629294] [DEBUG] [LOCAL ] EXPD: No primary data file found to delete. [2025-10-21T18:41:28.629329] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-21T18:41:28.937226] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T18:41:28.953202] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-21T18:41:29.008503] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:41:29.750985] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-21T18:41:30.083605] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T18:41:30.551035] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-21T18:41:30.713290] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T18:41:30.792791] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T18:41:31.351004] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-21T18:41:32.151040] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-21T18:41:32.222054] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T18:41:32.770352] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T18:41:32.951026] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-21T18:41:33.441076] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T18:41:33.751046] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-21T18:41:33.937176] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-21T18:41:34.551005] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-21T18:41:35.351025] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-21T18:41:35.508580] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T18:41:36.040438] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T18:41:36.150996] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-21T18:41:36.663034] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T18:41:36.950992] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-21T18:41:37.751005] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-21T18:41:37.869162] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T18:41:38.276918] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T18:41:38.550995] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-21T18:41:39.356965] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-21T18:41:39.375371] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T18:41:39.734586] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T18:41:40.150994] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-21T18:41:40.618336] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-21T18:41:40.951025] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-21T18:41:41.176021] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T18:41:41.751091] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-21T18:41:42.227699] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T18:41:42.551093] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-21T18:41:43.351027] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-21T18:41:43.748049] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-21T18:41:43.802021] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-21T18:41:44.151052] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-21T18:41:44.950997] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-21T18:41:45.137251] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T18:41:45.453444] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T18:41:45.458043] [INFO ] [REMOTE ] EXP: Full fetch complete (43039 records). [2025-10-21T18:41:45.458144] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-21T18:41:45.756100] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-21T18:41:45.837250] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-21T18:41:45.837332] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-21T18:41:45.838012] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-21T18:41:45.838077] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-21T18:41:45.839094] [DEBUG] [LOCAL ] EXP: Trimmed 43039 records to 29339 (keeping 200 days of data) [2025-10-21T18:41:46.020973] [DEBUG] [LOCAL ] EXP: Primary data saved (29339 records). [2025-10-21T18:41:46.021106] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-21T18:41:46.021227] [INFO ] [MAIN ] Update Progress: 796/2366 symbols completed. EXP took 21.8s. Estimated remaining: 3h 20m 35s. Rate: 7.8 symbols/min [2025-10-21T18:41:46.188026] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:41:46.231577] [DEBUG] [LOCAL ] EXR: Loaded 45611 existing records from primary storage. [2025-10-21T18:41:46.231887] [INFO ] [MAIN ] EXR: Loaded 45611 existing records. [2025-10-21T18:41:46.415064] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:41:46.415273] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-21T18:41:46.415331] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-21T18:41:46.415540] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-21T18:41:46.415594] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-21T18:41:46.565080] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-21T18:41:46.775495] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:41:46.826319] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T18:41:47.148677] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T18:41:47.153891] [INFO ] [REMOTE ] EXG: Full fetch complete (49616 records). [2025-10-21T18:41:47.154000] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-21T18:41:47.356226] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-21T18:41:47.541858] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-21T18:41:47.541941] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-21T18:41:47.542611] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-21T18:41:47.542687] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-21T18:41:47.543731] [DEBUG] [LOCAL ] EXG: Trimmed 49616 records to 33695 (keeping 200 days of data) [2025-10-21T18:41:47.740842] [DEBUG] [LOCAL ] EXG: Primary data saved (33695 records). [2025-10-21T18:41:47.740985] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-21T18:41:47.741063] [INFO ] [MAIN ] Update Progress: 797/2366 symbols completed. EXG took 35.3s. Estimated remaining: 3h 20m 16s. Rate: 7.8 symbols/min [2025-10-21T18:41:48.151058] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-21T18:41:48.194369] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T18:41:48.608370] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T18:41:48.951105] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-21T18:41:49.751052] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-21T18:41:50.030924] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T18:41:50.508727] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T18:41:50.550993] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-21T18:41:50.910147] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-21T18:41:51.350999] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-21T18:41:52.023351] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T18:41:52.151019] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-21T18:41:52.951137] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-21T18:41:53.013444] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T18:41:53.751086] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-21T18:41:54.040055] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T18:41:54.551069] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-21T18:41:55.274956] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-21T18:41:55.283439] [INFO ] [REMOTE ] EXK: Full fetch complete (76819 records). [2025-10-21T18:41:55.283562] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-21T18:41:55.715836] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-21T18:41:55.716048] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-21T18:41:55.717060] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-21T18:41:55.717143] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-21T18:41:55.743293] [DEBUG] [LOCAL ] EXK: Trimmed 76819 records to 53186 (keeping 200 days of data) [2025-10-21T18:41:55.745250] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-21T18:41:55.756252] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-21T18:41:56.059856] [DEBUG] [LOCAL ] EXK: Primary data saved (53186 records). [2025-10-21T18:41:56.060015] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-21T18:41:56.060851] [INFO ] [MAIN ] Update Progress: 798/2366 symbols completed. EXK took 41.0s. Estimated remaining: 3h 20m 10s. Rate: 7.8 symbols/min [2025-10-21T18:41:56.203625] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T18:41:56.215260] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-21T18:41:56.682171] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-21T18:41:56.690131] [INFO ] [REMOTE ] EXPD: Full fetch complete (69454 records). [2025-10-21T18:41:56.690322] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-21T18:41:57.103325] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-21T18:41:57.103414] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-21T18:41:57.104325] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-21T18:41:57.104417] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-21T18:41:57.105804] [DEBUG] [LOCAL ] EXPD: Trimmed 69454 records to 47765 (keeping 200 days of data) [2025-10-21T18:41:57.407180] [DEBUG] [LOCAL ] EXPD: Primary data saved (47765 records). [2025-10-21T18:41:57.407423] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-21T18:41:57.407533] [INFO ] [MAIN ] Update Progress: 799/2366 symbols completed. EXPD took 29.0s. Estimated remaining: 3h 19m 50s. Rate: 7.8 symbols/min [2025-10-21T18:41:57.474711] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T18:41:57.484958] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-21T18:41:59.260887] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T18:41:59.272278] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-21T18:42:01.034481] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T18:42:01.044463] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-21T18:42:06.189172] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (5.14 seconds). [2025-10-21T18:42:06.199205] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-21T18:42:07.917534] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T18:42:07.927209] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-21T18:42:08.747487] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T18:42:08.754636] [INFO ] [REMOTE ] EXR: Full fetch complete (66206 records). [2025-10-21T18:42:08.754773] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-21T18:42:09.135427] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-21T18:42:09.135522] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-21T18:42:09.136365] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-21T18:42:09.136429] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-21T18:42:09.137808] [DEBUG] [LOCAL ] EXR: Trimmed 66206 records to 45544 (keeping 200 days of data) [2025-10-21T18:42:09.421311] [DEBUG] [LOCAL ] EXR: Primary data saved (45544 records). [2025-10-21T18:42:09.421464] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-21T18:42:09.422272] [INFO ] [MAIN ] Update Progress: 800/2366 symbols completed. EXR took 23.4s. Estimated remaining: 3h 19m 50s. Rate: 7.8 symbols/min [2025-10-21T18:42:10.095891] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:42:10.097091] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:42:10.135708] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:42:10.134428] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:42:10.175196] [DEBUG] [LOCAL ] FBK: Loaded 27519 existing records from primary storage. [2025-10-21T18:42:10.185287] [INFO ] [MAIN ] FBK: Loaded 27519 existing records. [2025-10-21T18:42:10.314037] [DEBUG] [LOCAL ] FAF: Loaded 41567 existing records from primary storage. [2025-10-21T18:42:10.349522] [DEBUG] [LOCAL ] FBIN: Loaded 50414 existing records from primary storage. [2025-10-21T18:42:10.360198] [INFO ] [MAIN ] FAF: Loaded 41567 existing records. [2025-10-21T18:42:10.415508] [INFO ] [MAIN ] FBIN: Loaded 50414 existing records. [2025-10-21T18:42:10.449826] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-21T18:42:10.449039] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:42:10.458833] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-21T18:42:10.529448] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-21T18:42:10.609867] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-21T18:42:10.662417] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-21T18:42:10.711486] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-21T18:42:11.030902] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:42:11.072733] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-21T18:42:11.065924] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:42:11.079357] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-21T18:42:11.072973] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-21T18:42:11.082760] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-21T18:42:11.086021] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:42:11.111925] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-21T18:42:11.106769] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-21T18:42:11.125035] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-21T18:42:11.140313] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-21T18:42:11.155844] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-21T18:42:11.161094] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-21T18:42:11.201229] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-21T18:42:11.254976] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-21T18:42:11.857167] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:42:11.964412] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-21T18:42:12.349958] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:42:12.345895] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:42:12.355969] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-21T18:42:12.355756] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-21T18:42:12.429565] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:42:12.430058] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-21T18:42:13.153254] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-21T18:42:13.157189] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-21T18:42:13.519824] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-21T18:42:13.526925] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-21T18:42:14.111563] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T18:42:14.121713] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-21T18:42:14.136332] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T18:42:14.139792] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-21T18:42:14.828792] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T18:42:14.836230] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-21T18:42:15.014206] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-21T18:42:15.025206] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-21T18:42:15.195329] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T18:42:15.199633] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-21T18:42:15.704918] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T18:42:15.714760] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-21T18:42:16.223842] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T18:42:16.232539] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-21T18:42:16.259509] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-21T18:42:16.266218] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-21T18:42:17.242356] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T18:42:17.252674] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-21T18:42:17.398623] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-21T18:42:17.409023] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-21T18:42:17.456730] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T18:42:17.461455] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-21T18:42:17.813876] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T18:42:17.823028] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-21T18:42:18.185192] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T18:42:18.190185] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-21T18:42:19.066825] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T18:42:19.077793] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-21T18:42:19.383637] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T18:42:19.392928] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-21T18:42:19.466031] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T18:42:19.474136] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-21T18:42:19.904221] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-21T18:42:19.916219] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-21T18:42:20.783341] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T18:42:20.799271] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T18:42:20.807253] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-21T18:42:20.809274] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-21T18:42:20.952099] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T18:42:20.961909] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-21T18:42:21.929782] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-21T18:42:21.935469] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-21T18:42:22.195249] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T18:42:22.281312] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-21T18:42:22.522931] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-21T18:42:22.550982] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-21T18:42:23.352931] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-21T18:42:23.355098] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-21T18:42:23.360966] [INFO ] [REMOTE ] FBK: Full fetch complete (35446 records). [2025-10-21T18:42:23.361052] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-21T18:42:23.733403] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-21T18:42:23.733476] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-21T18:42:23.734063] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-21T18:42:23.734123] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-21T18:42:23.734940] [DEBUG] [LOCAL ] FBK: Trimmed 35446 records to 27486 (keeping 200 days of data) [2025-10-21T18:42:23.899716] [DEBUG] [LOCAL ] FBK: Primary data saved (27486 records). [2025-10-21T18:42:23.899834] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-21T18:42:23.899908] [INFO ] [MAIN ] Update Progress: 801/2366 symbols completed. FBK took 14.5s. Estimated remaining: 3h 19m 56s. Rate: 7.8 symbols/min [2025-10-21T18:42:24.073838] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:42:24.123074] [DEBUG] [LOCAL ] FBP: Loaded 45752 existing records from primary storage. [2025-10-21T18:42:24.123458] [INFO ] [MAIN ] FBP: Loaded 45752 existing records. [2025-10-21T18:42:24.153609] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-21T18:42:24.329163] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:42:24.329371] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-21T18:42:24.329448] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-21T18:42:24.329979] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-21T18:42:24.330038] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-21T18:42:24.697535] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:42:24.741222] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-21T18:42:24.869535] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T18:42:24.951021] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-21T18:42:25.751026] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-21T18:42:26.543125] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-21T18:42:26.550995] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-21T18:42:26.804579] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-21T18:42:27.127166] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T18:42:27.351071] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-21T18:42:28.151018] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-21T18:42:28.421314] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T18:42:28.796868] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T18:42:28.802977] [INFO ] [REMOTE ] FAF: Full fetch complete (58233 records). [2025-10-21T18:42:28.803091] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-21T18:42:28.958959] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-21T18:42:29.216869] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-21T18:42:29.216945] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-21T18:42:29.217698] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-21T18:42:29.217760] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-21T18:42:29.218893] [DEBUG] [LOCAL ] FAF: Trimmed 58233 records to 41479 (keeping 200 days of data) [2025-10-21T18:42:29.490424] [DEBUG] [LOCAL ] FAF: Primary data saved (41479 records). [2025-10-21T18:42:29.490559] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-21T18:42:29.490661] [INFO ] [MAIN ] Update Progress: 802/2366 symbols completed. FAF took 20.1s. Estimated remaining: 3h 19m 44s. Rate: 7.8 symbols/min [2025-10-21T18:42:29.670879] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:42:29.671069] [DEBUG] [LOCAL ] FBRT: No existing data file found in primary storage. [2025-10-21T18:42:29.671118] [WARN ] [MAIN ] FBRT: No existing data found, performing full refresh instead. [2025-10-21T18:42:29.671246] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-21T18:42:29.671288] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-21T18:42:29.671330] [DEBUG] [LOCAL ] FBRT: No primary data file found to delete. [2025-10-21T18:42:29.671366] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-21T18:42:29.756186] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-21T18:42:30.030717] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:42:30.552168] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-21T18:42:30.557750] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-21T18:42:30.598990] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T18:42:31.327619] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T18:42:31.350997] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-21T18:42:32.025484] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T18:42:32.151035] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-21T18:42:32.951033] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-21T18:42:33.554776] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T18:42:33.750994] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-21T18:42:33.958994] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-21T18:42:34.212515] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T18:42:34.551034] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-21T18:42:35.351088] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-21T18:42:35.533707] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T18:42:35.541326] [INFO ] [REMOTE ] FBIN: Full fetch complete (73015 records). [2025-10-21T18:42:35.541449] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-21T18:42:35.924684] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-21T18:42:35.924768] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-21T18:42:35.925605] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-21T18:42:35.925664] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-21T18:42:35.926986] [DEBUG] [LOCAL ] FBIN: Trimmed 73015 records to 50399 (keeping 200 days of data) [2025-10-21T18:42:36.154373] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-21T18:42:36.220968] [DEBUG] [LOCAL ] FBIN: Primary data saved (50399 records). [2025-10-21T18:42:36.221076] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-21T18:42:36.221906] [INFO ] [MAIN ] Update Progress: 803/2366 symbols completed. FBIN took 26.8s. Estimated remaining: 3h 19m 35s. Rate: 7.8 symbols/min [2025-10-21T18:42:36.392827] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:42:36.409992] [DEBUG] [LOCAL ] FC: Loaded 14647 existing records from primary storage. [2025-10-21T18:42:36.410251] [INFO ] [MAIN ] FC: Loaded 14647 existing records. [2025-10-21T18:42:36.588002] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:42:36.588257] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-21T18:42:36.588334] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-21T18:42:36.588683] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-21T18:42:36.588743] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-21T18:42:36.862295] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-21T18:42:36.973318] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:42:36.954022] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-21T18:42:37.183412] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-21T18:42:37.751039] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-21T18:42:37.935111] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-21T18:42:38.464250] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T18:42:38.551017] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-21T18:42:38.658783] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T18:42:39.351016] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-21T18:42:40.151033] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-21T18:42:40.955500] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-21T18:42:40.961416] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T18:42:41.010963] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-21T18:42:41.023888] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-21T18:42:41.751087] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-21T18:42:42.424095] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-21T18:42:42.551013] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-21T18:42:42.793623] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T18:42:43.351026] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-21T18:42:43.432018] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T18:42:43.440333] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-10-21T18:42:43.440480] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-21T18:42:43.844020] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-21T18:42:43.844096] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-21T18:42:43.845000] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-21T18:42:43.845063] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-21T18:42:43.846410] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-21T18:42:44.155267] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-21T18:42:44.175569] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-10-21T18:42:44.175761] [INFO ] [MAIN ] F: Full history saved. [2025-10-21T18:42:44.175954] [INFO ] [MAIN ] Update Progress: 804/2366 symbols completed. F took 34.8s. Estimated remaining: 3h 19m 28s. Rate: 7.8 symbols/min [2025-10-21T18:42:44.359877] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:42:44.360183] [DEBUG] [LOCAL ] FCF: No existing data file found in primary storage. [2025-10-21T18:42:44.360245] [WARN ] [MAIN ] FCF: No existing data found, performing full refresh instead. [2025-10-21T18:42:44.360393] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-21T18:42:44.360437] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-21T18:42:44.360483] [DEBUG] [LOCAL ] FCF: No primary data file found to delete. [2025-10-21T18:42:44.360518] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-21T18:42:44.517925] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-21T18:42:44.731440] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:42:44.951003] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-21T18:42:45.639573] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T18:42:45.751024] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-21T18:42:46.551092] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-21T18:42:46.613182] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T18:42:47.347750] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T18:42:47.357386] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-21T18:42:47.385982] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T18:42:48.151047] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-21T18:42:48.614396] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T18:42:48.951067] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-21T18:42:49.484083] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T18:42:49.751002] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-21T18:42:50.551018] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-21T18:42:50.659237] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T18:42:50.830868] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T18:42:51.351141] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-21T18:42:52.065265] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T18:42:52.151064] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-21T18:42:52.908896] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T18:42:52.950997] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-21T18:42:53.751024] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-21T18:42:53.800088] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T18:42:54.551110] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-21T18:42:54.683919] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T18:42:54.691305] [INFO ] [REMOTE ] FBP: Full fetch complete (66723 records). [2025-10-21T18:42:54.691420] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-21T18:42:54.827174] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-21T18:42:55.105464] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-21T18:42:55.105538] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-21T18:42:55.106395] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-21T18:42:55.106465] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-21T18:42:55.107802] [DEBUG] [LOCAL ] FBP: Trimmed 66723 records to 45626 (keeping 200 days of data) [2025-10-21T18:42:55.358285] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-21T18:42:55.377887] [DEBUG] [LOCAL ] FBP: Primary data saved (45626 records). [2025-10-21T18:42:55.377974] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-21T18:42:55.378615] [INFO ] [MAIN ] Update Progress: 805/2366 symbols completed. FBP took 31.5s. Estimated remaining: 3h 19m 27s. Rate: 7.8 symbols/min [2025-10-21T18:42:55.551202] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:42:55.584403] [DEBUG] [LOCAL ] FCN: Loaded 25974 existing records from primary storage. [2025-10-21T18:42:55.585279] [INFO ] [MAIN ] FCN: Loaded 25974 existing records. [2025-10-21T18:42:55.767300] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:42:55.767575] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-21T18:42:55.767634] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-21T18:42:55.768367] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-21T18:42:55.768425] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-21T18:42:56.096474] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T18:42:56.164142] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:42:56.158663] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-21T18:42:56.950992] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-21T18:42:57.064140] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T18:42:57.411268] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T18:42:57.751002] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-21T18:42:58.079996] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-21T18:42:58.551089] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-21T18:42:59.092872] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T18:42:59.351161] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-21T18:43:00.122749] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T18:43:00.150999] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-21T18:43:00.423591] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T18:43:00.951019] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-21T18:43:01.701193] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T18:43:01.722805] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T18:43:01.751006] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-21T18:43:02.551046] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-21T18:43:02.760144] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-21T18:43:03.351038] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-21T18:43:03.657326] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T18:43:04.151031] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-21T18:43:04.393637] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T18:43:04.951048] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-21T18:43:05.751038] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-21T18:43:05.807550] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-21T18:43:05.813688] [INFO ] [REMOTE ] FBRT: Full fetch complete (49231 records). [2025-10-21T18:43:05.813827] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-21T18:43:05.814485] [FATAL] [VALIDATOR ] FBRT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:43:05.814611] [FATAL] [MAIN ] FBRT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:43:05.814722] [WARN ] [MAIN ] FBRT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:43:05.814810] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-21T18:43:05.814994] [DEBUG] [LOCAL ] FBRT: No primary data file found to delete. [2025-10-21T18:43:05.815412] [INFO ] [LOCAL ] FBRT: Starting deletion of derivative data. [2025-10-21T18:43:05.815471] [DEBUG] [LOCAL ] FBRT: No derivative data file found to delete. [2025-10-21T18:43:05.815533] [INFO ] [MAIN ] Update Progress: 806/2366 symbols completed. FBRT took 36.3s. Estimated remaining: 3h 19m 25s. Rate: 7.8 symbols/min [2025-10-21T18:43:05.993813] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:43:06.011010] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T18:43:06.049855] [DEBUG] [LOCAL ] FCPT: Loaded 37210 existing records from primary storage. [2025-10-21T18:43:06.050126] [INFO ] [MAIN ] FCPT: Loaded 37210 existing records. [2025-10-21T18:43:06.232265] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:43:06.232471] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-21T18:43:06.232518] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-21T18:43:06.233024] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-21T18:43:06.233082] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-21T18:43:06.556116] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-21T18:43:06.594752] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:43:07.237893] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T18:43:07.244402] [INFO ] [REMOTE ] FCF: Full fetch complete (58208 records). [2025-10-21T18:43:07.244547] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-21T18:43:07.356145] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-21T18:43:07.629634] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-21T18:43:07.629743] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-21T18:43:07.630536] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-21T18:43:07.630577] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-21T18:43:07.631681] [DEBUG] [LOCAL ] FCF: Trimmed 58208 records to 39218 (keeping 200 days of data) [2025-10-21T18:43:07.863044] [DEBUG] [LOCAL ] FCF: Primary data saved (39218 records). [2025-10-21T18:43:07.863183] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-21T18:43:07.863254] [INFO ] [MAIN ] Update Progress: 807/2366 symbols completed. FCF took 23.7s. Estimated remaining: 3h 19m 6s. Rate: 7.8 symbols/min [2025-10-21T18:43:08.042469] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:43:08.042766] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-21T18:43:08.042822] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-21T18:43:08.043046] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-21T18:43:08.049950] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-21T18:43:08.061142] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-21T18:43:08.061247] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-21T18:43:08.122812] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T18:43:08.156129] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-21T18:43:08.454884] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:43:08.837508] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T18:43:08.950995] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-21T18:43:09.315096] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T18:43:09.317689] [INFO ] [REMOTE ] FC: Full fetch complete (21884 records). [2025-10-21T18:43:09.317767] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-21T18:43:09.675915] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-21T18:43:09.675999] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-21T18:43:09.676451] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-21T18:43:09.676490] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-21T18:43:09.677191] [DEBUG] [LOCAL ] FC: Trimmed 21884 records to 14475 (keeping 200 days of data) [2025-10-21T18:43:09.751053] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-21T18:43:09.759069] [DEBUG] [LOCAL ] FC: Primary data saved (14475 records). [2025-10-21T18:43:09.759227] [INFO ] [MAIN ] FC: Full history saved. [2025-10-21T18:43:09.759495] [INFO ] [MAIN ] Update Progress: 808/2366 symbols completed. FC took 33.5s. Estimated remaining: 3h 18m 47s. Rate: 7.8 symbols/min [2025-10-21T18:43:09.926671] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:43:09.941284] [DEBUG] [LOCAL ] FCT: Loaded 14667 existing records from primary storage. [2025-10-21T18:43:09.941463] [INFO ] [MAIN ] FCT: Loaded 14667 existing records. [2025-10-21T18:43:10.120214] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:43:10.120392] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-21T18:43:10.120436] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-21T18:43:10.120692] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-21T18:43:10.120748] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-21T18:43:10.497466] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:43:10.492577] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T18:43:10.551009] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-21T18:43:11.219157] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T18:43:11.351065] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-21T18:43:11.947765] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T18:43:12.151009] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-21T18:43:12.630045] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-21T18:43:12.951051] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-21T18:43:13.168419] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T18:43:13.751063] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-21T18:43:13.849980] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-21T18:43:14.551039] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-21T18:43:15.057931] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-21T18:43:15.279570] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T18:43:15.351050] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-21T18:43:16.151028] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-21T18:43:16.492395] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-21T18:43:16.529927] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T18:43:16.951066] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-21T18:43:17.751078] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-21T18:43:18.419181] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-21T18:43:18.551000] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-21T18:43:18.854390] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-21T18:43:19.351082] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-21T18:43:20.102983] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T18:43:20.138369] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T18:43:20.150978] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-21T18:43:20.951000] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-21T18:43:21.173372] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-21T18:43:21.270479] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-21T18:43:21.751020] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-21T18:43:22.039842] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-21T18:43:22.551029] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-21T18:43:23.351041] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-21T18:43:23.940046] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T18:43:24.151002] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-21T18:43:24.462319] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T18:43:24.951013] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-21T18:43:25.486861] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T18:43:25.751013] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-21T18:43:25.771877] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T18:43:26.551030] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-21T18:43:26.971834] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-21T18:43:27.269209] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T18:43:27.350994] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-21T18:43:27.775945] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-21T18:43:28.151018] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-21T18:43:28.950995] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-21T18:43:29.176439] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-21T18:43:29.751076] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-21T18:43:30.421372] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T18:43:30.427493] [INFO ] [REMOTE ] FCPT: Full fetch complete (53805 records). [2025-10-21T18:43:30.427602] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-21T18:43:30.556083] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-21T18:43:30.749309] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-21T18:43:30.799474] [INFO ] [REMOTE ] FCT: Full fetch complete (21160 records). [2025-10-21T18:43:30.800869] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-21T18:43:30.897576] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-21T18:43:30.903347] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-21T18:43:30.909909] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-21T18:43:30.915100] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-21T18:43:30.963881] [DEBUG] [LOCAL ] FCPT: Trimmed 53805 records to 37077 (keeping 200 days of data) [2025-10-21T18:43:31.120830] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-21T18:43:31.348015] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-21T18:43:31.350309] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-21T18:43:31.357103] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-21T18:43:31.356356] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-21T18:43:31.357336] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-21T18:43:31.431841] [DEBUG] [LOCAL ] FCT: Trimmed 21160 records to 14677 (keeping 200 days of data) [2025-10-21T18:43:31.540966] [DEBUG] [LOCAL ] FCPT: Primary data saved (37077 records). [2025-10-21T18:43:31.549351] [DEBUG] [LOCAL ] FCT: Primary data saved (14677 records). [2025-10-21T18:43:31.549432] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-21T18:43:31.549595] [INFO ] [MAIN ] Update Progress: 809/2366 symbols completed. FCPT took 25.7s. Estimated remaining: 3h 19m 7s. Rate: 7.8 symbols/min [2025-10-21T18:43:31.549713] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-21T18:43:31.581520] [INFO ] [MAIN ] Update Progress: 810/2366 symbols completed. FCT took 21.8s. Estimated remaining: 3h 18m 45s. Rate: 7.8 symbols/min [2025-10-21T18:43:31.793569] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-21T18:43:31.881661] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:43:31.898528] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:43:31.929491] [DEBUG] [LOCAL ] FDP: Loaded 29728 existing records from primary storage. [2025-10-21T18:43:31.929787] [INFO ] [MAIN ] FDP: Loaded 29728 existing records. [2025-10-21T18:43:32.119733] [DEBUG] [LOCAL ] FCX: Loaded 53701 existing records from primary storage. [2025-10-21T18:43:32.140579] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:43:32.140824] [INFO ] [MAIN ] FCX: Loaded 53701 existing records. [2025-10-21T18:43:32.161034] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-21T18:43:32.161168] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-21T18:43:32.170116] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-21T18:43:32.183709] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-21T18:43:32.205595] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-21T18:43:32.486259] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:43:32.502819] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-21T18:43:32.513125] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-21T18:43:32.530913] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-21T18:43:32.541289] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-21T18:43:32.745485] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T18:43:32.905753] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:43:32.960928] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-21T18:43:33.085897] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:43:33.751020] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-21T18:43:34.292934] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T18:43:34.551029] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-21T18:43:35.142204] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T18:43:35.212718] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-21T18:43:35.213358] [INFO ] [REMOTE ] FCRX: Full fetch complete (1643 records). [2025-10-21T18:43:35.213423] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-21T18:43:35.356853] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-21T18:43:35.398281] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-21T18:43:35.398440] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:43:35.398506] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:43:35.398587] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-21T18:43:35.398688] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-21T18:43:35.398742] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-21T18:43:35.398785] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-21T18:43:35.398839] [INFO ] [MAIN ] Update Progress: 811/2366 symbols completed. FCRX took 27.5s. Estimated remaining: 3h 18m 30s. Rate: 7.8 symbols/min [2025-10-21T18:43:35.566306] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:43:35.593898] [DEBUG] [LOCAL ] FDS: Loaded 27869 existing records from primary storage. [2025-10-21T18:43:35.594147] [INFO ] [MAIN ] FDS: Loaded 27869 existing records. [2025-10-21T18:43:35.774690] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:43:35.774904] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-21T18:43:35.774950] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-21T18:43:35.775224] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-21T18:43:35.775287] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-21T18:43:36.135575] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:43:36.150975] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-21T18:43:36.951068] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-21T18:43:37.706878] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T18:43:37.750983] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-21T18:43:37.873374] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-21T18:43:38.056549] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-21T18:43:38.551020] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-21T18:43:38.904028] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-21T18:43:39.350988] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-21T18:43:39.635778] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-21T18:43:40.150990] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-21T18:43:40.443037] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-21T18:43:40.951012] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-21T18:43:41.035958] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T18:43:41.040128] [INFO ] [REMOTE ] FCN: Full fetch complete (36109 records). [2025-10-21T18:43:41.040205] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-21T18:43:41.417090] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-21T18:43:41.417168] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-21T18:43:41.417785] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-21T18:43:41.417847] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-21T18:43:41.418676] [DEBUG] [LOCAL ] FCN: Trimmed 36109 records to 25874 (keeping 200 days of data) [2025-10-21T18:43:41.566144] [DEBUG] [LOCAL ] FCN: Primary data saved (25874 records). [2025-10-21T18:43:41.566259] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-21T18:43:41.566333] [INFO ] [MAIN ] Update Progress: 812/2366 symbols completed. FCN took 46.2s. Estimated remaining: 3h 18m 19s. Rate: 7.8 symbols/min [2025-10-21T18:43:41.733274] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:43:41.761318] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-21T18:43:41.783149] [DEBUG] [LOCAL ] FDX: Loaded 51326 existing records from primary storage. [2025-10-21T18:43:41.783442] [INFO ] [MAIN ] FDX: Loaded 51326 existing records. [2025-10-21T18:43:41.961813] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:43:41.962001] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-21T18:43:41.962048] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-21T18:43:41.962546] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-21T18:43:41.962587] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-21T18:43:42.350509] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T18:43:42.349675] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:43:42.551035] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-21T18:43:43.351046] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-21T18:43:44.151002] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-21T18:43:44.302056] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-10-21T18:43:44.679347] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T18:43:44.879692] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-21T18:43:44.951126] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-21T18:43:45.391438] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T18:43:45.751083] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-21T18:43:46.551090] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-21T18:43:46.617214] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T18:43:47.070431] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T18:43:47.351050] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-21T18:43:47.584547] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T18:43:48.151023] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-21T18:43:48.951037] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-21T18:43:49.362790] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T18:43:49.367951] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-21T18:43:49.751069] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-21T18:43:49.804384] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T18:43:50.551005] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-21T18:43:51.351000] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-21T18:43:51.649504] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-21T18:43:52.151031] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-21T18:43:52.780633] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T18:43:52.950983] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-21T18:43:53.015434] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-21T18:43:53.250686] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T18:43:53.751048] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-21T18:43:54.421232] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T18:43:54.551038] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-21T18:43:55.350995] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-21T18:43:55.700019] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-21T18:43:55.744783] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-21T18:43:56.151070] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-21T18:43:56.951019] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-21T18:43:57.130513] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-21T18:43:57.570552] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-21T18:43:57.751039] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-21T18:43:58.550995] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-21T18:43:58.853292] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-21T18:43:59.351077] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-21T18:43:59.852360] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-21T18:43:59.919249] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T18:44:00.151067] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-21T18:44:00.951022] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-21T18:44:01.764670] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-21T18:44:01.790237] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-21T18:44:02.320915] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-21T18:44:02.550999] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-21T18:44:02.869579] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-21T18:44:03.119400] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T18:44:03.123901] [INFO ] [REMOTE ] FDP: Full fetch complete (42841 records). [2025-10-21T18:44:03.123980] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-21T18:44:03.356260] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-21T18:44:03.498228] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-21T18:44:03.498302] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-21T18:44:03.499005] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-21T18:44:03.499068] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-21T18:44:03.499972] [DEBUG] [LOCAL ] FDP: Trimmed 42841 records to 29749 (keeping 200 days of data) [2025-10-21T18:44:03.674619] [DEBUG] [LOCAL ] FDP: Primary data saved (29749 records). [2025-10-21T18:44:03.674787] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-21T18:44:03.675248] [INFO ] [MAIN ] Update Progress: 813/2366 symbols completed. FDP took 32.1s. Estimated remaining: 3h 18m 39s. Rate: 7.8 symbols/min [2025-10-21T18:44:03.840712] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:44:03.894536] [DEBUG] [LOCAL ] FE: Loaded 53436 existing records from primary storage. [2025-10-21T18:44:03.894943] [INFO ] [MAIN ] FE: Loaded 53436 existing records. [2025-10-21T18:44:04.079092] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:44:04.079383] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-21T18:44:04.079547] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-21T18:44:04.080146] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-21T18:44:04.080215] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-21T18:44:04.156211] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-21T18:44:04.457621] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-21T18:44:04.488560] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:44:04.951054] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-21T18:44:05.114143] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-21T18:44:05.120443] [INFO ] [REMOTE ] FDS: Full fetch complete (39230 records). [2025-10-21T18:44:05.120567] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-21T18:44:05.492998] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-21T18:44:05.493076] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-21T18:44:05.493705] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-21T18:44:05.493764] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-21T18:44:05.494597] [DEBUG] [LOCAL ] FDS: Trimmed 39230 records to 28015 (keeping 200 days of data) [2025-10-21T18:44:05.668193] [DEBUG] [LOCAL ] FDS: Primary data saved (28015 records). [2025-10-21T18:44:05.668321] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-21T18:44:05.668398] [INFO ] [MAIN ] Update Progress: 814/2366 symbols completed. FDS took 30.3s. Estimated remaining: 3h 18m 20s. Rate: 7.8 symbols/min [2025-10-21T18:44:05.763638] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-21T18:44:05.844862] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:44:05.845030] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-21T18:44:05.845073] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-21T18:44:05.845175] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-21T18:44:05.845216] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-21T18:44:05.845256] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-21T18:44:05.845286] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-21T18:44:06.197289] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:44:06.550998] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-21T18:44:06.659469] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T18:44:06.706231] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-21T18:44:07.012695] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-21T18:44:07.350990] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-21T18:44:07.908756] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-21T18:44:07.911559] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-21T18:44:08.151016] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-21T18:44:08.951047] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-21T18:44:09.751062] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-21T18:44:10.239511] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-21T18:44:10.551060] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-21T18:44:10.892434] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-21T18:44:10.900159] [INFO ] [REMOTE ] FDX: Full fetch complete (74287 records). [2025-10-21T18:44:10.900287] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-21T18:44:11.287372] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-21T18:44:11.287530] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-21T18:44:11.288461] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-21T18:44:11.288538] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-21T18:44:11.289967] [DEBUG] [LOCAL ] FDX: Trimmed 74287 records to 51271 (keeping 200 days of data) [2025-10-21T18:44:11.355430] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-21T18:44:11.573336] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T18:44:11.650194] [DEBUG] [LOCAL ] FDX: Primary data saved (51271 records). [2025-10-21T18:44:11.650289] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-21T18:44:11.650821] [INFO ] [MAIN ] Update Progress: 815/2366 symbols completed. FDX took 30.1s. Estimated remaining: 3h 18m 10s. Rate: 7.8 symbols/min [2025-10-21T18:44:11.740754] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-21T18:44:11.825705] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:44:11.872755] [DEBUG] [LOCAL ] FERG: Loaded 48769 existing records from primary storage. [2025-10-21T18:44:11.873025] [INFO ] [MAIN ] FERG: Loaded 48769 existing records. [2025-10-21T18:44:12.052622] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:44:12.052873] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-21T18:44:12.052929] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-21T18:44:12.053124] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-21T18:44:12.053181] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-21T18:44:12.156319] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-21T18:44:12.422981] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:44:12.556847] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-21T18:44:12.639488] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-21T18:44:12.950995] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-21T18:44:13.751022] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-21T18:44:14.551064] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-21T18:44:14.617059] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T18:44:14.626570] [INFO ] [REMOTE ] FCX: Full fetch complete (77878 records). [2025-10-21T18:44:14.626755] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-21T18:44:15.058687] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-21T18:44:15.060541] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-21T18:44:15.058906] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-21T18:44:15.071471] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-21T18:44:15.073101] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-21T18:44:15.073223] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-21T18:44:15.074755] [DEBUG] [LOCAL ] FCX: Trimmed 77878 records to 53701 (keeping 200 days of data) [2025-10-21T18:44:15.354667] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-21T18:44:15.405498] [DEBUG] [LOCAL ] FCX: Primary data saved (53701 records). [2025-10-21T18:44:15.405667] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-21T18:44:15.405768] [INFO ] [MAIN ] Update Progress: 816/2366 symbols completed. FCX took 43.9s. Estimated remaining: 3h 17m 55s. Rate: 7.8 symbols/min [2025-10-21T18:44:15.572274] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:44:15.586974] [DEBUG] [LOCAL ] FET: Loaded 12965 existing records from primary storage. [2025-10-21T18:44:15.587198] [INFO ] [MAIN ] FET: Loaded 12965 existing records. [2025-10-21T18:44:15.688749] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-21T18:44:15.765098] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:44:15.765328] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-21T18:44:15.765374] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-21T18:44:15.765521] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-21T18:44:15.765558] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-21T18:44:16.111847] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:44:16.150980] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-21T18:44:16.951018] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-21T18:44:17.123470] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T18:44:17.751021] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-21T18:44:18.520670] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T18:44:18.550986] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-21T18:44:18.897744] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T18:44:19.351004] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-21T18:44:19.464501] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-21T18:44:20.151054] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-21T18:44:20.951004] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-21T18:44:21.150300] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T18:44:21.171610] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-21T18:44:21.417512] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-21T18:44:21.751026] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-21T18:44:22.551021] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-21T18:44:22.910227] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-21T18:44:23.299626] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T18:44:23.350973] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-21T18:44:24.151021] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-21T18:44:24.535369] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-21T18:44:24.951077] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-21T18:44:25.162085] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T18:44:25.751047] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-21T18:44:26.455997] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-21T18:44:26.487990] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T18:44:26.550991] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-21T18:44:27.351023] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-21T18:44:28.156207] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-21T18:44:28.176770] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T18:44:28.270571] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-21T18:44:28.951069] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-21T18:44:29.407731] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-21T18:44:29.408618] [INFO ] [REMOTE ] FENG: Full fetch complete (2282 records). [2025-10-21T18:44:29.408716] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-21T18:44:29.596134] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T18:44:29.596317] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:44:29.596384] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:44:29.596432] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-21T18:44:29.596486] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-21T18:44:29.596521] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-21T18:44:29.596559] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-21T18:44:29.596613] [INFO ] [MAIN ] Update Progress: 817/2366 symbols completed. FENG took 23.9s. Estimated remaining: 3h 17m 59s. Rate: 7.8 symbols/min [2025-10-21T18:44:29.750991] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-21T18:44:29.770891] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:44:29.793160] [DEBUG] [LOCAL ] FF: Loaded 24052 existing records from primary storage. [2025-10-21T18:44:29.793399] [INFO ] [MAIN ] FF: Loaded 24052 existing records. [2025-10-21T18:44:29.991325] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:44:29.991617] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-21T18:44:29.991780] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-21T18:44:29.992003] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-21T18:44:29.992060] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-21T18:44:30.373598] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:44:30.375684] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-21T18:44:30.551007] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-21T18:44:30.716274] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-21T18:44:31.351034] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-21T18:44:31.754560] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T18:44:32.151044] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-21T18:44:32.951034] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-21T18:44:32.991777] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T18:44:33.333048] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T18:44:33.751085] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-21T18:44:33.897095] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-21T18:44:34.551074] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-21T18:44:35.108022] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T18:44:35.351028] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-21T18:44:36.151022] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-21T18:44:36.593380] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-21T18:44:36.669557] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T18:44:36.951029] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-21T18:44:37.751203] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-21T18:44:37.812208] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T18:44:37.958062] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-21T18:44:38.551077] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-21T18:44:39.351037] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-21T18:44:39.567997] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T18:44:40.150992] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-21T18:44:40.334731] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T18:44:40.368709] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T18:44:40.371260] [INFO ] [REMOTE ] FET: Full fetch complete (18419 records). [2025-10-21T18:44:40.371328] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-21T18:44:40.726282] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-21T18:44:40.726356] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-21T18:44:40.726718] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-21T18:44:40.726780] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-21T18:44:40.727284] [DEBUG] [LOCAL ] FET: Trimmed 18419 records to 12922 (keeping 200 days of data) [2025-10-21T18:44:40.800296] [DEBUG] [LOCAL ] FET: Primary data saved (12922 records). [2025-10-21T18:44:40.800416] [INFO ] [MAIN ] FET: Full history saved. [2025-10-21T18:44:40.800490] [INFO ] [MAIN ] Update Progress: 818/2366 symbols completed. FET took 25.4s. Estimated remaining: 3h 17m 58s. Rate: 7.8 symbols/min [2025-10-21T18:44:40.957098] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-21T18:44:40.967948] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:44:40.968109] [DEBUG] [LOCAL ] FFA: No existing data file found in primary storage. [2025-10-21T18:44:40.968153] [WARN ] [MAIN ] FFA: No existing data found, performing full refresh instead. [2025-10-21T18:44:40.968255] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-21T18:44:40.968297] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-21T18:44:40.968394] [DEBUG] [LOCAL ] FFA: No primary data file found to delete. [2025-10-21T18:44:40.968433] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-21T18:44:41.316524] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:44:41.751006] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-21T18:44:42.134012] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T18:44:42.223621] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T18:44:42.551095] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-21T18:44:43.029089] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T18:44:43.351121] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-21T18:44:43.434557] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T18:44:43.443188] [INFO ] [REMOTE ] FE: Full fetch complete (77477 records). [2025-10-21T18:44:43.443342] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-21T18:44:43.861850] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-21T18:44:43.861941] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-21T18:44:43.862898] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-21T18:44:43.862974] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-21T18:44:43.864454] [DEBUG] [LOCAL ] FE: Trimmed 77477 records to 53434 (keeping 200 days of data) [2025-10-21T18:44:44.162169] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-21T18:44:44.187086] [DEBUG] [LOCAL ] FE: Primary data saved (53434 records). [2025-10-21T18:44:44.187192] [INFO ] [MAIN ] FE: Full history saved. [2025-10-21T18:44:44.187728] [INFO ] [MAIN ] Update Progress: 819/2366 symbols completed. FE took 40.5s. Estimated remaining: 3h 17m 42s. Rate: 7.8 symbols/min [2025-10-21T18:44:44.368531] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:44:44.386855] [DEBUG] [LOCAL ] FFC: Loaded 16622 existing records from primary storage. [2025-10-21T18:44:44.387084] [INFO ] [MAIN ] FFC: Loaded 16622 existing records. [2025-10-21T18:44:44.569921] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:44:44.570135] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-21T18:44:44.570183] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-21T18:44:44.570332] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-21T18:44:44.570370] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-21T18:44:44.949436] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:44:44.950978] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-21T18:44:45.189058] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T18:44:45.321741] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T18:44:45.751060] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-21T18:44:46.390223] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T18:44:46.551026] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-21T18:44:46.857702] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-21T18:44:47.351092] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-21T18:44:47.931984] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T18:44:48.151007] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-21T18:44:48.535186] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-21T18:44:48.542770] [INFO ] [REMOTE ] FERG: Full fetch complete (71205 records). [2025-10-21T18:44:48.542876] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-21T18:44:48.943790] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-21T18:44:48.950940] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-21T18:44:48.952149] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-21T18:44:48.953188] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-21T18:44:48.951041] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-21T18:44:48.955079] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-21T18:44:48.960907] [DEBUG] [LOCAL ] FERG: Trimmed 71205 records to 48749 (keeping 200 days of data) [2025-10-21T18:44:49.259937] [DEBUG] [LOCAL ] FERG: Primary data saved (48749 records). [2025-10-21T18:44:49.260072] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-21T18:44:49.260841] [INFO ] [MAIN ] Update Progress: 820/2366 symbols completed. FERG took 37.6s. Estimated remaining: 3h 17m 30s. Rate: 7.8 symbols/min [2025-10-21T18:44:49.430252] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:44:49.464892] [DEBUG] [LOCAL ] FFWM: Loaded 35833 existing records from primary storage. [2025-10-21T18:44:49.465148] [INFO ] [MAIN ] FFWM: Loaded 35833 existing records. [2025-10-21T18:44:49.692246] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:44:49.692990] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-21T18:44:49.693310] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-21T18:44:49.695684] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-21T18:44:49.695968] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-21T18:44:49.696040] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-21T18:44:49.760865] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-21T18:44:50.049967] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:44:50.551009] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-21T18:44:50.977587] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-21T18:44:51.351053] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-21T18:44:51.563514] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-21T18:44:52.151034] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-21T18:44:52.735446] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T18:44:52.800243] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-21T18:44:52.951046] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-21T18:44:53.751004] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-21T18:44:54.140995] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T18:44:54.514255] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-21T18:44:54.551038] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-21T18:44:55.060623] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-21T18:44:55.351059] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-21T18:44:55.925776] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-21T18:44:56.151094] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-21T18:44:56.763738] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-21T18:44:56.950997] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-21T18:44:57.751026] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-21T18:44:58.306555] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-21T18:44:58.551000] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-21T18:44:58.933514] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-21T18:44:58.938879] [INFO ] [REMOTE ] FF: Full fetch complete (36594 records). [2025-10-21T18:44:58.938988] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-21T18:44:59.321083] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-21T18:44:59.321159] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-21T18:44:59.321754] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-21T18:44:59.321814] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-21T18:44:59.322676] [DEBUG] [LOCAL ] FF: Trimmed 36594 records to 23879 (keeping 200 days of data) [2025-10-21T18:44:59.369590] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-21T18:44:59.458480] [DEBUG] [LOCAL ] FF: Primary data saved (23879 records). [2025-10-21T18:44:59.458596] [INFO ] [MAIN ] FF: Full history saved. [2025-10-21T18:44:59.458691] [INFO ] [MAIN ] Update Progress: 821/2366 symbols completed. FF took 29.9s. Estimated remaining: 3h 17m 27s. Rate: 7.8 symbols/min [2025-10-21T18:44:59.625233] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:44:59.646001] [DEBUG] [LOCAL ] FG: Loaded 21737 existing records from primary storage. [2025-10-21T18:44:59.646239] [INFO ] [MAIN ] FG: Loaded 21737 existing records. [2025-10-21T18:44:59.773187] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T18:44:59.837758] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:44:59.837968] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-21T18:44:59.838019] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-21T18:44:59.838199] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-21T18:44:59.838238] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-21T18:45:00.156127] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-21T18:45:00.197371] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:45:00.921357] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T18:45:00.951050] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-21T18:45:01.179808] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-21T18:45:01.751104] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-21T18:45:02.241878] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T18:45:02.551034] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-21T18:45:03.351032] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-21T18:45:03.747806] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-21T18:45:03.841953] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T18:45:04.151039] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-21T18:45:04.951102] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-21T18:45:05.102077] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T18:45:05.551541] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T18:45:05.750983] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-21T18:45:06.033739] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T18:45:06.556008] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-21T18:45:06.558693] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-21T18:45:07.354467] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-21T18:45:07.355226] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T18:45:07.357989] [INFO ] [REMOTE ] FFA: Full fetch complete (8625 records). [2025-10-21T18:45:07.358066] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-21T18:45:07.358430] [FATAL] [VALIDATOR ] FFA: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:45:07.358533] [FATAL] [MAIN ] FFA: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:45:07.358576] [WARN ] [MAIN ] FFA: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:45:07.358621] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-21T18:45:07.358709] [DEBUG] [LOCAL ] FFA: No primary data file found to delete. [2025-10-21T18:45:07.358757] [INFO ] [LOCAL ] FFA: Starting deletion of derivative data. [2025-10-21T18:45:07.358799] [DEBUG] [LOCAL ] FFA: No derivative data file found to delete. [2025-10-21T18:45:07.358850] [INFO ] [MAIN ] Update Progress: 822/2366 symbols completed. FFA took 26.6s. Estimated remaining: 3h 17m 20s. Rate: 7.8 symbols/min [2025-10-21T18:45:07.529264] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:45:07.535082] [DEBUG] [LOCAL ] FGN: Loaded 3636 existing records from primary storage. [2025-10-21T18:45:07.535260] [INFO ] [MAIN ] FGN: Loaded 3636 existing records. [2025-10-21T18:45:07.716552] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:45:07.716895] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-21T18:45:07.716952] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-21T18:45:07.717204] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-21T18:45:07.717261] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-21T18:45:08.061997] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:45:08.150986] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-21T18:45:08.443694] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T18:45:08.937851] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-21T18:45:08.950981] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-21T18:45:09.438925] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-21T18:45:09.751056] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-21T18:45:10.551024] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-21T18:45:11.238485] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T18:45:11.351075] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-21T18:45:11.786966] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T18:45:12.150989] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-21T18:45:12.628696] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-21T18:45:12.806458] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-21T18:45:12.951029] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-21T18:45:13.390105] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-21T18:45:13.751074] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-21T18:45:14.551028] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-21T18:45:15.289807] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T18:45:15.350988] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-21T18:45:16.151003] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-21T18:45:16.277458] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T18:45:16.462966] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-21T18:45:16.692881] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-21T18:45:16.951063] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-21T18:45:17.751051] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-21T18:45:17.970041] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-21T18:45:18.551036] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-21T18:45:18.787140] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T18:45:19.293219] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-21T18:45:19.351039] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-21T18:45:20.151004] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-21T18:45:20.464935] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-21T18:45:20.951059] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-21T18:45:21.478992] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T18:45:21.751030] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-21T18:45:22.008992] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-21T18:45:22.011934] [INFO ] [REMOTE ] FFC: Full fetch complete (24454 records). [2025-10-21T18:45:22.012099] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-21T18:45:22.398760] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-21T18:45:22.399069] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-21T18:45:22.399021] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-21T18:45:22.399836] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-21T18:45:22.401850] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-21T18:45:22.402963] [DEBUG] [LOCAL ] FFC: Trimmed 24454 records to 16617 (keeping 200 days of data) [2025-10-21T18:45:22.500783] [DEBUG] [LOCAL ] FFC: Primary data saved (16617 records). [2025-10-21T18:45:22.500912] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-21T18:45:22.500987] [INFO ] [MAIN ] Update Progress: 823/2366 symbols completed. FFC took 38.3s. Estimated remaining: 3h 17m 26s. Rate: 7.8 symbols/min [2025-10-21T18:45:22.556370] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-21T18:45:22.670555] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:45:22.670736] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-21T18:45:22.670780] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-21T18:45:22.670919] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-21T18:45:22.670959] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-21T18:45:22.671015] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-21T18:45:22.671047] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-21T18:45:23.018712] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:45:23.351058] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-21T18:45:23.651994] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-21T18:45:24.150999] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-21T18:45:24.648604] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T18:45:24.951018] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-21T18:45:24.975028] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T18:45:24.978568] [INFO ] [REMOTE ] FG: Full fetch complete (28917 records). [2025-10-21T18:45:24.978678] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-21T18:45:25.349237] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-21T18:45:25.349310] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-21T18:45:25.349860] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-21T18:45:25.349921] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-21T18:45:25.350561] [DEBUG] [LOCAL ] FG: Trimmed 28917 records to 21549 (keeping 200 days of data) [2025-10-21T18:45:25.481681] [DEBUG] [LOCAL ] FG: Primary data saved (21549 records). [2025-10-21T18:45:25.481803] [INFO ] [MAIN ] FG: Full history saved. [2025-10-21T18:45:25.481875] [INFO ] [MAIN ] Update Progress: 824/2366 symbols completed. FG took 26.0s. Estimated remaining: 3h 17m 10s. Rate: 7.8 symbols/min [2025-10-21T18:45:25.567488] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-21T18:45:25.659524] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:45:25.697196] [DEBUG] [LOCAL ] FHI: Loaded 39793 existing records from primary storage. [2025-10-21T18:45:25.697476] [INFO ] [MAIN ] FHI: Loaded 39793 existing records. [2025-10-21T18:45:25.758785] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-21T18:45:25.880052] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:45:25.880276] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-21T18:45:25.880323] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-21T18:45:25.880602] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-21T18:45:25.880701] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-21T18:45:26.240521] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:45:26.551062] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-10-21T18:45:27.244072] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T18:45:27.249505] [INFO ] [REMOTE ] FFWM: Full fetch complete (51684 records). [2025-10-21T18:45:27.249634] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-21T18:45:27.250258] [FATAL] [VALIDATOR ] FFWM: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:45:27.250347] [FATAL] [MAIN ] FFWM: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:45:27.250391] [WARN ] [MAIN ] FFWM: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:45:27.250453] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-21T18:45:27.250514] [DEBUG] [LOCAL ] FFWM: No primary data file found to delete. [2025-10-21T18:45:27.250610] [INFO ] [LOCAL ] FFWM: Starting deletion of derivative data. [2025-10-21T18:45:27.250830] [DEBUG] [LOCAL ] FFWM: Deleted derivative data file. [2025-10-21T18:45:27.251279] [INFO ] [MAIN ] Update Progress: 825/2366 symbols completed. FFWM took 38.0s. Estimated remaining: 3h 16m 51s. Rate: 7.8 symbols/min [2025-10-21T18:45:27.353148] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-21T18:45:27.405448] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-21T18:45:27.462418] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:45:27.513158] [DEBUG] [LOCAL ] FHN: Loaded 53394 existing records from primary storage. [2025-10-21T18:45:27.513453] [INFO ] [MAIN ] FHN: Loaded 53394 existing records. [2025-10-21T18:45:27.688796] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:45:27.688973] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-21T18:45:27.689019] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-21T18:45:27.689489] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-21T18:45:27.689544] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-21T18:45:28.028984] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-21T18:45:28.051304] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:45:28.151006] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-21T18:45:28.951021] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-10-21T18:45:29.598120] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-21T18:45:29.751029] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-21T18:45:30.037472] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-21T18:45:30.298448] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-21T18:45:30.551034] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-21T18:45:31.054023] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-21T18:45:31.054983] [INFO ] [REMOTE ] FGN: Full fetch complete (5539 records). [2025-10-21T18:45:31.055053] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-21T18:45:31.356305] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-10-21T18:45:31.451690] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-21T18:45:31.451775] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-21T18:45:31.451925] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-21T18:45:31.451962] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-21T18:45:31.452311] [DEBUG] [LOCAL ] FGN: Trimmed 5539 records to 3610 (keeping 200 days of data) [2025-10-21T18:45:31.473583] [DEBUG] [LOCAL ] FGN: Primary data saved (3610 records). [2025-10-21T18:45:31.473663] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-21T18:45:31.473749] [INFO ] [MAIN ] Update Progress: 826/2366 symbols completed. FGN took 24.1s. Estimated remaining: 3h 16m 37s. Rate: 7.8 symbols/min [2025-10-21T18:45:31.640115] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:45:31.695168] [DEBUG] [LOCAL ] FI: Loaded 53585 existing records from primary storage. [2025-10-21T18:45:31.695702] [INFO ] [MAIN ] FI: Loaded 53585 existing records. [2025-10-21T18:45:31.880256] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:45:31.880453] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-21T18:45:31.880520] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-21T18:45:31.881162] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-21T18:45:31.881218] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-21T18:45:31.991237] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-21T18:45:32.157972] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-10-21T18:45:32.248669] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:45:32.895900] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-21T18:45:32.951022] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-21T18:45:33.751028] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-21T18:45:34.551105] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-21T18:45:34.828989] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T18:45:35.184778] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-21T18:45:35.351067] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-21T18:45:36.151043] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-21T18:45:36.365408] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T18:45:36.912195] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T18:45:36.950990] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-21T18:45:37.755287] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-10-21T18:45:37.761001] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-21T18:45:38.384993] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-21T18:45:38.422139] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-21T18:45:38.551007] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-21T18:45:39.351001] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-10-21T18:45:39.980360] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-21T18:45:40.151029] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-21T18:45:40.355343] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T18:45:40.951050] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-10-21T18:45:41.313297] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-21T18:45:41.559070] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T18:45:41.751038] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-10-21T18:45:42.097985] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-21T18:45:42.551022] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-21T18:45:43.351025] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-10-21T18:45:43.931097] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T18:45:43.956069] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T18:45:44.151074] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-10. [2025-10-21T18:45:44.944336] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T18:45:44.945551] [INFO ] [REMOTE ] FGSN: Full fetch complete (8057 records). [2025-10-21T18:45:44.945688] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-10-21T18:45:44.957012] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-21T18:45:45.128147] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-21T18:45:45.128402] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:45:45.128469] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:45:45.128540] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-21T18:45:45.128601] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-21T18:45:45.128636] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-21T18:45:45.128734] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-21T18:45:45.128796] [INFO ] [MAIN ] Update Progress: 827/2366 symbols completed. FGSN took 22.6s. Estimated remaining: 3h 16m 40s. Rate: 7.8 symbols/min [2025-10-21T18:45:45.297167] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:45:45.325371] [DEBUG] [LOCAL ] FICO: Loaded 21862 existing records from primary storage. [2025-10-21T18:45:45.325632] [INFO ] [MAIN ] FICO: Loaded 21862 existing records. [2025-10-21T18:45:45.506997] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:45:45.507212] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-21T18:45:45.507259] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-21T18:45:45.507417] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-21T18:45:45.507454] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-21T18:45:45.759023] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-21T18:45:45.887913] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:45:46.551051] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-21T18:45:47.001312] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-21T18:45:47.306361] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T18:45:47.350988] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-21T18:45:48.151125] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-21T18:45:48.204214] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T18:45:48.590603] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T18:45:48.951114] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-21T18:45:49.751020] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-21T18:45:50.074131] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-21T18:45:50.551046] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-21T18:45:50.761550] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T18:45:50.989305] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T18:45:51.350995] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-21T18:45:52.068265] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T18:45:52.151066] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-21T18:45:52.951032] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-21T18:45:53.029257] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T18:45:53.587120] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-21T18:45:53.592829] [INFO ] [REMOTE ] FHI: Full fetch complete (57551 records). [2025-10-21T18:45:53.592929] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-21T18:45:53.764384] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-21T18:45:53.972519] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-21T18:45:53.972609] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-21T18:45:53.973412] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-21T18:45:53.973476] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-21T18:45:53.974737] [DEBUG] [LOCAL ] FHI: Trimmed 57551 records to 39612 (keeping 200 days of data) [2025-10-21T18:45:54.208893] [DEBUG] [LOCAL ] FHI: Primary data saved (39612 records). [2025-10-21T18:45:54.209033] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-21T18:45:54.209112] [INFO ] [MAIN ] Update Progress: 828/2366 symbols completed. FHI took 28.7s. Estimated remaining: 3h 16m 35s. Rate: 7.8 symbols/min [2025-10-21T18:45:54.381437] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:45:54.381616] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-21T18:45:54.381694] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-21T18:45:54.381820] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-21T18:45:54.381883] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-21T18:45:54.381951] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-21T18:45:54.381985] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-21T18:45:54.553956] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-21T18:45:54.749239] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:45:55.150924] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-21T18:45:55.351077] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-21T18:45:55.665825] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T18:45:55.866474] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-21T18:45:56.151054] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-21T18:45:56.951018] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-21T18:45:57.375716] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-21T18:45:57.751002] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-21T18:45:57.888163] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T18:45:57.980275] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-21T18:45:58.110720] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-21T18:45:58.551023] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-21T18:45:59.351047] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-21T18:45:59.591826] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-21T18:45:59.803838] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T18:46:00.151021] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-21T18:46:00.412483] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-21T18:46:00.951068] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-21T18:46:01.434093] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-21T18:46:01.751080] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-21T18:46:02.551052] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-21T18:46:02.819559] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-21T18:46:03.030038] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T18:46:03.351028] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-21T18:46:04.151053] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-21T18:46:04.460382] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-21T18:46:04.951077] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-21T18:46:05.751065] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-21T18:46:05.966888] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T18:46:05.967345] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-21T18:46:05.967445] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:46:05.967539] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-21T18:46:05.967608] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:46:05.967708] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-21T18:46:05.967783] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-21T18:46:05.967820] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-21T18:46:05.967883] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-21T18:46:05.967959] [INFO ] [MAIN ] Update Progress: 829/2366 symbols completed. FIG took 11.8s. Estimated remaining: 3h 16m 35s. Rate: 7.8 symbols/min [2025-10-21T18:46:06.197005] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:46:06.201003] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-21T18:46:06.267561] [DEBUG] [LOCAL ] FIGS: Loaded 48620 existing records from primary storage. [2025-10-21T18:46:06.268211] [INFO ] [MAIN ] FIGS: Loaded 48620 existing records. [2025-10-21T18:46:06.400588] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T18:46:06.493010] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:46:06.493174] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-21T18:46:06.493223] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-21T18:46:06.493891] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-21T18:46:06.493950] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-21T18:46:06.556188] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-21T18:46:06.840044] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:46:07.351092] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-21T18:46:08.151102] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-21T18:46:08.695228] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T18:46:08.770610] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-21T18:46:08.951031] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-21T18:46:09.744212] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T18:46:09.753436] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-21T18:46:10.550992] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-21T18:46:10.807571] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T18:46:11.350994] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-21T18:46:11.667041] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-21T18:46:11.758097] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T18:46:12.151082] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-21T18:46:12.951070] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-21T18:46:13.167771] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-21T18:46:13.176715] [INFO ] [REMOTE ] FHN: Full fetch complete (77476 records). [2025-10-21T18:46:13.176873] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-21T18:46:13.606276] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-21T18:46:13.606397] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-21T18:46:13.607767] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-21T18:46:13.607877] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-21T18:46:13.609767] [DEBUG] [LOCAL ] FHN: Trimmed 77476 records to 53399 (keeping 200 days of data) [2025-10-21T18:46:13.802527] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-21T18:46:13.963517] [DEBUG] [LOCAL ] FHN: Primary data saved (53399 records). [2025-10-21T18:46:13.963801] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-21T18:46:13.963976] [INFO ] [MAIN ] Update Progress: 830/2366 symbols completed. FHN took 46.7s. Estimated remaining: 3h 16m 28s. Rate: 7.8 symbols/min [2025-10-21T18:46:14.138393] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:46:14.177597] [DEBUG] [LOCAL ] FIHL: Loaded 39199 existing records from primary storage. [2025-10-21T18:46:14.177944] [INFO ] [MAIN ] FIHL: Loaded 39199 existing records. [2025-10-21T18:46:14.349796] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-21T18:46:14.422116] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:46:14.422804] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-21T18:46:14.423068] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-21T18:46:14.423923] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-21T18:46:14.424080] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-21T18:46:14.552968] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-21T18:46:14.688342] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T18:46:14.740140] [INFO ] [REMOTE ] FICO: Full fetch complete (29954 records). [2025-10-21T18:46:14.746250] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-21T18:46:14.955200] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:46:15.257210] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-21T18:46:15.257306] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-21T18:46:15.257936] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-21T18:46:15.258001] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-21T18:46:15.258919] [DEBUG] [LOCAL ] FICO: Trimmed 29954 records to 21911 (keeping 200 days of data) [2025-10-21T18:46:15.351784] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-21T18:46:15.401334] [DEBUG] [LOCAL ] FICO: Primary data saved (21911 records). [2025-10-21T18:46:15.401505] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-21T18:46:15.401951] [INFO ] [MAIN ] Update Progress: 831/2366 symbols completed. FICO took 30.3s. Estimated remaining: 3h 16m 9s. Rate: 7.8 symbols/min [2025-10-21T18:46:15.597539] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T18:46:15.623806] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:46:15.666728] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T18:46:15.680376] [INFO ] [REMOTE ] FI: Full fetch complete (77482 records). [2025-10-21T18:46:15.680715] [DEBUG] [LOCAL ] FINS: Loaded 8283 existing records from primary storage. [2025-10-21T18:46:15.681045] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-21T18:46:15.681333] [INFO ] [MAIN ] FINS: Loaded 8283 existing records. [2025-10-21T18:46:16.053229] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:46:16.075105] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-21T18:46:16.096054] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-21T18:46:16.138218] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-21T18:46:16.151207] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-21T18:46:16.164950] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-21T18:46:16.438866] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-21T18:46:16.444135] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-21T18:46:16.445276] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-21T18:46:16.450504] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-21T18:46:16.531082] [DEBUG] [LOCAL ] FI: Trimmed 77482 records to 53588 (keeping 200 days of data) [2025-10-21T18:46:16.902438] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:46:16.957367] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-21T18:46:16.964735] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T18:46:17.101066] [DEBUG] [LOCAL ] FI: Primary data saved (53588 records). [2025-10-21T18:46:17.101266] [INFO ] [MAIN ] FI: Full history saved. [2025-10-21T18:46:17.102202] [INFO ] [MAIN ] Update Progress: 832/2366 symbols completed. FI took 45.6s. Estimated remaining: 3h 15m 50s. Rate: 7.8 symbols/min [2025-10-21T18:46:17.287088] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:46:17.339587] [DEBUG] [LOCAL ] FINV: Loaded 45271 existing records from primary storage. [2025-10-21T18:46:17.340039] [INFO ] [MAIN ] FINV: Loaded 45271 existing records. [2025-10-21T18:46:17.547275] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:46:17.547584] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-21T18:46:17.547636] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-21T18:46:17.548352] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-21T18:46:17.548412] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-21T18:46:17.762880] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-21T18:46:17.834993] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-21T18:46:17.994828] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:46:18.001051] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T18:46:18.551004] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-21T18:46:18.892183] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T18:46:19.351039] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-21T18:46:19.889424] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-21T18:46:20.151027] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-21T18:46:20.907443] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T18:46:20.951006] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-21T18:46:21.665117] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-21T18:46:21.750987] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-21T18:46:22.515734] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T18:46:22.551002] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-21T18:46:23.263431] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-21T18:46:23.287262] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T18:46:23.351000] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-21T18:46:24.151072] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-21T18:46:24.715500] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-21T18:46:24.951008] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-21T18:46:25.347355] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T18:46:25.751024] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-21T18:46:26.340315] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T18:46:26.551035] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-21T18:46:27.307248] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T18:46:27.350977] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-21T18:46:27.897579] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T18:46:28.151000] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-21T18:46:28.851450] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T18:46:28.951026] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-21T18:46:29.740677] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T18:46:29.750978] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-21T18:46:30.458897] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T18:46:30.550989] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-21T18:46:31.040999] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T18:46:31.351041] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-21T18:46:31.654705] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-21T18:46:32.151032] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-21T18:46:32.486194] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T18:46:32.951066] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-21T18:46:33.556801] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-21T18:46:33.558511] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T18:46:33.751015] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-21T18:46:34.338011] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-21T18:46:34.551076] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-21T18:46:35.334897] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T18:46:35.350977] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-21T18:46:36.151013] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-21T18:46:36.203151] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T18:46:36.951024] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-21T18:46:37.681588] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-21T18:46:37.750989] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-21T18:46:38.551108] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-21T18:46:38.636810] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T18:46:38.972620] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-21T18:46:39.203469] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T18:46:39.212097] [INFO ] [REMOTE ] FIHL: Full fetch complete (56319 records). [2025-10-21T18:46:39.212244] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-21T18:46:39.356147] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-21T18:46:39.596947] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-21T18:46:39.597031] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-21T18:46:39.597787] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-21T18:46:39.597850] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-21T18:46:39.599088] [DEBUG] [LOCAL ] FIHL: Trimmed 56319 records to 39140 (keeping 200 days of data) [2025-10-21T18:46:39.836608] [DEBUG] [LOCAL ] FIHL: Primary data saved (39140 records). [2025-10-21T18:46:39.836762] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-21T18:46:39.837328] [INFO ] [MAIN ] Update Progress: 833/2366 symbols completed. FIHL took 25.9s. Estimated remaining: 3h 16m 10s. Rate: 7.8 symbols/min [2025-10-21T18:46:40.009181] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:46:40.015022] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-21T18:46:40.064543] [DEBUG] [LOCAL ] FIS: Loaded 53327 existing records from primary storage. [2025-10-21T18:46:40.064916] [INFO ] [MAIN ] FIS: Loaded 53327 existing records. [2025-10-21T18:46:40.156183] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-21T18:46:40.241141] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:46:40.241329] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-21T18:46:40.241377] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-21T18:46:40.241926] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-21T18:46:40.241982] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-21T18:46:40.590133] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:46:40.951103] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-21T18:46:41.751049] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-21T18:46:41.923459] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T18:46:42.551002] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-21T18:46:42.594353] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T18:46:42.969522] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-21T18:46:43.351024] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-21T18:46:43.541753] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T18:46:44.151049] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-21T18:46:44.849069] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-21T18:46:44.850560] [INFO ] [REMOTE ] FINS: Full fetch complete (11625 records). [2025-10-21T18:46:44.850627] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-21T18:46:44.953596] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-21T18:46:45.232972] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-21T18:46:45.251240] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-21T18:46:45.252043] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-21T18:46:45.252674] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T18:46:45.252826] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-21T18:46:45.260390] [DEBUG] [LOCAL ] FINS: Trimmed 11625 records to 8297 (keeping 200 days of data) [2025-10-21T18:46:45.260309] [INFO ] [REMOTE ] FIGS: Full fetch complete (70822 records). [2025-10-21T18:46:45.260818] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-21T18:46:45.436727] [DEBUG] [LOCAL ] FINS: Primary data saved (8297 records). [2025-10-21T18:46:45.454611] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-21T18:46:45.467262] [INFO ] [MAIN ] Update Progress: 834/2366 symbols completed. FINS took 30.1s. Estimated remaining: 3h 15m 59s. Rate: 7.8 symbols/min [2025-10-21T18:46:45.754730] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-21T18:46:45.857625] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:46:45.896877] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-21T18:46:45.897064] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-21T18:46:45.897969] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-21T18:46:45.898050] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-21T18:46:45.899921] [DEBUG] [LOCAL ] FIGS: Trimmed 70822 records to 48559 (keeping 200 days of data) [2025-10-21T18:46:46.128430] [DEBUG] [LOCAL ] FIX: Loaded 28617 existing records from primary storage. [2025-10-21T18:46:46.133079] [INFO ] [MAIN ] FIX: Loaded 28617 existing records. [2025-10-21T18:46:46.375155] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:46:46.376063] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-21T18:46:46.376376] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-21T18:46:46.377296] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-21T18:46:46.378246] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-21T18:46:46.448151] [DEBUG] [LOCAL ] FIGS: Primary data saved (48559 records). [2025-10-21T18:46:46.471096] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-21T18:46:46.471301] [INFO ] [MAIN ] Update Progress: 835/2366 symbols completed. FIGS took 40.5s. Estimated remaining: 3h 15m 39s. Rate: 7.8 symbols/min [2025-10-21T18:46:46.842131] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:46:46.848046] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-21T18:46:46.858491] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-21T18:46:46.891969] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-21T18:46:46.898886] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-21T18:46:46.923914] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-21T18:46:46.923999] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-21T18:46:46.923786] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:46:46.935263] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-21T18:46:47.141493] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-21T18:46:47.334802] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:46:47.350975] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-10-21T18:46:47.480323] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T18:46:47.556321] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T18:46:47.556587] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-10-21T18:46:47.556713] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:46:47.556790] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-21T18:46:47.556871] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:46:47.556963] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-21T18:46:47.557042] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-21T18:46:47.557079] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-21T18:46:47.557118] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-21T18:46:47.557161] [INFO ] [MAIN ] Update Progress: 836/2366 symbols completed. FIXT took 1.1s. Estimated remaining: 3h 15m 19s. Rate: 7.8 symbols/min [2025-10-21T18:46:47.723956] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:46:47.731495] [DEBUG] [LOCAL ] FLC: Loaded 5417 existing records from primary storage. [2025-10-21T18:46:47.731670] [INFO ] [MAIN ] FLC: Loaded 5417 existing records. [2025-10-21T18:46:47.904947] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:46:47.905134] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-21T18:46:47.905189] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-21T18:46:47.905365] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-21T18:46:47.905420] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-21T18:46:48.156140] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-21T18:46:48.262294] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:46:48.569468] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T18:46:48.951062] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-21T18:46:49.751063] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-21T18:46:49.972881] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T18:46:50.429977] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T18:46:50.550984] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-21T18:46:50.625088] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-21T18:46:51.351032] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-21T18:46:51.930063] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T18:46:52.151052] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-21T18:46:52.196986] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T18:46:52.951069] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-21T18:46:53.751012] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-21T18:46:54.092929] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T18:46:54.441173] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-21T18:46:54.551057] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-21T18:46:54.683873] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T18:46:54.691222] [INFO ] [REMOTE ] FINV: Full fetch complete (64870 records). [2025-10-21T18:46:54.691341] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-21T18:46:55.091406] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-21T18:46:55.091484] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-21T18:46:55.092300] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-21T18:46:55.092361] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-21T18:46:55.093574] [DEBUG] [LOCAL ] FINV: Trimmed 64870 records to 45256 (keeping 200 days of data) [2025-10-21T18:46:55.347564] [DEBUG] [LOCAL ] FINV: Primary data saved (45256 records). [2025-10-21T18:46:55.347707] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-21T18:46:55.347793] [INFO ] [MAIN ] Update Progress: 837/2366 symbols completed. FINV took 38.2s. Estimated remaining: 3h 15m 12s. Rate: 7.8 symbols/min [2025-10-21T18:46:55.351041] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-21T18:46:56.150989] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-21T18:46:56.285099] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T18:46:56.925744] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-21T18:46:56.950993] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-21T18:46:57.001115] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T18:46:57.551843] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-21T18:46:57.751002] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-21T18:46:58.551020] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-21T18:46:59.358037] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-21T18:46:59.377619] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T18:46:59.402555] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T18:47:00.151066] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-21T18:47:00.782898] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T18:47:00.951003] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-21T18:47:01.751106] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-21T18:47:02.091199] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T18:47:02.204821] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T18:47:02.245091] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-21T18:47:02.551096] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-21T18:47:03.351089] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-21T18:47:04.078260] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-21T18:47:04.150983] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-21T18:47:04.429568] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T18:47:04.951066] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-21T18:47:05.176599] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-21T18:47:05.609906] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-21T18:47:05.751007] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-21T18:47:06.551038] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-21T18:47:07.351061] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-21T18:47:07.555540] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-21T18:47:07.832218] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T18:47:08.021424] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-21T18:47:08.022709] [INFO ] [REMOTE ] FLC: Full fetch complete (7779 records). [2025-10-21T18:47:08.022777] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-21T18:47:08.156237] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-21T18:47:08.403342] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-21T18:47:08.403413] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-21T18:47:08.403603] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-21T18:47:08.403659] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-21T18:47:08.404065] [DEBUG] [LOCAL ] FLC: Trimmed 7779 records to 5426 (keeping 200 days of data) [2025-10-21T18:47:08.435564] [DEBUG] [LOCAL ] FLC: Primary data saved (5426 records). [2025-10-21T18:47:08.435633] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-21T18:47:08.435750] [INFO ] [MAIN ] Update Progress: 838/2366 symbols completed. FLC took 20.9s. Estimated remaining: 3h 15m 14s. Rate: 7.8 symbols/min [2025-10-21T18:47:08.951075] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-21T18:47:09.512457] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T18:47:09.665447] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T18:47:09.673726] [INFO ] [REMOTE ] FIS: Full fetch complete (77391 records). [2025-10-21T18:47:09.673849] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-21T18:47:09.764897] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-21T18:47:10.080026] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-21T18:47:10.080102] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-21T18:47:10.081012] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-21T18:47:10.081073] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-21T18:47:10.082492] [DEBUG] [LOCAL ] FIS: Trimmed 77391 records to 53326 (keeping 200 days of data) [2025-10-21T18:47:10.400519] [DEBUG] [LOCAL ] FIS: Primary data saved (53326 records). [2025-10-21T18:47:10.400662] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-21T18:47:10.401356] [INFO ] [MAIN ] Update Progress: 839/2366 symbols completed. FIS took 30.6s. Estimated remaining: 3h 14m 56s. Rate: 7.8 symbols/min [2025-10-21T18:47:11.169430] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T18:47:11.173850] [INFO ] [REMOTE ] FIX: Full fetch complete (45554 records). [2025-10-21T18:47:11.173956] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-21T18:47:11.550080] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-21T18:47:11.550204] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-21T18:47:11.550911] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-21T18:47:11.550974] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-21T18:47:11.552030] [DEBUG] [LOCAL ] FIX: Trimmed 45554 records to 28480 (keeping 200 days of data) [2025-10-21T18:47:11.725614] [DEBUG] [LOCAL ] FIX: Primary data saved (28480 records). [2025-10-21T18:47:11.725764] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-21T18:47:11.725844] [INFO ] [MAIN ] Update Progress: 840/2366 symbols completed. FIX took 26.3s. Estimated remaining: 3h 14m 37s. Rate: 7.8 symbols/min [2025-10-21T18:47:12.410438] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:47:12.431943] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:47:12.428513] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:47:12.427590] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:47:12.432683] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-21T18:47:12.433400] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-21T18:47:12.433532] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-21T18:47:12.433586] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-21T18:47:12.433640] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-21T18:47:12.433733] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-21T18:47:12.756966] [DEBUG] [LOCAL ] FLNG: Loaded 33591 existing records from primary storage. [2025-10-21T18:47:12.835482] [DEBUG] [LOCAL ] FLO: Loaded 52083 existing records from primary storage. [2025-10-21T18:47:12.835883] [INFO ] [MAIN ] FLO: Loaded 52083 existing records. [2025-10-21T18:47:12.841962] [DEBUG] [LOCAL ] FLG: Loaded 53322 existing records from primary storage. [2025-10-21T18:47:12.847280] [INFO ] [MAIN ] FLNG: Loaded 33591 existing records. [2025-10-21T18:47:12.919150] [INFO ] [MAIN ] FLG: Loaded 53322 existing records. [2025-10-21T18:47:13.083813] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:47:13.118714] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-10-21T18:47:13.376751] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:47:13.440169] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:47:13.417509] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-21T18:47:13.454522] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-21T18:47:13.475967] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-21T18:47:13.475870] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:47:13.476243] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-21T18:47:13.476369] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-21T18:47:13.476477] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-21T18:47:13.476533] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-21T18:47:13.476586] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-21T18:47:13.476916] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-21T18:47:13.477009] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-21T18:47:13.501422] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-21T18:47:13.564287] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-21T18:47:14.424259] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:47:14.449857] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-21T18:47:14.566237] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:47:14.600776] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-21T18:47:14.606717] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:47:14.609177] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-21T18:47:14.611071] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T18:47:14.616046] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-10-21T18:47:15.898613] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T18:47:15.906581] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-10-21T18:47:15.977300] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T18:47:15.985180] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-21T18:47:16.367253] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T18:47:16.378732] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-21T18:47:16.418003] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T18:47:16.951005] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-21T18:47:17.052493] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T18:47:17.111296] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T18:47:17.751021] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-21T18:47:18.152288] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-21T18:47:18.556157] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-10-21T18:47:18.576255] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T18:47:19.258754] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-21T18:47:19.351032] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-21T18:47:19.498449] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-21T18:47:20.151037] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-21T18:47:20.951024] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-21T18:47:21.081517] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T18:47:21.751031] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-21T18:47:21.927487] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T18:47:22.364505] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T18:47:22.551010] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-21T18:47:23.350998] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-21T18:47:23.676935] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T18:47:23.901630] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T18:47:24.151019] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-10-21T18:47:24.957954] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-21T18:47:24.963539] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T18:47:25.499112] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T18:47:25.751037] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-10-21T18:47:26.550998] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-21T18:47:26.703561] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T18:47:26.993461] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-21T18:47:27.351074] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-21T18:47:28.151020] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-21T18:47:28.304026] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T18:47:28.951068] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-21T18:47:29.208467] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T18:47:29.508282] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T18:47:29.751062] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-21T18:47:30.386821] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T18:47:30.551051] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-21T18:47:31.351032] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-10-21T18:47:31.796747] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-21T18:47:32.151040] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-21T18:47:32.450840] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T18:47:32.525554] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-21T18:47:32.951068] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-21T18:47:33.682338] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T18:47:33.751040] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-21T18:47:34.551056] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-21T18:47:34.720682] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T18:47:34.955339] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-21T18:47:35.351050] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-21T18:47:36.151089] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-21T18:47:36.350322] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-21T18:47:36.951012] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-21T18:47:37.161106] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T18:47:37.718883] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T18:47:37.750977] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-21T18:47:38.551086] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-10-21T18:47:38.779821] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-21T18:47:39.148414] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T18:47:39.153249] [INFO ] [REMOTE ] FLNG: Full fetch complete (49938 records). [2025-10-21T18:47:39.153361] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-21T18:47:39.352957] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-21T18:47:39.553007] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-21T18:47:39.553122] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-21T18:47:39.553861] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-21T18:47:39.553925] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-21T18:47:39.555300] [DEBUG] [LOCAL ] FLNG: Trimmed 49938 records to 33491 (keeping 200 days of data) [2025-10-21T18:47:39.684478] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T18:47:39.788119] [DEBUG] [LOCAL ] FLNG: Primary data saved (33491 records). [2025-10-21T18:47:39.788246] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-21T18:47:39.788325] [INFO ] [MAIN ] Update Progress: 841/2366 symbols completed. FLNG took 28.1s. Estimated remaining: 3h 15m 6s. Rate: 7.8 symbols/min [2025-10-21T18:47:39.955241] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:47:40.004694] [DEBUG] [LOCAL ] FLR: Loaded 53258 existing records from primary storage. [2025-10-21T18:47:40.004984] [INFO ] [MAIN ] FLR: Loaded 53258 existing records. [2025-10-21T18:47:40.161562] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-10-21T18:47:40.183027] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:47:40.183869] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-21T18:47:40.183919] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-21T18:47:40.184473] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-21T18:47:40.184531] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-21T18:47:40.561168] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:47:40.951015] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-21T18:47:41.335885] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T18:47:41.401484] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-21T18:47:41.410087] [INFO ] [REMOTE ] FLG: Full fetch complete (77424 records). [2025-10-21T18:47:41.410272] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-21T18:47:41.758639] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-21T18:47:41.807591] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-21T18:47:41.807699] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-21T18:47:41.808716] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-21T18:47:41.808779] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-21T18:47:41.810628] [DEBUG] [LOCAL ] FLG: Trimmed 77424 records to 53319 (keeping 200 days of data) [2025-10-21T18:47:42.134338] [DEBUG] [LOCAL ] FLG: Primary data saved (53319 records). [2025-10-21T18:47:42.134704] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-21T18:47:42.134801] [INFO ] [MAIN ] Update Progress: 842/2366 symbols completed. FLG took 30.4s. Estimated remaining: 3h 14m 49s. Rate: 7.8 symbols/min [2025-10-21T18:47:42.306121] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:47:42.353431] [DEBUG] [LOCAL ] FLS: Loaded 50452 existing records from primary storage. [2025-10-21T18:47:42.353777] [INFO ] [MAIN ] FLS: Loaded 50452 existing records. [2025-10-21T18:47:42.553609] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-10. [2025-10-21T18:47:42.578548] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:47:42.578871] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-21T18:47:42.578943] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-21T18:47:42.581453] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-21T18:47:42.581393] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T18:47:42.581758] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-21T18:47:42.946574] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:47:43.350983] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-21T18:47:43.586187] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T18:47:43.594879] [INFO ] [REMOTE ] FLO: Full fetch complete (75383 records). [2025-10-21T18:47:43.595024] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-21T18:47:44.001681] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-21T18:47:44.002292] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-21T18:47:44.002932] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T18:47:44.007635] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-21T18:47:44.008144] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-21T18:47:44.008353] [INFO ] [REMOTE ] FLOC: Full fetch complete (40673 records). [2025-10-21T18:47:44.008432] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-10-21T18:47:44.089411] [DEBUG] [LOCAL ] FLO: Trimmed 75383 records to 52075 (keeping 200 days of data) [2025-10-21T18:47:44.179039] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-21T18:47:44.294962] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-21T18:47:44.296309] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:47:44.301689] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:47:44.312952] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-21T18:47:44.320912] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-21T18:47:44.321254] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-21T18:47:44.323708] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-21T18:47:44.331020] [INFO ] [MAIN ] Update Progress: 843/2366 symbols completed. FLOC took 32.6s. Estimated remaining: 3h 14m 31s. Rate: 7.8 symbols/min [2025-10-21T18:47:44.609601] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:47:44.704303] [DEBUG] [LOCAL ] FLO: Primary data saved (52075 records). [2025-10-21T18:47:44.704524] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-21T18:47:44.705183] [INFO ] [MAIN ] Update Progress: 844/2366 symbols completed. FLO took 33.0s. Estimated remaining: 3h 14m 11s. Rate: 7.8 symbols/min [2025-10-21T18:47:44.890218] [DEBUG] [LOCAL ] FLUT: Loaded 50697 existing records from primary storage. [2025-10-21T18:47:44.908510] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:47:44.908750] [INFO ] [MAIN ] FLUT: Loaded 50697 existing records. [2025-10-21T18:47:45.105289] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:47:45.105685] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-21T18:47:45.105982] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-21T18:47:45.107446] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-21T18:47:45.107329] [DEBUG] [LOCAL ] FLXR: Loaded 21242 existing records from primary storage. [2025-10-21T18:47:45.107534] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-21T18:47:45.107805] [INFO ] [MAIN ] FLXR: Loaded 21242 existing records. [2025-10-21T18:47:45.327069] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-21T18:47:45.350930] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-21T18:47:45.554816] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:47:45.607706] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-21T18:47:45.612988] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-21T18:47:45.644357] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-21T18:47:45.686759] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-21T18:47:45.718107] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:47:45.759210] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-21T18:47:46.054634] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-21T18:47:46.129223] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:47:46.550987] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-21T18:47:46.800129] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T18:47:47.351013] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-21T18:47:47.462821] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T18:47:48.151000] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-21T18:47:48.418443] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T18:47:48.454710] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T18:47:48.951006] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-21T18:47:49.392951] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-21T18:47:49.751063] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-21T18:47:50.551005] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-21T18:47:50.817900] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T18:47:51.350998] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-21T18:47:51.549396] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T18:47:51.918901] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T18:47:52.151018] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-21T18:47:52.865630] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T18:47:52.950986] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-21T18:47:53.662293] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T18:47:53.750985] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-21T18:47:54.403898] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T18:47:54.550992] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-21T18:47:55.350991] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-21T18:47:55.454344] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T18:47:56.151062] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-21T18:47:56.455287] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T18:47:56.951042] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-21T18:47:57.134943] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-21T18:47:57.746587] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-21T18:47:57.750971] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-21T18:47:57.879836] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T18:47:58.390784] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T18:47:58.551066] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-21T18:47:59.351029] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-21T18:48:00.151054] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-21T18:48:00.231097] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T18:48:00.951017] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-21T18:48:01.267797] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-21T18:48:01.311125] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-21T18:48:01.751037] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-21T18:48:02.551091] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-21T18:48:02.939344] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-21T18:48:03.205534] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-21T18:48:03.350996] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-21T18:48:03.535510] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T18:48:04.151064] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-21T18:48:04.950986] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-21T18:48:05.290777] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T18:48:05.750998] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-21T18:48:05.833308] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T18:48:05.877258] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-21T18:48:06.551016] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-21T18:48:07.350999] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-21T18:48:08.157354] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-21T18:48:08.160197] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-21T18:48:08.168919] [INFO ] [REMOTE ] FLR: Full fetch complete (76873 records). [2025-10-21T18:48:08.169041] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-21T18:48:08.536692] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T18:48:08.629858] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-21T18:48:08.644479] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-21T18:48:08.644956] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-21T18:48:08.646517] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-21T18:48:08.646799] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-21T18:48:08.648396] [DEBUG] [LOCAL ] FLR: Trimmed 76873 records to 53260 (keeping 200 days of data) [2025-10-21T18:48:08.945886] [DEBUG] [LOCAL ] FLR: Primary data saved (53260 records). [2025-10-21T18:48:08.946009] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-21T18:48:08.946085] [INFO ] [MAIN ] Update Progress: 845/2366 symbols completed. FLR took 29.2s. Estimated remaining: 3h 14m 33s. Rate: 7.8 symbols/min [2025-10-21T18:48:08.951500] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-21T18:48:09.114976] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:48:09.161618] [DEBUG] [LOCAL ] FMC: Loaded 51892 existing records from primary storage. [2025-10-21T18:48:09.161949] [INFO ] [MAIN ] FMC: Loaded 51892 existing records. [2025-10-21T18:48:09.333901] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:48:09.334084] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-21T18:48:09.334133] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-21T18:48:09.335118] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-21T18:48:09.335175] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-21T18:48:09.686039] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:48:09.751005] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-21T18:48:09.996979] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T18:48:10.197667] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T18:48:10.551048] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-21T18:48:11.351069] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-21T18:48:11.470067] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T18:48:12.075224] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T18:48:12.151074] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-21T18:48:12.951068] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-21T18:48:13.435351] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-21T18:48:13.443257] [INFO ] [REMOTE ] FLUT: Full fetch complete (73387 records). [2025-10-21T18:48:13.443393] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-21T18:48:13.756190] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-21T18:48:13.835001] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-21T18:48:13.835087] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-21T18:48:13.836018] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-21T18:48:13.836082] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-21T18:48:13.837460] [DEBUG] [LOCAL ] FLUT: Trimmed 73387 records to 50684 (keeping 200 days of data) [2025-10-21T18:48:14.094067] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-21T18:48:14.106683] [INFO ] [REMOTE ] FLS: Full fetch complete (72491 records). [2025-10-21T18:48:14.132745] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-21T18:48:14.467060] [DEBUG] [LOCAL ] FLUT: Primary data saved (50684 records). [2025-10-21T18:48:14.481816] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-21T18:48:14.502316] [INFO ] [MAIN ] Update Progress: 846/2366 symbols completed. FLUT took 30.2s. Estimated remaining: 3h 14m 21s. Rate: 7.8 symbols/min [2025-10-21T18:48:14.710877] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-21T18:48:14.711265] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-21T18:48:14.712319] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-21T18:48:14.726234] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-21T18:48:14.788959] [DEBUG] [LOCAL ] FLS: Trimmed 72491 records to 50413 (keeping 200 days of data) [2025-10-21T18:48:14.788537] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:48:14.899883] [DEBUG] [LOCAL ] FMN: Loaded 5517 existing records from primary storage. [2025-10-21T18:48:14.904930] [INFO ] [MAIN ] FMN: Loaded 5517 existing records. [2025-10-21T18:48:15.120766] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T18:48:15.192631] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-21T18:48:15.287447] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:48:15.292637] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-21T18:48:15.292811] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-21T18:48:15.300328] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-21T18:48:15.304939] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-21T18:48:15.313954] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-21T18:48:15.409229] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-21T18:48:15.642846] [DEBUG] [LOCAL ] FLS: Primary data saved (50413 records). [2025-10-21T18:48:15.681248] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-21T18:48:15.701032] [INFO ] [MAIN ] Update Progress: 847/2366 symbols completed. FLS took 33.6s. Estimated remaining: 3h 14m 2s. Rate: 7.8 symbols/min [2025-10-21T18:48:15.901162] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:48:15.953200] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:48:15.983070] [DEBUG] [LOCAL ] FMS: Loaded 30419 existing records from primary storage. [2025-10-21T18:48:15.983327] [INFO ] [MAIN ] FMS: Loaded 30419 existing records. [2025-10-21T18:48:16.157113] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-21T18:48:16.161615] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:48:16.161847] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-21T18:48:16.162683] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-21T18:48:16.163301] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-21T18:48:16.163358] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-21T18:48:16.530806] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-21T18:48:16.563551] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:48:16.951069] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-21T18:48:17.066564] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T18:48:17.379113] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T18:48:17.751049] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-21T18:48:17.852555] [DEBUG] [REMOTE ] FLXR: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-21T18:48:17.852917] [WARN ] [REMOTE ] FLXR: No data returned for month 2025-10 [2025-10-21T18:48:17.853025] [FATAL] [REMOTE ] FLXR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:48:17.853147] [FATAL] [MAIN ] FLXR: Failed to fetch primary data. [2025-10-21T18:48:17.853229] [WARN ] [MAIN ] FLXR: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:48:17.853313] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-21T18:48:17.853391] [DEBUG] [LOCAL ] FLXR: No primary data file found to delete. [2025-10-21T18:48:17.853441] [INFO ] [LOCAL ] FLXR: Starting deletion of derivative data. [2025-10-21T18:48:17.853683] [DEBUG] [LOCAL ] FLXR: Deleted derivative data file. [2025-10-21T18:48:17.853795] [INFO ] [MAIN ] Update Progress: 848/2366 symbols completed. FLXR took 33.1s. Estimated remaining: 3h 13m 45s. Rate: 7.8 symbols/min [2025-10-21T18:48:18.025823] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:48:18.063859] [DEBUG] [LOCAL ] FMX: Loaded 40649 existing records from primary storage. [2025-10-21T18:48:18.064149] [INFO ] [MAIN ] FMX: Loaded 40649 existing records. [2025-10-21T18:48:18.254624] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T18:48:18.272423] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:48:18.273105] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-21T18:48:18.273162] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-21T18:48:18.273374] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-21T18:48:18.273428] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-21T18:48:18.556195] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-21T18:48:18.626241] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:48:19.351001] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-21T18:48:19.814352] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T18:48:20.151024] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-21T18:48:20.755383] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T18:48:20.951019] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-21T18:48:21.751039] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-21T18:48:21.802780] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-21T18:48:21.855226] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T18:48:22.551023] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-21T18:48:23.195273] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T18:48:23.351005] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-21T18:48:23.360364] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T18:48:24.151032] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-21T18:48:24.693522] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T18:48:24.951021] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-21T18:48:25.751029] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-21T18:48:26.398297] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-21T18:48:26.533189] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-21T18:48:26.550973] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-21T18:48:27.024387] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-21T18:48:27.351020] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-21T18:48:28.151057] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-21T18:48:28.244263] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T18:48:28.951026] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-21T18:48:29.036814] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T18:48:29.630094] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T18:48:29.750981] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-21T18:48:30.551059] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-21T18:48:30.730265] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T18:48:30.748222] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-21T18:48:31.351040] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-21T18:48:31.861596] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T18:48:32.151055] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-21T18:48:32.718268] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-21T18:48:32.951029] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-21T18:48:33.015576] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T18:48:33.453086] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-21T18:48:33.751049] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-21T18:48:34.376449] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-21T18:48:34.551017] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-21T18:48:35.241665] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-21T18:48:35.351018] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-21T18:48:35.941876] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T18:48:36.151030] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-21T18:48:36.951011] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-21T18:48:37.632607] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T18:48:37.751061] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-21T18:48:38.198078] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T18:48:38.551030] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-21T18:48:39.105924] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T18:48:39.351035] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-21T18:48:39.825405] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T18:48:40.150932] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T18:48:40.150981] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-21T18:48:40.153670] [INFO ] [REMOTE ] FMN: Full fetch complete (10022 records). [2025-10-21T18:48:40.153744] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-21T18:48:40.510747] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-21T18:48:40.510811] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-21T18:48:40.511046] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-21T18:48:40.511085] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-21T18:48:40.511519] [DEBUG] [LOCAL ] FMN: Trimmed 10022 records to 5499 (keeping 200 days of data) [2025-10-21T18:48:40.543820] [DEBUG] [LOCAL ] FMN: Primary data saved (5499 records). [2025-10-21T18:48:40.543923] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-21T18:48:40.543998] [INFO ] [MAIN ] Update Progress: 849/2366 symbols completed. FMN took 26.0s. Estimated remaining: 3h 14m 4s. Rate: 7.8 symbols/min [2025-10-21T18:48:40.712838] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:48:40.716346] [DEBUG] [LOCAL ] FMY: Loaded 1381 existing records from primary storage. [2025-10-21T18:48:40.716484] [INFO ] [MAIN ] FMY: Loaded 1381 existing records. [2025-10-21T18:48:40.891876] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:48:40.892077] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-21T18:48:40.892125] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-21T18:48:40.892268] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-21T18:48:40.892310] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-21T18:48:40.956145] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-21T18:48:41.251700] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:48:41.555034] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T18:48:41.751031] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-21T18:48:42.551091] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-21T18:48:42.580285] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T18:48:42.894888] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-21T18:48:43.076165] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T18:48:43.081356] [INFO ] [REMOTE ] FMS: Full fetch complete (43116 records). [2025-10-21T18:48:43.081444] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-21T18:48:43.356119] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-21T18:48:43.475449] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-21T18:48:43.475540] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-21T18:48:43.476206] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-21T18:48:43.476267] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-21T18:48:43.477327] [DEBUG] [LOCAL ] FMS: Trimmed 43116 records to 30427 (keeping 200 days of data) [2025-10-21T18:48:43.654747] [DEBUG] [LOCAL ] FMS: Primary data saved (30427 records). [2025-10-21T18:48:43.654873] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-21T18:48:43.654948] [INFO ] [MAIN ] Update Progress: 850/2366 symbols completed. FMS took 28.0s. Estimated remaining: 3h 13m 48s. Rate: 7.8 symbols/min [2025-10-21T18:48:43.825986] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:48:43.862819] [DEBUG] [LOCAL ] FN: Loaded 37620 existing records from primary storage. [2025-10-21T18:48:43.863099] [INFO ] [MAIN ] FN: Loaded 37620 existing records. [2025-10-21T18:48:44.038459] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:48:44.038718] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-21T18:48:44.038773] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-21T18:48:44.039027] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-21T18:48:44.039082] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-21T18:48:44.156136] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-21T18:48:44.414444] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:48:44.737774] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T18:48:44.951041] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-21T18:48:45.173965] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T18:48:45.304128] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-21T18:48:45.751080] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-21T18:48:46.551005] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-21T18:48:47.351011] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-21T18:48:47.665207] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T18:48:47.673748] [INFO ] [REMOTE ] FMC: Full fetch complete (75398 records). [2025-10-21T18:48:47.673887] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-21T18:48:47.806690] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-21T18:48:48.090950] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-21T18:48:48.091062] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-21T18:48:48.092132] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-21T18:48:48.092320] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-21T18:48:48.113271] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T18:48:48.121363] [DEBUG] [LOCAL ] FMC: Trimmed 75398 records to 51887 (keeping 200 days of data) [2025-10-21T18:48:48.172904] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-21T18:48:48.431964] [DEBUG] [LOCAL ] FMC: Primary data saved (51887 records). [2025-10-21T18:48:48.432126] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-21T18:48:48.432218] [INFO ] [MAIN ] Update Progress: 851/2366 symbols completed. FMC took 39.5s. Estimated remaining: 3h 13m 35s. Rate: 7.8 symbols/min [2025-10-21T18:48:48.598161] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:48:48.648097] [DEBUG] [LOCAL ] FNB: Loaded 52605 existing records from primary storage. [2025-10-21T18:48:48.648397] [INFO ] [MAIN ] FNB: Loaded 52605 existing records. [2025-10-21T18:48:48.820590] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:48:48.820867] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-21T18:48:48.820915] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-21T18:48:48.821137] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-21T18:48:48.821193] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-21T18:48:48.957263] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-21T18:48:49.173424] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:48:49.751048] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-21T18:48:49.796412] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-21T18:48:50.043076] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-21T18:48:50.235478] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T18:48:50.551026] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-21T18:48:51.351063] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-21T18:48:52.150999] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-21T18:48:52.252377] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T18:48:52.503944] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-21T18:48:52.950936] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-21T18:48:52.989752] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T18:48:53.393745] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-21T18:48:53.751080] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-21T18:48:54.551078] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-21T18:48:55.351022] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-21T18:48:55.395499] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T18:48:56.151086] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-21T18:48:56.203120] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T18:48:56.603978] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-21T18:48:56.951037] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-21T18:48:57.085533] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T18:48:57.091599] [INFO ] [REMOTE ] FMX: Full fetch complete (58007 records). [2025-10-21T18:48:57.091792] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-21T18:48:57.495848] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-21T18:48:57.495930] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-21T18:48:57.496782] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-21T18:48:57.496865] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-21T18:48:57.498109] [DEBUG] [LOCAL ] FMX: Trimmed 58007 records to 40553 (keeping 200 days of data) [2025-10-21T18:48:57.749049] [DEBUG] [LOCAL ] FMX: Primary data saved (40553 records). [2025-10-21T18:48:57.749171] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-21T18:48:57.749749] [INFO ] [MAIN ] Update Progress: 852/2366 symbols completed. FMX took 39.9s. Estimated remaining: 3h 13m 30s. Rate: 7.8 symbols/min [2025-10-21T18:48:57.761433] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-21T18:48:57.931277] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:48:57.982340] [DEBUG] [LOCAL ] FND: Loaded 52091 existing records from primary storage. [2025-10-21T18:48:57.982693] [INFO ] [MAIN ] FND: Loaded 52091 existing records. [2025-10-21T18:48:58.170863] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:48:58.171120] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-21T18:48:58.171191] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-21T18:48:58.171523] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-21T18:48:58.171589] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-21T18:48:58.280315] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-21T18:48:58.551457] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-21T18:48:58.551337] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:48:58.629524] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T18:48:58.995574] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-21T18:48:58.996301] [INFO ] [REMOTE ] FMY: Full fetch complete (1945 records). [2025-10-21T18:48:58.996368] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-21T18:48:59.356181] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-21T18:48:59.362076] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-21T18:48:59.362137] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-21T18:48:59.362229] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-21T18:48:59.362270] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-21T18:48:59.362591] [DEBUG] [LOCAL ] FMY: Trimmed 1945 records to 1377 (keeping 200 days of data) [2025-10-21T18:48:59.371401] [DEBUG] [LOCAL ] FMY: Primary data saved (1377 records). [2025-10-21T18:48:59.371468] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-21T18:48:59.371539] [INFO ] [MAIN ] Update Progress: 853/2366 symbols completed. FMY took 18.8s. Estimated remaining: 3h 13m 12s. Rate: 7.8 symbols/min [2025-10-21T18:48:59.552531] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:48:59.598284] [DEBUG] [LOCAL ] FNF: Loaded 48842 existing records from primary storage. [2025-10-21T18:48:59.598594] [INFO ] [MAIN ] FNF: Loaded 48842 existing records. [2025-10-21T18:48:59.785221] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:48:59.785421] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-21T18:48:59.785470] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-21T18:48:59.785739] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-21T18:48:59.785796] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-21T18:49:00.153940] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-21T18:49:00.157791] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:49:00.951027] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-21T18:49:01.038744] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-21T18:49:01.751313] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-21T18:49:01.855786] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T18:49:02.550997] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-21T18:49:02.649470] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T18:49:03.350995] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-21T18:49:03.439777] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T18:49:03.992041] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T18:49:04.151039] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-21T18:49:04.951004] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-21T18:49:05.190502] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T18:49:05.225929] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-21T18:49:05.751038] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-21T18:49:06.551039] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-21T18:49:06.609692] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T18:49:07.351005] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-21T18:49:07.451402] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T18:49:08.064713] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T18:49:08.151015] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-21T18:49:08.951001] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-21T18:49:09.163950] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T18:49:09.502862] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T18:49:09.750997] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-21T18:49:10.551036] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-21T18:49:10.598326] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T18:49:11.350998] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-21T18:49:11.446674] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T18:49:12.137146] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-21T18:49:12.150983] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-21T18:49:12.891558] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T18:49:12.951040] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-21T18:49:13.536944] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T18:49:13.542131] [INFO ] [REMOTE ] FN: Full fetch complete (56379 records). [2025-10-21T18:49:13.542249] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-21T18:49:13.756232] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-21T18:49:13.951910] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-21T18:49:13.951992] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-21T18:49:13.952808] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-21T18:49:13.952871] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-21T18:49:13.954421] [DEBUG] [LOCAL ] FN: Trimmed 56379 records to 37491 (keeping 200 days of data) [2025-10-21T18:49:14.174713] [DEBUG] [LOCAL ] FN: Primary data saved (37491 records). [2025-10-21T18:49:14.174842] [INFO ] [MAIN ] FN: Full history saved. [2025-10-21T18:49:14.174916] [INFO ] [MAIN ] Update Progress: 854/2366 symbols completed. FN took 30.5s. Estimated remaining: 3h 13m 17s. Rate: 7.8 symbols/min [2025-10-21T18:49:14.341941] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:49:14.387299] [DEBUG] [LOCAL ] FNV: Loaded 46152 existing records from primary storage. [2025-10-21T18:49:14.387617] [INFO ] [MAIN ] FNV: Loaded 46152 existing records. [2025-10-21T18:49:14.557977] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-21T18:49:14.570771] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:49:14.572266] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-21T18:49:14.572344] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-21T18:49:14.572789] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-21T18:49:14.572848] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-21T18:49:14.777009] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T18:49:14.967092] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:49:15.236044] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T18:49:15.350994] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-21T18:49:16.151012] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-21T18:49:16.446182] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T18:49:16.951010] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-21T18:49:17.178350] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T18:49:17.413639] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-21T18:49:17.751053] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-21T18:49:18.556287] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-21T18:49:18.571948] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T18:49:19.351065] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-21T18:49:19.537210] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T18:49:20.151013] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-21T18:49:20.272567] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T18:49:20.951033] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-21T18:49:21.166896] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T18:49:21.426917] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T18:49:21.751031] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-21T18:49:22.551093] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-21T18:49:22.666278] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-21T18:49:23.317028] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T18:49:23.351031] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-21T18:49:24.151050] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-21T18:49:24.322394] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T18:49:24.951061] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-21T18:49:25.071735] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T18:49:25.750992] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-21T18:49:26.004627] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-21T18:49:26.551087] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-21T18:49:26.785315] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T18:49:26.796331] [INFO ] [REMOTE ] FNB: Full fetch complete (76217 records). [2025-10-21T18:49:26.796505] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-21T18:49:27.277871] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-21T18:49:27.278018] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-21T18:49:27.279080] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-21T18:49:27.279165] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-21T18:49:27.280911] [DEBUG] [LOCAL ] FNB: Trimmed 76217 records to 52603 (keeping 200 days of data) [2025-10-21T18:49:27.361134] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-21T18:49:27.405597] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T18:49:27.654921] [DEBUG] [LOCAL ] FNB: Primary data saved (52603 records). [2025-10-21T18:49:27.655065] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-21T18:49:27.655150] [INFO ] [MAIN ] Update Progress: 855/2366 symbols completed. FNB took 39.2s. Estimated remaining: 3h 13m 20s. Rate: 7.8 symbols/min [2025-10-21T18:49:27.834157] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:49:27.848283] [DEBUG] [LOCAL ] FOA: Loaded 13064 existing records from primary storage. [2025-10-21T18:49:27.848460] [INFO ] [MAIN ] FOA: Loaded 13064 existing records. [2025-10-21T18:49:28.024566] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:49:28.024763] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-21T18:49:28.024810] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-21T18:49:28.025029] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-21T18:49:28.025084] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-21T18:49:28.165369] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-21T18:49:28.408228] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:49:28.410083] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T18:49:28.951022] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-21T18:49:29.098161] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T18:49:29.705514] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-21T18:49:29.713797] [INFO ] [REMOTE ] FND: Full fetch complete (75046 records). [2025-10-21T18:49:29.713923] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-21T18:49:29.756557] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-21T18:49:30.105143] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-21T18:49:30.105271] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-21T18:49:30.106178] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-21T18:49:30.106239] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-21T18:49:30.107726] [DEBUG] [LOCAL ] FND: Trimmed 75046 records to 52080 (keeping 200 days of data) [2025-10-21T18:49:30.421818] [DEBUG] [LOCAL ] FND: Primary data saved (52080 records). [2025-10-21T18:49:30.421950] [INFO ] [MAIN ] FND: Full history saved. [2025-10-21T18:49:30.422542] [INFO ] [MAIN ] Update Progress: 856/2366 symbols completed. FND took 32.7s. Estimated remaining: 3h 13m 3s. Rate: 7.8 symbols/min [2025-10-21T18:49:30.551116] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-21T18:49:30.624869] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:49:30.658003] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-21T18:49:30.672459] [DEBUG] [LOCAL ] FOF: Loaded 8615 existing records from primary storage. [2025-10-21T18:49:30.673180] [INFO ] [MAIN ] FOF: Loaded 8615 existing records. [2025-10-21T18:49:30.770543] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-21T18:49:30.875430] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:49:30.875742] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-21T18:49:30.875795] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-21T18:49:30.875986] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-21T18:49:30.876041] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-21T18:49:31.225974] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:49:31.351008] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-21T18:49:32.151000] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-21T18:49:32.308621] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-21T18:49:32.803683] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-21T18:49:32.951023] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-21T18:49:33.721621] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T18:49:33.751014] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-21T18:49:33.925206] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-21T18:49:33.932629] [INFO ] [REMOTE ] FNF: Full fetch complete (69982 records). [2025-10-21T18:49:33.932816] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-21T18:49:34.315805] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-21T18:49:34.315884] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-21T18:49:34.316745] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-21T18:49:34.316808] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-21T18:49:34.318118] [DEBUG] [LOCAL ] FNF: Trimmed 69982 records to 48759 (keeping 200 days of data) [2025-10-21T18:49:34.553806] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-21T18:49:34.622355] [DEBUG] [LOCAL ] FNF: Primary data saved (48759 records). [2025-10-21T18:49:34.622492] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-21T18:49:34.622845] [INFO ] [MAIN ] Update Progress: 857/2366 symbols completed. FNF took 35.3s. Estimated remaining: 3h 12m 49s. Rate: 7.8 symbols/min [2025-10-21T18:49:34.798338] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:49:34.818730] [DEBUG] [LOCAL ] FOR: Loaded 19738 existing records from primary storage. [2025-10-21T18:49:34.818974] [INFO ] [MAIN ] FOR: Loaded 19738 existing records. [2025-10-21T18:49:35.001851] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:49:35.002152] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-21T18:49:35.002209] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-21T18:49:35.002907] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-21T18:49:35.002970] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-21T18:49:35.342860] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-21T18:49:35.355848] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-21T18:49:35.456343] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:49:35.458681] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T18:49:36.150991] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-21T18:49:36.401796] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T18:49:36.951000] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-21T18:49:37.324453] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T18:49:37.677700] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T18:49:37.750964] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-21T18:49:38.551087] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-21T18:49:38.897482] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-21T18:49:39.351004] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-21T18:49:39.474813] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-21T18:49:40.151053] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-21T18:49:40.951000] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-21T18:49:40.993818] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T18:49:41.193025] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T18:49:41.745020] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-21T18:49:41.750973] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-21T18:49:42.317726] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-21T18:49:42.551063] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-21T18:49:43.351030] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-21T18:49:43.835362] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-21T18:49:44.044946] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-21T18:49:44.151031] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-21T18:49:44.951034] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-21T18:49:45.222832] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-21T18:49:45.751007] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-21T18:49:45.776816] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T18:49:46.555311] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-21T18:49:46.559285] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-21T18:49:47.297239] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-21T18:49:47.351049] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-21T18:49:48.078723] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-21T18:49:48.151011] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-21T18:49:48.949712] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T18:49:48.952023] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-21T18:49:49.705479] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-21T18:49:49.751020] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-21T18:49:50.494938] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-21T18:49:50.550981] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-21T18:49:51.351019] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-21T18:49:51.634221] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T18:49:52.151035] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-21T18:49:52.392574] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T18:49:52.394376] [INFO ] [REMOTE ] FOF: Full fetch complete (11919 records). [2025-10-21T18:49:52.394447] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-21T18:49:52.752851] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-21T18:49:52.753138] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-21T18:49:52.753429] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-21T18:49:52.753487] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-21T18:49:52.753946] [DEBUG] [LOCAL ] FOF: Trimmed 11919 records to 8614 (keeping 200 days of data) [2025-10-21T18:49:52.805852] [DEBUG] [LOCAL ] FOF: Primary data saved (8614 records). [2025-10-21T18:49:52.805964] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-21T18:49:52.806039] [INFO ] [MAIN ] Update Progress: 858/2366 symbols completed. FOF took 22.4s. Estimated remaining: 3h 13m 0s. Rate: 7.8 symbols/min [2025-10-21T18:49:52.957674] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-21T18:49:52.975856] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:49:53.021515] [DEBUG] [LOCAL ] FOUR: Loaded 49761 existing records from primary storage. [2025-10-21T18:49:53.021826] [INFO ] [MAIN ] FOUR: Loaded 49761 existing records. [2025-10-21T18:49:53.204413] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-21T18:49:53.209963] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:49:53.213444] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-21T18:49:53.213531] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-21T18:49:53.214249] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-21T18:49:53.214309] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-21T18:49:53.593173] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:49:53.751015] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-21T18:49:54.551028] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-21T18:49:54.739596] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T18:49:55.253093] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-21T18:49:55.351002] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-21T18:49:55.437203] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T18:49:56.151025] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-21T18:49:56.951048] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-21T18:49:57.215211] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-21T18:49:57.217784] [INFO ] [REMOTE ] FOA: Full fetch complete (21269 records). [2025-10-21T18:49:57.217894] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-21T18:49:57.487047] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-21T18:49:57.535575] [INFO ] [REMOTE ] FNV: Full fetch complete (66918 records). [2025-10-21T18:49:57.541319] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-21T18:49:57.733866] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-21T18:49:57.744195] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-21T18:49:57.766515] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-21T18:49:57.767234] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-21T18:49:57.774357] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-21T18:49:57.812203] [DEBUG] [LOCAL ] FOA: Trimmed 21269 records to 13051 (keeping 200 days of data) [2025-10-21T18:49:58.086361] [DEBUG] [LOCAL ] FOA: Primary data saved (13051 records). [2025-10-21T18:49:58.086485] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-21T18:49:58.086603] [INFO ] [MAIN ] Update Progress: 859/2366 symbols completed. FOA took 30.4s. Estimated remaining: 3h 12m 48s. Rate: 7.8 symbols/min [2025-10-21T18:49:58.086763] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-21T18:49:58.098145] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-21T18:49:58.119209] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-21T18:49:58.130484] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-21T18:49:58.212295] [DEBUG] [LOCAL ] FNV: Trimmed 66918 records to 46145 (keeping 200 days of data) [2025-10-21T18:49:58.312603] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:49:58.487878] [DEBUG] [LOCAL ] FPF: Loaded 18844 existing records from primary storage. [2025-10-21T18:49:58.495747] [INFO ] [MAIN ] FPF: Loaded 18844 existing records. [2025-10-21T18:49:58.721877] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:49:58.747168] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-21T18:49:58.755835] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-21T18:49:58.766175] [DEBUG] [LOCAL ] FNV: Primary data saved (46145 records). [2025-10-21T18:49:58.766539] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-21T18:49:58.766710] [INFO ] [MAIN ] Update Progress: 860/2366 symbols completed. FNV took 44.6s. Estimated remaining: 3h 12m 28s. Rate: 7.8 symbols/min [2025-10-21T18:49:58.766801] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-21T18:49:58.766987] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-21T18:49:59.053905] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T18:49:59.106485] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-21T18:49:59.162231] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-21T18:49:59.187507] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:49:59.373767] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-21T18:49:59.373681] [DEBUG] [LOCAL ] FPH: Loaded 19328 existing records from primary storage. [2025-10-21T18:49:59.396684] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:49:59.397997] [INFO ] [MAIN ] FPH: Loaded 19328 existing records. [2025-10-21T18:49:59.584775] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:49:59.585007] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-21T18:49:59.585054] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-21T18:49:59.585222] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-21T18:49:59.585280] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-21T18:49:59.930329] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:50:00.151005] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-21T18:50:00.276892] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T18:50:00.951105] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-21T18:50:01.282869] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T18:50:01.332797] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T18:50:01.751064] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-21T18:50:02.249816] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T18:50:02.551041] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-21T18:50:02.858290] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T18:50:03.351063] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-21T18:50:03.578049] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T18:50:03.580989] [INFO ] [REMOTE ] FOR: Full fetch complete (29702 records). [2025-10-21T18:50:03.581074] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-21T18:50:03.955820] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-21T18:50:03.955900] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-21T18:50:03.956434] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-21T18:50:03.956472] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-21T18:50:03.957254] [DEBUG] [LOCAL ] FOR: Trimmed 29702 records to 19646 (keeping 200 days of data) [2025-10-21T18:50:04.069096] [DEBUG] [LOCAL ] FOR: Primary data saved (19646 records). [2025-10-21T18:50:04.069236] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-21T18:50:04.069310] [INFO ] [MAIN ] Update Progress: 861/2366 symbols completed. FOR took 29.4s. Estimated remaining: 3h 12m 17s. Rate: 7.8 symbols/min [2025-10-21T18:50:04.156170] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-21T18:50:04.256064] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:50:04.290289] [DEBUG] [LOCAL ] FPI: Loaded 31464 existing records from primary storage. [2025-10-21T18:50:04.290598] [INFO ] [MAIN ] FPI: Loaded 31464 existing records. [2025-10-21T18:50:04.479778] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:50:04.480136] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-21T18:50:04.480258] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-21T18:50:04.480471] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-21T18:50:04.480529] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-21T18:50:04.637445] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T18:50:04.869186] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:50:04.879955] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-21T18:50:04.951027] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-21T18:50:05.751064] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-21T18:50:05.962866] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-21T18:50:06.551001] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-21T18:50:06.847378] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T18:50:07.351050] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-21T18:50:08.151011] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-21T18:50:08.304622] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T18:50:08.433768] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-21T18:50:08.951017] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-21T18:50:09.222215] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T18:50:09.751024] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-21T18:50:10.336780] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T18:50:10.526179] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T18:50:10.551003] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-21T18:50:11.351005] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-21T18:50:11.597957] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T18:50:11.899075] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-21T18:50:12.151042] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-21T18:50:12.951046] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-21T18:50:13.202873] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T18:50:13.751036] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-21T18:50:14.105221] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T18:50:14.551001] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-21T18:50:14.710685] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-21T18:50:15.351018] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-21T18:50:15.600271] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T18:50:16.151070] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-21T18:50:16.951052] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-21T18:50:17.001081] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T18:50:17.190328] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T18:50:17.750998] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-21T18:50:18.079271] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T18:50:18.405628] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-21T18:50:18.551070] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-21T18:50:19.351014] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-21T18:50:19.791684] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T18:50:20.151024] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-21T18:50:20.951018] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-21T18:50:21.085772] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T18:50:21.123904] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-21T18:50:21.126967] [INFO ] [REMOTE ] FPH: Full fetch complete (30839 records). [2025-10-21T18:50:21.127046] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-21T18:50:21.485125] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-21T18:50:21.485200] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-21T18:50:21.485760] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-21T18:50:21.485860] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-21T18:50:21.486555] [DEBUG] [LOCAL ] FPH: Trimmed 30839 records to 19222 (keeping 200 days of data) [2025-10-21T18:50:21.588836] [DEBUG] [LOCAL ] FPH: Primary data saved (19222 records). [2025-10-21T18:50:21.588965] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-21T18:50:21.589054] [INFO ] [MAIN ] Update Progress: 862/2366 symbols completed. FPH took 22.8s. Estimated remaining: 3h 12m 26s. Rate: 7.8 symbols/min [2025-10-21T18:50:21.756218] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:50:21.755218] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-21T18:50:21.802699] [DEBUG] [LOCAL ] FR: Loaded 46684 existing records from primary storage. [2025-10-21T18:50:21.803224] [INFO ] [MAIN ] FR: Loaded 46684 existing records. [2025-10-21T18:50:22.005106] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:50:22.005324] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-21T18:50:22.005377] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-21T18:50:22.005895] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-21T18:50:22.005954] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-21T18:50:22.147309] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-21T18:50:22.431835] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:50:22.551025] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-21T18:50:23.351000] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-21T18:50:23.699082] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-21T18:50:24.085414] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T18:50:24.151053] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-21T18:50:24.722618] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-21T18:50:24.951025] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-21T18:50:25.751016] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-21T18:50:25.936398] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T18:50:26.177912] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T18:50:26.181882] [INFO ] [REMOTE ] FPF: Full fetch complete (26512 records). [2025-10-21T18:50:26.182013] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-21T18:50:26.540599] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-21T18:50:26.540709] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-21T18:50:26.541227] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-21T18:50:26.541269] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-21T18:50:26.542013] [DEBUG] [LOCAL ] FPF: Trimmed 26512 records to 18753 (keeping 200 days of data) [2025-10-21T18:50:26.588562] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-21T18:50:26.662209] [DEBUG] [LOCAL ] FPF: Primary data saved (18753 records). [2025-10-21T18:50:26.662362] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-21T18:50:26.662455] [INFO ] [MAIN ] Update Progress: 863/2366 symbols completed. FPF took 28.6s. Estimated remaining: 3h 12m 14s. Rate: 7.8 symbols/min [2025-10-21T18:50:26.829536] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:50:26.845524] [DEBUG] [LOCAL ] FRA: Loaded 14261 existing records from primary storage. [2025-10-21T18:50:26.845790] [INFO ] [MAIN ] FRA: Loaded 14261 existing records. [2025-10-21T18:50:27.021389] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:50:27.021604] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-21T18:50:27.021820] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-21T18:50:27.022150] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-21T18:50:27.022206] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-21T18:50:27.354361] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-21T18:50:27.377111] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:50:27.400602] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T18:50:28.151287] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-21T18:50:28.487457] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T18:50:28.495393] [INFO ] [REMOTE ] FOUR: Full fetch complete (72237 records). [2025-10-21T18:50:28.495505] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-21T18:50:28.883929] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T18:50:28.901312] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-21T18:50:28.908794] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-21T18:50:28.909716] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-21T18:50:28.910177] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-21T18:50:28.911437] [DEBUG] [LOCAL ] FOUR: Trimmed 72237 records to 49722 (keeping 200 days of data) [2025-10-21T18:50:28.961470] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-21T18:50:29.201475] [DEBUG] [LOCAL ] FOUR: Primary data saved (49722 records). [2025-10-21T18:50:29.201605] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-21T18:50:29.202476] [INFO ] [MAIN ] Update Progress: 864/2366 symbols completed. FOUR took 36.4s. Estimated remaining: 3h 11m 57s. Rate: 7.8 symbols/min [2025-10-21T18:50:29.368484] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:50:29.388553] [DEBUG] [LOCAL ] FRGE: Loaded 15767 existing records from primary storage. [2025-10-21T18:50:29.388805] [INFO ] [MAIN ] FRGE: Loaded 15767 existing records. [2025-10-21T18:50:29.568957] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:50:29.569222] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-21T18:50:29.569271] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-21T18:50:29.569417] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-21T18:50:29.569454] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-21T18:50:29.759848] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-21T18:50:29.950516] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:50:29.977294] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T18:50:30.409209] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T18:50:30.551060] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-21T18:50:31.174150] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T18:50:31.351096] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-21T18:50:31.911161] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T18:50:32.151034] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-21T18:50:32.354023] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T18:50:32.951019] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-21T18:50:33.751049] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-21T18:50:33.945198] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T18:50:34.076547] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T18:50:34.551053] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-21T18:50:34.758913] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-21T18:50:35.351045] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-21T18:50:35.738257] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T18:50:36.151060] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-21T18:50:36.604539] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T18:50:36.951040] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-21T18:50:37.112730] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-21T18:50:37.751073] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-21T18:50:38.551011] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-21T18:50:38.736567] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T18:50:39.052138] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T18:50:39.351035] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-21T18:50:39.556507] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-21T18:50:40.151069] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-21T18:50:40.894104] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T18:50:40.951003] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-21T18:50:41.399279] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T18:50:41.751085] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-21T18:50:42.482398] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-21T18:50:42.551024] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-21T18:50:43.039578] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-21T18:50:43.351051] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-21T18:50:44.111110] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T18:50:44.150978] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-21T18:50:44.358778] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T18:50:44.951025] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-21T18:50:45.433016] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T18:50:45.440541] [INFO ] [REMOTE ] FR: Full fetch complete (67157 records). [2025-10-21T18:50:45.440702] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-21T18:50:45.756192] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-21T18:50:45.830721] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-21T18:50:45.830805] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-21T18:50:45.831611] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-21T18:50:45.831678] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-21T18:50:45.833883] [DEBUG] [LOCAL ] FR: Trimmed 67157 records to 46672 (keeping 200 days of data) [2025-10-21T18:50:46.116228] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T18:50:46.132496] [DEBUG] [LOCAL ] FR: Primary data saved (46672 records). [2025-10-21T18:50:46.132810] [INFO ] [MAIN ] FR: Full history saved. [2025-10-21T18:50:46.132931] [INFO ] [MAIN ] Update Progress: 865/2366 symbols completed. FR took 24.5s. Estimated remaining: 3h 12m 6s. Rate: 7.8 symbols/min [2025-10-21T18:50:46.132621] [INFO ] [REMOTE ] FPI: Full fetch complete (43845 records). [2025-10-21T18:50:46.144486] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-21T18:50:46.469377] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:50:46.569365] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-21T18:50:46.617553] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-21T18:50:46.725538] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-21T18:50:46.725617] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-21T18:50:46.726401] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-21T18:50:46.726463] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-21T18:50:46.727401] [DEBUG] [LOCAL ] FPI: Trimmed 43845 records to 31413 (keeping 200 days of data) [2025-10-21T18:50:46.840420] [DEBUG] [LOCAL ] FRO: Loaded 51691 existing records from primary storage. [2025-10-21T18:50:46.843499] [INFO ] [MAIN ] FRO: Loaded 51691 existing records. [2025-10-21T18:50:47.083912] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:50:47.104004] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-21T18:50:47.111364] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-21T18:50:47.116559] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-21T18:50:47.118001] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-21T18:50:47.226967] [DEBUG] [LOCAL ] FPI: Primary data saved (31413 records). [2025-10-21T18:50:47.227206] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-21T18:50:47.230978] [INFO ] [MAIN ] Update Progress: 866/2366 symbols completed. FPI took 43.2s. Estimated remaining: 3h 11m 47s. Rate: 7.8 symbols/min [2025-10-21T18:50:47.359791] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-21T18:50:47.619553] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-21T18:50:47.618743] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:50:47.702894] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:50:47.735761] [DEBUG] [LOCAL ] FRT: Loaded 41648 existing records from primary storage. [2025-10-21T18:50:47.736030] [INFO ] [MAIN ] FRT: Loaded 41648 existing records. [2025-10-21T18:50:47.911587] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:50:47.911813] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-21T18:50:47.911862] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-21T18:50:47.912053] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-21T18:50:47.912093] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-21T18:50:48.156107] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-21T18:50:48.267060] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:50:48.387055] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-21T18:50:48.951036] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-21T18:50:49.750999] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-21T18:50:49.932163] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-21T18:50:50.127906] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-21T18:50:50.550992] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-21T18:50:50.752359] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-21T18:50:51.351032] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-21T18:50:52.089442] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T18:50:52.151018] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-21T18:50:52.216372] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-21T18:50:52.951063] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-21T18:50:53.751006] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-21T18:50:53.816751] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T18:50:53.974320] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T18:50:53.976597] [INFO ] [REMOTE ] FRGE: Full fetch complete (30314 records). [2025-10-21T18:50:53.976701] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-21T18:50:54.341376] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-21T18:50:54.341455] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-21T18:50:54.342010] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-21T18:50:54.342071] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-21T18:50:54.342813] [DEBUG] [LOCAL ] FRGE: Trimmed 30314 records to 15653 (keeping 200 days of data) [2025-10-21T18:50:54.432416] [DEBUG] [LOCAL ] FRGE: Primary data saved (15653 records). [2025-10-21T18:50:54.432552] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-21T18:50:54.432627] [INFO ] [MAIN ] Update Progress: 867/2366 symbols completed. FRGE took 25.2s. Estimated remaining: 3h 11m 38s. Rate: 7.8 symbols/min [2025-10-21T18:50:54.556091] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-21T18:50:54.603563] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:50:54.638195] [DEBUG] [LOCAL ] FSCO: Loaded 38696 existing records from primary storage. [2025-10-21T18:50:54.638464] [INFO ] [MAIN ] FSCO: Loaded 38696 existing records. [2025-10-21T18:50:54.816153] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:50:54.816453] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-21T18:50:54.816511] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-21T18:50:54.816901] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-21T18:50:54.816959] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-21T18:50:55.165895] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:50:55.350995] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-21T18:50:55.489410] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-21T18:50:55.632062] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-21T18:50:56.151076] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-21T18:50:56.853844] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-21T18:50:56.951007] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-21T18:50:57.035225] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-21T18:50:57.751081] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-21T18:50:58.551089] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-21T18:50:58.583074] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T18:50:58.601549] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-21T18:50:59.351024] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-21T18:51:00.151081] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-21T18:51:00.459475] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T18:51:00.951111] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-21T18:51:01.638518] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-21T18:51:01.751052] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-21T18:51:01.783797] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T18:51:02.147945] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T18:51:02.150795] [INFO ] [REMOTE ] FRA: Full fetch complete (23487 records). [2025-10-21T18:51:02.150937] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-21T18:51:02.545679] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-21T18:51:02.545804] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-21T18:51:02.546353] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-21T18:51:02.546397] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-21T18:51:02.547188] [DEBUG] [LOCAL ] FRA: Trimmed 23487 records to 14225 (keeping 200 days of data) [2025-10-21T18:51:02.583277] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-21T18:51:02.640345] [DEBUG] [LOCAL ] FRA: Primary data saved (14225 records). [2025-10-21T18:51:02.640485] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-21T18:51:02.640567] [INFO ] [MAIN ] Update Progress: 868/2366 symbols completed. FRA took 36.0s. Estimated remaining: 3h 11m 31s. Rate: 7.8 symbols/min [2025-10-21T18:51:02.841999] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:51:02.889619] [DEBUG] [LOCAL ] FSK: Loaded 49506 existing records from primary storage. [2025-10-21T18:51:02.889966] [INFO ] [MAIN ] FSK: Loaded 49506 existing records. [2025-10-21T18:51:03.072722] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:51:03.073020] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-21T18:51:03.073162] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-21T18:51:03.073372] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-21T18:51:03.073414] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-21T18:51:03.356421] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-21T18:51:03.456818] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:51:03.460671] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T18:51:04.150996] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-21T18:51:04.615111] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-21T18:51:04.924706] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T18:51:04.951067] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-21T18:51:05.751001] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-21T18:51:05.791189] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T18:51:06.444112] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-21T18:51:06.551018] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-21T18:51:07.297577] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T18:51:07.350987] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-21T18:51:08.075700] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T18:51:08.151010] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-21T18:51:08.951005] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-21T18:51:08.953885] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T18:51:09.329044] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T18:51:09.751071] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-21T18:51:10.271752] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T18:51:10.551068] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-21T18:51:11.351088] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-21T18:51:11.515361] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T18:51:12.103229] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T18:51:12.151028] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-21T18:51:12.950991] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-21T18:51:13.122522] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-21T18:51:13.652313] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T18:51:13.751001] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-21T18:51:14.333438] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T18:51:14.551052] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-21T18:51:15.213621] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-21T18:51:15.219806] [INFO ] [REMOTE ] FRT: Full fetch complete (60476 records). [2025-10-21T18:51:15.219927] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-21T18:51:15.356575] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-21T18:51:15.604733] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-21T18:51:15.604812] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-21T18:51:15.605564] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-21T18:51:15.605603] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-21T18:51:15.606730] [DEBUG] [LOCAL ] FRT: Trimmed 60476 records to 41559 (keeping 200 days of data) [2025-10-21T18:51:15.859132] [DEBUG] [LOCAL ] FRT: Primary data saved (41559 records). [2025-10-21T18:51:15.859272] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-21T18:51:15.859363] [INFO ] [MAIN ] Update Progress: 869/2366 symbols completed. FRT took 28.6s. Estimated remaining: 3h 11m 33s. Rate: 7.8 symbols/min [2025-10-21T18:51:16.034106] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:51:16.081140] [DEBUG] [LOCAL ] FSLY: Loaded 51345 existing records from primary storage. [2025-10-21T18:51:16.081458] [INFO ] [MAIN ] FSLY: Loaded 51345 existing records. [2025-10-21T18:51:16.158685] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-21T18:51:16.273004] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:51:16.273410] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-21T18:51:16.273515] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-21T18:51:16.283219] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-21T18:51:16.299600] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-21T18:51:16.367794] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T18:51:16.673192] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:51:16.938508] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T18:51:16.950968] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-21T18:51:17.750990] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-21T18:51:18.060962] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-21T18:51:18.134980] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-21T18:51:18.551023] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-21T18:51:19.353312] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-21T18:51:19.356082] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T18:51:19.916998] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T18:51:20.151030] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-21T18:51:20.951028] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-21T18:51:21.282228] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T18:51:21.498080] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T18:51:21.751019] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-21T18:51:22.410118] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T18:51:22.551033] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-21T18:51:23.351035] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-21T18:51:23.559707] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-21T18:51:23.732257] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T18:51:24.151092] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-21T18:51:24.951011] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-21T18:51:25.069120] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T18:51:25.751053] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-21T18:51:25.952052] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T18:51:25.959841] [INFO ] [REMOTE ] FSCO: Full fetch complete (55374 records). [2025-10-21T18:51:25.959996] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-21T18:51:26.363690] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-21T18:51:26.363808] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-21T18:51:26.365083] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-21T18:51:26.365153] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-21T18:51:26.366760] [DEBUG] [LOCAL ] FSCO: Trimmed 55374 records to 38651 (keeping 200 days of data) [2025-10-21T18:51:26.554629] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-21T18:51:26.617903] [DEBUG] [LOCAL ] FSCO: Primary data saved (38651 records). [2025-10-21T18:51:26.618137] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-21T18:51:26.619220] [INFO ] [MAIN ] Update Progress: 870/2366 symbols completed. FSCO took 32.2s. Estimated remaining: 3h 11m 31s. Rate: 7.8 symbols/min [2025-10-21T18:51:26.822526] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:51:26.853733] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T18:51:26.917062] [DEBUG] [LOCAL ] FSM: Loaded 53303 existing records from primary storage. [2025-10-21T18:51:26.917553] [INFO ] [MAIN ] FSM: Loaded 53303 existing records. [2025-10-21T18:51:27.110013] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:51:27.110551] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-21T18:51:27.110677] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-21T18:51:27.111065] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-21T18:51:27.111173] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-21T18:51:27.368574] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-21T18:51:27.494506] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T18:51:27.538336] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:51:28.040921] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-21T18:51:28.151033] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-21T18:51:28.961126] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-21T18:51:28.962807] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-21T18:51:28.972140] [INFO ] [REMOTE ] FRO: Full fetch complete (75373 records). [2025-10-21T18:51:28.972277] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-21T18:51:29.361050] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-21T18:51:29.361127] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-21T18:51:29.362045] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-21T18:51:29.362108] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-21T18:51:29.363485] [DEBUG] [LOCAL ] FRO: Trimmed 75373 records to 51688 (keeping 200 days of data) [2025-10-21T18:51:29.670080] [DEBUG] [LOCAL ] FRO: Primary data saved (51688 records). [2025-10-21T18:51:29.670211] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-21T18:51:29.670287] [INFO ] [MAIN ] Update Progress: 871/2366 symbols completed. FRO took 43.5s. Estimated remaining: 3h 11m 15s. Rate: 7.8 symbols/min [2025-10-21T18:51:29.752204] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-21T18:51:29.849584] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:51:29.884114] [DEBUG] [LOCAL ] FSS: Loaded 33463 existing records from primary storage. [2025-10-21T18:51:29.884567] [INFO ] [MAIN ] FSS: Loaded 33463 existing records. [2025-10-21T18:51:30.072148] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:51:30.072390] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-21T18:51:30.072524] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-21T18:51:30.072829] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-21T18:51:30.072916] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-21T18:51:30.221546] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-21T18:51:30.517998] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:51:30.552570] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T18:51:30.552727] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-21T18:51:31.351075] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-21T18:51:31.706355] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-21T18:51:31.913602] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-21T18:51:32.151033] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-21T18:51:32.951022] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-21T18:51:33.039948] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T18:51:33.751025] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-21T18:51:34.026940] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T18:51:34.035309] [INFO ] [REMOTE ] FSK: Full fetch complete (72136 records). [2025-10-21T18:51:34.035443] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-21T18:51:34.440795] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-21T18:51:34.440882] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-21T18:51:34.441771] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-21T18:51:34.441835] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-21T18:51:34.443306] [DEBUG] [LOCAL ] FSK: Trimmed 72136 records to 49498 (keeping 200 days of data) [2025-10-21T18:51:34.553806] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-21T18:51:34.698203] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T18:51:34.794345] [DEBUG] [LOCAL ] FSK: Primary data saved (49498 records). [2025-10-21T18:51:34.794483] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-21T18:51:34.794638] [INFO ] [MAIN ] Update Progress: 872/2366 symbols completed. FSK took 32.2s. Estimated remaining: 3h 11m 3s. Rate: 7.8 symbols/min [2025-10-21T18:51:34.916072] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-21T18:51:34.990376] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:51:34.998554] [DEBUG] [LOCAL ] FT: Loaded 6734 existing records from primary storage. [2025-10-21T18:51:34.998986] [INFO ] [MAIN ] FT: Loaded 6734 existing records. [2025-10-21T18:51:35.173085] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:51:35.173295] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-21T18:51:35.173352] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-21T18:51:35.173518] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-21T18:51:35.173573] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-21T18:51:35.357383] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-21T18:51:35.534594] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:51:36.151026] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-21T18:51:36.354873] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T18:51:36.951015] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-21T18:51:37.209100] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-21T18:51:37.396991] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-21T18:51:37.618525] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-21T18:51:37.751002] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-21T18:51:38.551031] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-21T18:51:39.364070] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-21T18:51:39.366476] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T18:51:39.957514] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-21T18:51:40.151030] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-21T18:51:40.423755] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T18:51:40.951042] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-21T18:51:41.751025] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-21T18:51:41.986729] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T18:51:42.228866] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-21T18:51:42.297386] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T18:51:42.551041] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-21T18:51:43.351042] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-21T18:51:44.151051] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-21T18:51:44.367354] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T18:51:44.650343] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T18:51:44.664981] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-21T18:51:44.951035] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-21T18:51:45.751039] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-21T18:51:46.411157] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-21T18:51:46.551036] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-21T18:51:47.267070] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-21T18:51:47.275252] [INFO ] [REMOTE ] FSLY: Full fetch complete (74929 records). [2025-10-21T18:51:47.275375] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-21T18:51:47.356155] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-21T18:51:47.671056] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-21T18:51:47.671181] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-21T18:51:47.672249] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-21T18:51:47.672315] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-21T18:51:47.673731] [DEBUG] [LOCAL ] FSLY: Trimmed 74929 records to 51318 (keeping 200 days of data) [2025-10-21T18:51:47.949496] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-21T18:51:47.998614] [DEBUG] [LOCAL ] FSLY: Primary data saved (51318 records). [2025-10-21T18:51:47.998779] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-21T18:51:47.999369] [INFO ] [MAIN ] Update Progress: 873/2366 symbols completed. FSLY took 32.1s. Estimated remaining: 3h 11m 5s. Rate: 7.8 symbols/min [2025-10-21T18:51:48.155227] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-21T18:51:48.175797] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:51:48.192409] [DEBUG] [LOCAL ] FTHY: Loaded 12520 existing records from primary storage. [2025-10-21T18:51:48.192720] [INFO ] [MAIN ] FTHY: Loaded 12520 existing records. [2025-10-21T18:51:48.388465] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:51:48.388807] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-21T18:51:48.388870] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-21T18:51:48.389258] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-21T18:51:48.389318] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-21T18:51:48.805184] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:51:48.951016] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-21T18:51:49.138985] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-21T18:51:49.501420] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T18:51:49.751047] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-21T18:51:49.786215] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-21T18:51:50.551061] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-21T18:51:51.319133] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T18:51:51.324121] [INFO ] [REMOTE ] FSS: Full fetch complete (48573 records). [2025-10-21T18:51:51.324214] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-21T18:51:51.356146] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-21T18:51:51.702673] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-21T18:51:51.702773] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-21T18:51:51.703473] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-21T18:51:51.703513] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-21T18:51:51.704578] [DEBUG] [LOCAL ] FSS: Trimmed 48573 records to 33326 (keeping 200 days of data) [2025-10-21T18:51:51.919274] [DEBUG] [LOCAL ] FSS: Primary data saved (33326 records). [2025-10-21T18:51:51.919422] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-21T18:51:51.919501] [INFO ] [MAIN ] Update Progress: 874/2366 symbols completed. FSS took 22.2s. Estimated remaining: 3h 10m 51s. Rate: 7.8 symbols/min [2025-10-21T18:51:52.094241] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:51:52.145130] [DEBUG] [LOCAL ] FTI: Loaded 53290 existing records from primary storage. [2025-10-21T18:51:52.145452] [INFO ] [MAIN ] FTI: Loaded 53290 existing records. [2025-10-21T18:51:52.156819] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-21T18:51:52.190148] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T18:51:52.345234] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:51:52.345506] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-21T18:51:52.345769] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-21T18:51:52.346027] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-21T18:51:52.346272] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-21T18:51:52.530394] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-21T18:51:52.772475] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:51:52.782390] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-21T18:51:52.951090] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-21T18:51:53.664712] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-21T18:51:53.751064] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-21T18:51:54.533507] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-21T18:51:54.550986] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-21T18:51:55.127304] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-21T18:51:55.351021] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-21T18:51:56.151031] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-21T18:51:56.886917] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-21T18:51:56.951034] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-21T18:51:57.077227] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T18:51:57.537812] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-21T18:51:57.751092] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-21T18:51:58.405589] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-21T18:51:58.551035] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-21T18:51:59.269026] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T18:51:59.351022] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-21T18:52:00.151018] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-21T18:52:00.951012] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-21T18:52:01.000343] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-21T18:52:01.434077] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-21T18:52:01.751035] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-21T18:52:01.790087] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-21T18:52:02.519678] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-21T18:52:02.521441] [INFO ] [REMOTE ] FT: Full fetch complete (9252 records). [2025-10-21T18:52:02.521508] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-21T18:52:02.556175] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-21T18:52:02.892777] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-21T18:52:02.892865] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-21T18:52:02.893119] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-21T18:52:02.893166] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-21T18:52:02.893612] [DEBUG] [LOCAL ] FT: Trimmed 9252 records to 6765 (keeping 200 days of data) [2025-10-21T18:52:02.933197] [DEBUG] [LOCAL ] FT: Primary data saved (6765 records). [2025-10-21T18:52:02.933331] [INFO ] [MAIN ] FT: Full history saved. [2025-10-21T18:52:02.933412] [INFO ] [MAIN ] Update Progress: 875/2366 symbols completed. FT took 28.1s. Estimated remaining: 3h 10m 49s. Rate: 7.8 symbols/min [2025-10-21T18:52:03.120868] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:52:03.155071] [DEBUG] [LOCAL ] FTK: Loaded 32881 existing records from primary storage. [2025-10-21T18:52:03.155361] [INFO ] [MAIN ] FTK: Loaded 32881 existing records. [2025-10-21T18:52:03.333754] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:52:03.333986] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-21T18:52:03.334042] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-21T18:52:03.334239] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-21T18:52:03.334295] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-21T18:52:03.356091] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-21T18:52:03.626317] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T18:52:03.705733] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:52:04.151054] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-21T18:52:04.951004] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-21T18:52:04.995037] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-21T18:52:05.116213] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T18:52:05.751062] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-21T18:52:06.152131] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T18:52:06.551065] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-21T18:52:07.350995] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-21T18:52:07.390348] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-21T18:52:07.539085] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T18:52:08.151007] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-21T18:52:08.254389] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T18:52:08.257304] [INFO ] [REMOTE ] FTHY: Full fetch complete (17309 records). [2025-10-21T18:52:08.257391] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-21T18:52:08.660736] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-21T18:52:08.660822] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-21T18:52:08.661203] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-21T18:52:08.661244] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-21T18:52:08.661803] [DEBUG] [LOCAL ] FTHY: Trimmed 17309 records to 12518 (keeping 200 days of data) [2025-10-21T18:52:08.736615] [DEBUG] [LOCAL ] FTHY: Primary data saved (12518 records). [2025-10-21T18:52:08.736779] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-21T18:52:08.736865] [INFO ] [MAIN ] Update Progress: 876/2366 symbols completed. FTHY took 20.7s. Estimated remaining: 3h 10m 38s. Rate: 7.8 symbols/min [2025-10-21T18:52:08.909726] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:52:08.950626] [DEBUG] [LOCAL ] FTS: Loaded 42558 existing records from primary storage. [2025-10-21T18:52:08.950964] [INFO ] [MAIN ] FTS: Loaded 42558 existing records. [2025-10-21T18:52:08.962256] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-21T18:52:09.130340] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:52:09.130535] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-21T18:52:09.130582] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-21T18:52:09.130840] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-21T18:52:09.130903] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-21T18:52:09.491930] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:52:09.751057] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-21T18:52:09.798360] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T18:52:10.310565] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T18:52:10.551083] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-21T18:52:11.351009] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-21T18:52:11.382176] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T18:52:11.496446] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T18:52:12.151010] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-21T18:52:12.917353] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T18:52:12.951026] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-21T18:52:13.597681] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T18:52:13.751062] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-21T18:52:14.551040] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-21T18:52:14.816932] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-21T18:52:15.240463] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T18:52:15.351031] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-21T18:52:16.048922] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T18:52:16.151045] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-21T18:52:16.951055] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-21T18:52:17.059331] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T18:52:17.751080] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-21T18:52:18.000173] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T18:52:18.433251] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T18:52:18.551077] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-21T18:52:19.351048] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-21T18:52:19.517382] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T18:52:20.040240] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T18:52:20.151032] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-21T18:52:20.840786] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-21T18:52:20.951024] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-21T18:52:21.665864] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T18:52:21.750994] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-21T18:52:21.891555] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-21T18:52:22.551025] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-21T18:52:23.282144] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T18:52:23.351001] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-21T18:52:23.945912] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T18:52:24.151049] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-21T18:52:24.951086] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-21T18:52:25.160292] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T18:52:25.751043] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-21T18:52:26.115454] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T18:52:26.125125] [INFO ] [REMOTE ] FSM: Full fetch complete (77127 records). [2025-10-21T18:52:26.125283] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-21T18:52:26.560802] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-21T18:52:26.558606] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-21T18:52:26.562108] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-21T18:52:26.564775] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T18:52:26.563619] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-21T18:52:26.570693] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-21T18:52:26.571090] [INFO ] [REMOTE ] FTK: Full fetch complete (43945 records). [2025-10-21T18:52:26.571179] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-21T18:52:26.647307] [DEBUG] [LOCAL ] FSM: Trimmed 77127 records to 53303 (keeping 200 days of data) [2025-10-21T18:52:27.215757] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-21T18:52:27.223324] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-21T18:52:27.224678] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-21T18:52:27.232512] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-21T18:52:27.272284] [DEBUG] [LOCAL ] FTK: Trimmed 43945 records to 32948 (keeping 200 days of data) [2025-10-21T18:52:27.381045] [DEBUG] [LOCAL ] FSM: Primary data saved (53303 records). [2025-10-21T18:52:27.420226] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-21T18:52:27.433793] [INFO ] [MAIN ] Update Progress: 877/2366 symbols completed. FSM took 1m 1s. Estimated remaining: 3h 10m 49s. Rate: 7.8 symbols/min [2025-10-21T18:52:27.452774] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T18:52:27.477924] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-21T18:52:27.564751] [DEBUG] [LOCAL ] FTK: Primary data saved (32948 records). [2025-10-21T18:52:27.564883] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-21T18:52:27.564975] [INFO ] [MAIN ] Update Progress: 878/2366 symbols completed. FTK took 24.6s. Estimated remaining: 3h 10m 29s. Rate: 7.8 symbols/min [2025-10-21T18:52:28.473105] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T18:52:28.481931] [INFO ] [REMOTE ] FTI: Full fetch complete (77331 records). [2025-10-21T18:52:28.482086] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-21T18:52:28.880003] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-21T18:52:28.880099] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-21T18:52:28.881056] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-21T18:52:28.881120] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-21T18:52:28.882564] [DEBUG] [LOCAL ] FTI: Trimmed 77331 records to 53293 (keeping 200 days of data) [2025-10-21T18:52:29.229339] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-21T18:52:29.253459] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-21T18:52:29.265398] [DEBUG] [LOCAL ] FTI: Primary data saved (53293 records). [2025-10-21T18:52:29.266558] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-21T18:52:29.267469] [INFO ] [MAIN ] Update Progress: 879/2366 symbols completed. FTI took 37.3s. Estimated remaining: 3h 10m 11s. Rate: 7.8 symbols/min [2025-10-21T18:52:30.689067] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-21T18:52:30.701162] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-21T18:52:32.156971] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T18:52:32.166052] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-21T18:52:33.775804] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T18:52:33.783098] [INFO ] [REMOTE ] FTS: Full fetch complete (60729 records). [2025-10-21T18:52:33.783241] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-21T18:52:34.191609] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-21T18:52:34.191733] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-21T18:52:34.192627] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-21T18:52:34.192724] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-21T18:52:34.194012] [DEBUG] [LOCAL ] FTS: Trimmed 60729 records to 42523 (keeping 200 days of data) [2025-10-21T18:52:34.446905] [DEBUG] [LOCAL ] FTS: Primary data saved (42523 records). [2025-10-21T18:52:34.447032] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-21T18:52:34.447385] [INFO ] [MAIN ] Update Progress: 880/2366 symbols completed. FTS took 25.7s. Estimated remaining: 3h 9m 59s. Rate: 7.8 symbols/min [2025-10-21T18:52:35.209073] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:52:35.215105] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:52:35.213308] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:52:35.212299] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:52:35.225345] [DEBUG] [LOCAL ] FTWO: Loaded 1955 existing records from primary storage. [2025-10-21T18:52:35.225805] [INFO ] [MAIN ] FTWO: Loaded 1955 existing records. [2025-10-21T18:52:35.446177] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:52:35.415587] [DEBUG] [LOCAL ] FUL: Loaded 32097 existing records from primary storage. [2025-10-21T18:52:35.461244] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-21T18:52:35.460943] [INFO ] [MAIN ] FUL: Loaded 32097 existing records. [2025-10-21T18:52:35.472965] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-21T18:52:35.532389] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-21T18:52:35.541297] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-21T18:52:35.552942] [DEBUG] [LOCAL ] FUBO: Loaded 53718 existing records from primary storage. [2025-10-21T18:52:35.644592] [INFO ] [MAIN ] FUBO: Loaded 53718 existing records. [2025-10-21T18:52:35.724260] [DEBUG] [LOCAL ] FTV: Loaded 53059 existing records from primary storage. [2025-10-21T18:52:35.824904] [INFO ] [MAIN ] FTV: Loaded 53059 existing records. [2025-10-21T18:52:36.004150] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:52:36.085021] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-21T18:52:36.138980] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-21T18:52:36.243719] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:52:36.207000] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-21T18:52:36.307130] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-21T18:52:36.314293] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-21T18:52:36.320349] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-21T18:52:36.454246] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-21T18:52:36.522201] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:52:36.591244] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-21T18:52:36.596621] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-21T18:52:36.569260] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-21T18:52:36.591142] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:52:36.655343] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-21T18:52:36.677548] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-21T18:52:36.677140] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-21T18:52:37.179122] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:52:37.211446] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-21T18:52:37.483032] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-21T18:52:37.558273] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-21T18:52:37.640493] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:52:37.644515] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-21T18:52:37.673790] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:52:37.674089] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-21T18:52:38.085038] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-21T18:52:38.086341] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-21T18:52:38.564846] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-21T18:52:38.566066] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-21T18:52:38.587570] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T18:52:38.594982] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-21T18:52:39.015886] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-21T18:52:39.017380] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-21T18:52:39.289469] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-21T18:52:39.290876] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-21T18:52:39.363915] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T18:52:39.374545] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-21T18:52:39.877408] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T18:52:39.884063] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-21T18:52:40.055749] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-21T18:52:40.094520] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-21T18:52:40.151014] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-21T18:52:40.960076] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-21T18:52:40.979864] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T18:52:41.025044] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T18:52:41.440593] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T18:52:41.751053] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-21T18:52:42.373994] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-21T18:52:42.551006] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-21T18:52:43.208555] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T18:52:43.351041] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-21T18:52:43.775589] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-21T18:52:44.151043] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-21T18:52:44.237674] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T18:52:44.951036] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-21T18:52:45.751076] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-21T18:52:46.285589] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-21T18:52:46.529697] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T18:52:46.550989] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-21T18:52:46.695670] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T18:52:47.351061] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-21T18:52:47.487766] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-21T18:52:47.636369] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-21T18:52:48.151108] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-21T18:52:48.951048] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-21T18:52:49.751093] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-21T18:52:50.341343] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-21T18:52:50.343630] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-21T18:52:50.345227] [INFO ] [REMOTE ] FTWO: Full fetch complete (3336 records). [2025-10-21T18:52:50.355857] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-21T18:52:50.528554] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T18:52:50.566428] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-21T18:52:50.782444] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-21T18:52:50.782521] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-21T18:52:50.782636] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-21T18:52:50.782717] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-21T18:52:50.783069] [DEBUG] [LOCAL ] FTWO: Trimmed 3336 records to 1964 (keeping 200 days of data) [2025-10-21T18:52:50.795168] [DEBUG] [LOCAL ] FTWO: Primary data saved (1964 records). [2025-10-21T18:52:50.795265] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-21T18:52:50.795342] [INFO ] [MAIN ] Update Progress: 881/2366 symbols completed. FTWO took 16.3s. Estimated remaining: 3h 10m 6s. Rate: 7.8 symbols/min [2025-10-21T18:52:50.982936] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:52:51.030114] [DEBUG] [LOCAL ] FUN: Loaded 52012 existing records from primary storage. [2025-10-21T18:52:51.030410] [INFO ] [MAIN ] FUN: Loaded 52012 existing records. [2025-10-21T18:52:51.203054] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:52:51.203243] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-21T18:52:51.203289] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-21T18:52:51.203595] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-21T18:52:51.203680] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-21T18:52:51.374252] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-21T18:52:51.561038] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:52:52.151065] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-21T18:52:52.914256] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-21T18:52:52.950997] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-21T18:52:53.202469] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T18:52:53.751056] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-21T18:52:53.779989] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T18:52:54.551109] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-21T18:52:55.228817] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T18:52:55.350883] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-21T18:52:55.351008] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-21T18:52:55.752794] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-21T18:52:56.151024] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-21T18:52:56.640025] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-21T18:52:56.951025] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-21T18:52:57.751079] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-21T18:52:58.498808] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-21T18:52:58.550990] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-21T18:52:58.592347] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T18:52:59.350997] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-21T18:52:59.487347] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T18:53:00.151071] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-21T18:53:00.951041] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-21T18:53:01.103842] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-21T18:53:01.231246] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-21T18:53:01.377937] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T18:53:01.382787] [INFO ] [REMOTE ] FUL: Full fetch complete (47699 records). [2025-10-21T18:53:01.382877] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-21T18:53:01.757719] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-21T18:53:01.758491] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-21T18:53:01.758790] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-21T18:53:01.759512] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-21T18:53:01.759587] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-21T18:53:01.761626] [DEBUG] [LOCAL ] FUL: Trimmed 47699 records to 31998 (keeping 200 days of data) [2025-10-21T18:53:01.972978] [DEBUG] [LOCAL ] FUL: Primary data saved (31998 records). [2025-10-21T18:53:01.973138] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-21T18:53:01.973816] [INFO ] [MAIN ] Update Progress: 882/2366 symbols completed. FUL took 27.5s. Estimated remaining: 3h 10m 4s. Rate: 7.8 symbols/min [2025-10-21T18:53:02.149221] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:53:02.173398] [DEBUG] [LOCAL ] FVR: Loaded 20901 existing records from primary storage. [2025-10-21T18:53:02.173615] [INFO ] [MAIN ] FVR: Loaded 20901 existing records. [2025-10-21T18:53:02.364960] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:53:02.365225] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-21T18:53:02.365273] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-21T18:53:02.365455] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-21T18:53:02.365513] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-21T18:53:02.575368] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-21T18:53:02.733535] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:53:03.196919] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-21T18:53:03.351028] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-21T18:53:03.980917] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-21T18:53:04.151074] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-21T18:53:04.400057] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T18:53:04.951044] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-21T18:53:05.143892] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T18:53:05.751042] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-21T18:53:05.911558] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-21T18:53:06.081321] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-21T18:53:06.089780] [INFO ] [REMOTE ] FUBO: Full fetch complete (77868 records). [2025-10-21T18:53:06.089930] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-21T18:53:06.505177] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-21T18:53:06.505262] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-21T18:53:06.506193] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-21T18:53:06.506263] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-21T18:53:06.507794] [DEBUG] [LOCAL ] FUBO: Trimmed 77868 records to 53718 (keeping 200 days of data) [2025-10-21T18:53:06.552824] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-21T18:53:06.816195] [DEBUG] [LOCAL ] FUBO: Primary data saved (53718 records). [2025-10-21T18:53:06.816338] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-21T18:53:06.816415] [INFO ] [MAIN ] Update Progress: 883/2366 symbols completed. FUBO took 32.4s. Estimated remaining: 3h 9m 52s. Rate: 7.8 symbols/min [2025-10-21T18:53:06.984116] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:53:07.026473] [DEBUG] [LOCAL ] FVRR: Loaded 40712 existing records from primary storage. [2025-10-21T18:53:07.026800] [INFO ] [MAIN ] FVRR: Loaded 40712 existing records. [2025-10-21T18:53:07.230877] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:53:07.231073] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-21T18:53:07.231118] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-21T18:53:07.231365] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-21T18:53:07.231404] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-21T18:53:07.351292] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-21T18:53:07.540621] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-21T18:53:07.643098] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:53:07.646578] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T18:53:08.151046] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-21T18:53:08.951005] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-21T18:53:08.984983] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T18:53:09.751009] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-21T18:53:09.940334] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T18:53:09.948533] [INFO ] [REMOTE ] FTV: Full fetch complete (76625 records). [2025-10-21T18:53:09.948699] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-21T18:53:10.350960] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-21T18:53:10.351195] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-21T18:53:10.352185] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-21T18:53:10.352271] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-21T18:53:10.353695] [DEBUG] [LOCAL ] FTV: Trimmed 76625 records to 53034 (keeping 200 days of data) [2025-10-21T18:53:10.568403] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-21T18:53:10.678113] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T18:53:10.726399] [DEBUG] [LOCAL ] FTV: Primary data saved (53034 records). [2025-10-21T18:53:10.726537] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-21T18:53:10.726613] [INFO ] [MAIN ] Update Progress: 884/2366 symbols completed. FTV took 36.3s. Estimated remaining: 3h 9m 38s. Rate: 7.8 symbols/min [2025-10-21T18:53:10.900516] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:53:10.904383] [DEBUG] [LOCAL ] FXED: Loaded 1237 existing records from primary storage. [2025-10-21T18:53:10.904714] [INFO ] [MAIN ] FXED: Loaded 1237 existing records. [2025-10-21T18:53:11.093065] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:53:11.093359] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-21T18:53:11.093478] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-21T18:53:11.093631] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-21T18:53:11.093767] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-21T18:53:11.364063] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-21T18:53:11.374156] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T18:53:11.509748] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:53:11.790083] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-21T18:53:12.151087] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-21T18:53:12.424223] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-21T18:53:12.941724] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T18:53:12.950980] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-21T18:53:13.297308] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-21T18:53:13.751080] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-21T18:53:14.551034] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-21T18:53:15.351066] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-21T18:53:15.417991] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T18:53:15.657808] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-21T18:53:16.151074] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-21T18:53:16.563154] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-21T18:53:16.950996] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-21T18:53:16.992322] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T18:53:17.751023] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-21T18:53:18.078988] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-21T18:53:18.094798] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-21T18:53:18.551079] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-21T18:53:19.351039] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-21T18:53:19.695594] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-21T18:53:20.150997] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-21T18:53:20.318429] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T18:53:20.951088] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-21T18:53:21.674380] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T18:53:21.751128] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-21T18:53:22.016371] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-21T18:53:22.551042] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-21T18:53:23.007727] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T18:53:23.351034] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-21T18:53:24.150997] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-21T18:53:24.380354] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T18:53:24.388559] [INFO ] [REMOTE ] FUN: Full fetch complete (73456 records). [2025-10-21T18:53:24.388722] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-21T18:53:24.543319] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-21T18:53:24.826085] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-21T18:53:24.826382] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-21T18:53:24.827575] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-21T18:53:24.827752] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-21T18:53:24.829496] [DEBUG] [LOCAL ] FUN: Trimmed 73456 records to 52023 (keeping 200 days of data) [2025-10-21T18:53:24.947397] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T18:53:24.955743] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-21T18:53:25.160612] [DEBUG] [LOCAL ] FUN: Primary data saved (52023 records). [2025-10-21T18:53:25.160768] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-21T18:53:25.160850] [INFO ] [MAIN ] Update Progress: 885/2366 symbols completed. FUN took 34.4s. Estimated remaining: 3h 9m 41s. Rate: 7.8 symbols/min [2025-10-21T18:53:25.334039] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:53:25.383354] [DEBUG] [LOCAL ] G: Loaded 50114 existing records from primary storage. [2025-10-21T18:53:25.383739] [INFO ] [MAIN ] G: Loaded 50114 existing records. [2025-10-21T18:53:25.485101] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-21T18:53:25.573770] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:53:25.573947] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-21T18:53:25.573993] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-21T18:53:25.574247] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-21T18:53:25.574285] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-21T18:53:25.763355] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-21T18:53:25.955214] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:53:26.550998] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-21T18:53:26.916444] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-21T18:53:27.351068] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-21T18:53:27.777322] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-21T18:53:28.140946] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T18:53:28.152801] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-21T18:53:28.951021] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-21T18:53:29.176434] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-21T18:53:29.751046] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-21T18:53:30.551017] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-21T18:53:30.596869] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T18:53:30.674851] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T18:53:31.351027] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-21T18:53:32.163122] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-21T18:53:32.192441] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T18:53:32.494579] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T18:53:32.498338] [INFO ] [REMOTE ] FVR: Full fetch complete (29308 records). [2025-10-21T18:53:32.498448] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-21T18:53:32.692671] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-21T18:53:32.917968] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-21T18:53:32.918089] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-21T18:53:32.918973] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-21T18:53:32.919044] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-21T18:53:32.920296] [DEBUG] [LOCAL ] FVR: Trimmed 29308 records to 20869 (keeping 200 days of data) [2025-10-21T18:53:32.974736] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-21T18:53:33.064272] [DEBUG] [LOCAL ] FVR: Primary data saved (20869 records). [2025-10-21T18:53:33.064461] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-21T18:53:33.064565] [INFO ] [MAIN ] Update Progress: 886/2366 symbols completed. FVR took 31.1s. Estimated remaining: 3h 9m 34s. Rate: 7.8 symbols/min [2025-10-21T18:53:33.236428] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:53:33.265147] [DEBUG] [LOCAL ] GAB: Loaded 27744 existing records from primary storage. [2025-10-21T18:53:33.265526] [INFO ] [MAIN ] GAB: Loaded 27744 existing records. [2025-10-21T18:53:33.375046] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-21T18:53:33.386800] [INFO ] [REMOTE ] FXED: Full fetch complete (1792 records). [2025-10-21T18:53:33.392040] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-21T18:53:33.574302] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:53:33.590188] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-21T18:53:33.620280] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-21T18:53:33.630829] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-21T18:53:33.641024] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-21T18:53:33.760487] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-21T18:53:34.084306] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-21T18:53:34.125680] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-21T18:53:34.139151] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-21T18:53:34.157757] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-21T18:53:34.170109] [DEBUG] [LOCAL ] FXED: Trimmed 1792 records to 1238 (keeping 200 days of data) [2025-10-21T18:53:34.215168] [DEBUG] [LOCAL ] FXED: Primary data saved (1238 records). [2025-10-21T18:53:34.225595] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-21T18:53:34.252608] [INFO ] [MAIN ] Update Progress: 887/2366 symbols completed. FXED took 23.5s. Estimated remaining: 3h 9m 15s. Rate: 7.8 symbols/min [2025-10-21T18:53:34.367061] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:53:34.475160] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:53:34.482315] [DEBUG] [LOCAL ] GAM: Loaded 3901 existing records from primary storage. [2025-10-21T18:53:34.482602] [INFO ] [MAIN ] GAM: Loaded 3901 existing records. [2025-10-21T18:53:34.556260] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-21T18:53:34.677403] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:53:34.677632] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-21T18:53:34.677719] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-21T18:53:34.677913] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-21T18:53:34.677970] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-21T18:53:35.038377] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:53:35.351009] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-21T18:53:35.643884] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T18:53:36.151078] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-21T18:53:36.211966] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T18:53:36.348193] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T18:53:36.950993] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-21T18:53:37.565917] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T18:53:37.752402] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-21T18:53:37.754761] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-21T18:53:38.551031] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-21T18:53:38.860814] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-21T18:53:39.278237] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T18:53:39.350997] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-21T18:53:39.952883] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-21T18:53:40.151033] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-21T18:53:40.728346] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-21T18:53:40.951012] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-21T18:53:41.751054] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-21T18:53:41.932013] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T18:53:42.551037] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-21T18:53:43.351090] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-21T18:53:43.416786] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T18:53:43.423428] [INFO ] [REMOTE ] FVRR: Full fetch complete (59292 records). [2025-10-21T18:53:43.423581] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-21T18:53:43.817260] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-21T18:53:43.817364] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-21T18:53:43.818290] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-21T18:53:43.818387] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-21T18:53:43.836443] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T18:53:43.842973] [DEBUG] [LOCAL ] FVRR: Trimmed 59292 records to 40625 (keeping 200 days of data) [2025-10-21T18:53:44.076857] [DEBUG] [LOCAL ] FVRR: Primary data saved (40625 records). [2025-10-21T18:53:44.076989] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-21T18:53:44.077067] [INFO ] [MAIN ] Update Progress: 888/2366 symbols completed. FVRR took 37.3s. Estimated remaining: 3h 9m 11s. Rate: 7.8 symbols/min [2025-10-21T18:53:44.156228] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-21T18:53:44.246527] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:53:44.296235] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-21T18:53:44.296519] [INFO ] [MAIN ] GAP: Loaded 53653 existing records. [2025-10-21T18:53:44.470239] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:53:44.470513] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-21T18:53:44.470577] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-21T18:53:44.470851] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-21T18:53:44.470909] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-21T18:53:44.873425] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:53:44.873722] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T18:53:44.950985] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-21T18:53:44.998044] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T18:53:45.619762] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-21T18:53:45.751059] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-21T18:53:46.551074] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-21T18:53:47.351069] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-21T18:53:47.455963] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T18:53:47.916074] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-21T18:53:48.151099] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-21T18:53:48.264580] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T18:53:48.951048] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-21T18:53:49.751067] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-21T18:53:49.838140] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T18:53:50.230752] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-21T18:53:50.545769] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T18:53:50.552745] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-21T18:53:51.351049] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-21T18:53:52.150989] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-21T18:53:52.373815] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T18:53:52.562677] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T18:53:52.865094] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T18:53:52.866302] [INFO ] [REMOTE ] GAM: Full fetch complete (6519 records). [2025-10-21T18:53:52.866391] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-21T18:53:52.956254] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-21T18:53:53.223125] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-21T18:53:53.223225] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-21T18:53:53.223424] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-21T18:53:53.223484] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-21T18:53:53.224049] [DEBUG] [LOCAL ] GAM: Trimmed 6519 records to 3873 (keeping 200 days of data) [2025-10-21T18:53:53.245892] [DEBUG] [LOCAL ] GAM: Primary data saved (3873 records). [2025-10-21T18:53:53.245962] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-21T18:53:53.246029] [INFO ] [MAIN ] Update Progress: 889/2366 symbols completed. GAM took 19.0s. Estimated remaining: 3h 9m 6s. Rate: 7.8 symbols/min [2025-10-21T18:53:53.425547] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:53:53.444615] [DEBUG] [LOCAL ] GATX: Loaded 18106 existing records from primary storage. [2025-10-21T18:53:53.444877] [INFO ] [MAIN ] GATX: Loaded 18106 existing records. [2025-10-21T18:53:53.622258] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:53:53.622443] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-21T18:53:53.622488] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-21T18:53:53.622771] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-21T18:53:53.622833] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-21T18:53:53.760162] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-21T18:53:53.976463] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:53:54.209293] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T18:53:54.551065] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-21T18:53:55.351084] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-21T18:53:55.746603] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T18:53:56.151060] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-21T18:53:56.262573] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T18:53:56.581321] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-21T18:53:56.951058] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-21T18:53:57.247922] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T18:53:57.751058] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-21T18:53:58.469738] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T18:53:58.550444] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T18:53:58.557038] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-21T18:53:59.351031] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-21T18:54:00.151006] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-21T18:54:00.578224] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-21T18:54:00.643481] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-21T18:54:00.951038] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-21T18:54:01.275534] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T18:54:01.751266] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-21T18:54:02.520131] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T18:54:02.524630] [INFO ] [REMOTE ] GAB: Full fetch complete (39401 records). [2025-10-21T18:54:02.524782] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-21T18:54:02.557342] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-21T18:54:02.900753] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-21T18:54:02.900822] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-21T18:54:02.901381] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-21T18:54:02.901418] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-21T18:54:02.902278] [DEBUG] [LOCAL ] GAB: Trimmed 39401 records to 27631 (keeping 200 days of data) [2025-10-21T18:54:03.056003] [DEBUG] [LOCAL ] GAB: Primary data saved (27631 records). [2025-10-21T18:54:03.056132] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-21T18:54:03.056230] [INFO ] [MAIN ] Update Progress: 890/2366 symbols completed. GAB took 30.0s. Estimated remaining: 3h 9m 2s. Rate: 7.8 symbols/min [2025-10-21T18:54:03.227617] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:54:03.243748] [DEBUG] [LOCAL ] GBAB: Loaded 12847 existing records from primary storage. [2025-10-21T18:54:03.243946] [INFO ] [MAIN ] GBAB: Loaded 12847 existing records. [2025-10-21T18:54:03.357307] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-21T18:54:03.429350] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:54:03.430018] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-21T18:54:03.430285] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-21T18:54:03.436026] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-21T18:54:03.440268] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-21T18:54:03.485734] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-21T18:54:03.843316] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:54:03.847784] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-21T18:54:04.150998] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-21T18:54:04.951034] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-21T18:54:05.141253] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T18:54:05.184669] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T18:54:05.751087] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-21T18:54:06.540579] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T18:54:06.550982] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-21T18:54:07.350990] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-21T18:54:07.491987] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T18:54:07.499861] [INFO ] [REMOTE ] G: Full fetch complete (72268 records). [2025-10-21T18:54:07.499976] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-21T18:54:07.799445] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T18:54:07.905438] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-21T18:54:07.905521] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-21T18:54:07.906466] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-21T18:54:07.906531] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-21T18:54:07.907941] [DEBUG] [LOCAL ] G: Trimmed 72268 records to 50109 (keeping 200 days of data) [2025-10-21T18:54:08.151083] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-21T18:54:08.231702] [DEBUG] [LOCAL ] G: Primary data saved (50109 records). [2025-10-21T18:54:08.231853] [INFO ] [MAIN ] G: Full history saved. [2025-10-21T18:54:08.231944] [INFO ] [MAIN ] Update Progress: 891/2366 symbols completed. G took 43.1s. Estimated remaining: 3h 8m 50s. Rate: 7.8 symbols/min [2025-10-21T18:54:08.398502] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:54:08.437802] [DEBUG] [LOCAL ] GBCI: Loaded 41215 existing records from primary storage. [2025-10-21T18:54:08.438139] [INFO ] [MAIN ] GBCI: Loaded 41215 existing records. [2025-10-21T18:54:08.611760] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:54:08.611946] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-21T18:54:08.611992] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-21T18:54:08.612188] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-21T18:54:08.612226] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-21T18:54:08.953964] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-21T18:54:08.981767] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:54:09.098784] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-21T18:54:09.206374] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T18:54:09.519779] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T18:54:09.751055] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-21T18:54:10.551014] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-21T18:54:10.565009] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T18:54:11.351023] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-21T18:54:11.603495] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T18:54:12.151033] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-21T18:54:12.951133] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-21T18:54:13.161021] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-21T18:54:13.378434] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-21T18:54:13.751049] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-21T18:54:13.824209] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-21T18:54:14.551070] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-21T18:54:14.848032] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-21T18:54:15.351094] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-21T18:54:16.135557] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T18:54:16.150987] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-21T18:54:16.654343] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-21T18:54:16.951043] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-21T18:54:17.055812] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-21T18:54:17.751044] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-21T18:54:18.551039] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-21T18:54:19.008525] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T18:54:19.011250] [INFO ] [REMOTE ] GATX: Full fetch complete (24973 records). [2025-10-21T18:54:19.011339] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-21T18:54:19.374701] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-21T18:54:19.440687] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-21T18:54:19.440932] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-21T18:54:19.452066] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-21T18:54:19.453085] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-21T18:54:19.453164] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-21T18:54:19.454308] [DEBUG] [LOCAL ] GATX: Trimmed 24973 records to 18144 (keeping 200 days of data) [2025-10-21T18:54:19.548388] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-21T18:54:19.580880] [DEBUG] [LOCAL ] GATX: Primary data saved (18144 records). [2025-10-21T18:54:19.581008] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-21T18:54:19.581084] [INFO ] [MAIN ] Update Progress: 892/2366 symbols completed. GATX took 26.3s. Estimated remaining: 3h 8m 49s. Rate: 7.8 symbols/min [2025-10-21T18:54:19.767797] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:54:19.768022] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-21T18:54:19.768064] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-21T18:54:19.768180] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-21T18:54:19.768221] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-21T18:54:19.768262] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-21T18:54:19.768297] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-21T18:54:20.149535] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:54:20.150995] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-21T18:54:20.533608] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-21T18:54:20.829202] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T18:54:20.951095] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-21T18:54:21.274340] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-21T18:54:21.751043] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-21T18:54:22.112150] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-21T18:54:22.551022] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-21T18:54:22.908446] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-21T18:54:23.351044] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-21T18:54:24.151049] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-21T18:54:24.951011] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-21T18:54:25.290258] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-21T18:54:25.299010] [INFO ] [REMOTE ] GAP: Full fetch complete (77812 records). [2025-10-21T18:54:25.299179] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-21T18:54:25.378198] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-21T18:54:25.742027] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-21T18:54:25.742182] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-21T18:54:25.743827] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-21T18:54:25.745073] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-21T18:54:25.744982] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T18:54:25.752671] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-21T18:54:25.756144] [DEBUG] [LOCAL ] GAP: Trimmed 77812 records to 53653 (keeping 200 days of data) [2025-10-21T18:54:26.078923] [DEBUG] [LOCAL ] GAP: Primary data saved (53653 records). [2025-10-21T18:54:26.079053] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-21T18:54:26.079745] [INFO ] [MAIN ] Update Progress: 893/2366 symbols completed. GAP took 42.0s. Estimated remaining: 3h 8m 39s. Rate: 7.8 symbols/min [2025-10-21T18:54:26.249494] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:54:26.289188] [DEBUG] [LOCAL ] GBTG: Loaded 40310 existing records from primary storage. [2025-10-21T18:54:26.289506] [INFO ] [MAIN ] GBTG: Loaded 40310 existing records. [2025-10-21T18:54:26.464691] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:54:26.464892] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-21T18:54:26.464952] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-21T18:54:26.465300] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-21T18:54:26.465357] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-21T18:54:26.556165] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-21T18:54:26.808170] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-21T18:54:26.901826] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-21T18:54:26.901480] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:54:27.351091] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-21T18:54:28.126619] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-21T18:54:28.150989] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-21T18:54:28.951047] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-21T18:54:29.271027] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-21T18:54:29.345949] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T18:54:29.348213] [INFO ] [REMOTE ] GBAB: Full fetch complete (18804 records). [2025-10-21T18:54:29.348292] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-21T18:54:29.717045] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-21T18:54:29.717136] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-21T18:54:29.717564] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-21T18:54:29.717622] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-21T18:54:29.718219] [DEBUG] [LOCAL ] GBAB: Trimmed 18804 records to 12766 (keeping 200 days of data) [2025-10-21T18:54:29.756100] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-21T18:54:29.796488] [DEBUG] [LOCAL ] GBAB: Primary data saved (12766 records). [2025-10-21T18:54:29.796592] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-21T18:54:29.796697] [INFO ] [MAIN ] Update Progress: 894/2366 symbols completed. GBAB took 26.7s. Estimated remaining: 3h 8m 25s. Rate: 7.8 symbols/min [2025-10-21T18:54:29.978494] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:54:30.007518] [DEBUG] [LOCAL ] GBX: Loaded 28567 existing records from primary storage. [2025-10-21T18:54:30.007920] [INFO ] [MAIN ] GBX: Loaded 28567 existing records. [2025-10-21T18:54:30.200981] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:54:30.201215] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-21T18:54:30.201263] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-21T18:54:30.201470] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-21T18:54:30.201542] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-21T18:54:30.556717] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-21T18:54:30.590235] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:54:31.208698] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T18:54:31.351003] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-21T18:54:31.811489] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-21T18:54:32.145866] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T18:54:32.154166] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-21T18:54:32.951021] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-21T18:54:33.295573] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-21T18:54:33.652717] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-21T18:54:33.750987] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-21T18:54:34.550984] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-21T18:54:35.022093] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T18:54:35.351044] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-21T18:54:35.805260] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-21T18:54:35.805969] [INFO ] [REMOTE ] GBLI: Full fetch complete (1273 records). [2025-10-21T18:54:35.806034] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-21T18:54:35.987952] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-10-21T18:54:35.988190] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:54:35.988290] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:54:35.988370] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-21T18:54:35.988542] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-21T18:54:35.988627] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-21T18:54:35.988822] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-21T18:54:35.988962] [INFO ] [MAIN ] Update Progress: 895/2366 symbols completed. GBLI took 16.4s. Estimated remaining: 3h 8m 15s. Rate: 7.8 symbols/min [2025-10-21T18:54:36.166021] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:54:36.162691] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-21T18:54:36.192979] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T18:54:36.234163] [DEBUG] [LOCAL ] GCI: Loaded 43764 existing records from primary storage. [2025-10-21T18:54:36.234435] [INFO ] [MAIN ] GCI: Loaded 43764 existing records. [2025-10-21T18:54:36.407713] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:54:36.407947] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-21T18:54:36.407998] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-21T18:54:36.408269] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-21T18:54:36.408324] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-21T18:54:36.756897] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:54:36.950982] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-21T18:54:37.426093] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-21T18:54:37.751105] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-21T18:54:38.264322] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-21T18:54:38.551095] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-21T18:54:38.837113] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-21T18:54:39.351085] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-21T18:54:40.099259] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T18:54:40.151043] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-21T18:54:40.408570] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T18:54:40.951024] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-21T18:54:41.352891] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T18:54:41.751065] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-21T18:54:42.367152] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T18:54:42.551032] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-21T18:54:43.078980] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T18:54:43.350996] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-21T18:54:44.031736] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T18:54:44.150999] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-21T18:54:44.951012] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-21T18:54:45.012318] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T18:54:45.676163] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T18:54:45.751020] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-21T18:54:46.262938] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T18:54:46.500017] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T18:54:46.550986] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-21T18:54:47.351064] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-21T18:54:47.945883] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T18:54:48.151033] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-21T18:54:48.833494] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T18:54:48.951026] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-21T18:54:49.259994] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-21T18:54:49.751096] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-21T18:54:50.551090] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-21T18:54:50.632254] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T18:54:50.831299] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-21T18:54:51.351095] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-21T18:54:52.152071] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-21T18:54:52.155549] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T18:54:52.950991] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-21T18:54:53.040785] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T18:54:53.291450] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T18:54:53.295607] [INFO ] [REMOTE ] GBX: Full fetch complete (42797 records). [2025-10-21T18:54:53.295721] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-21T18:54:53.663092] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-21T18:54:53.663170] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-21T18:54:53.663829] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-21T18:54:53.663889] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-21T18:54:53.664911] [DEBUG] [LOCAL ] GBX: Trimmed 42797 records to 28402 (keeping 200 days of data) [2025-10-21T18:54:53.752893] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-21T18:54:53.833039] [DEBUG] [LOCAL ] GBX: Primary data saved (28402 records). [2025-10-21T18:54:53.833164] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-21T18:54:53.833235] [INFO ] [MAIN ] Update Progress: 896/2366 symbols completed. GBX took 24.0s. Estimated remaining: 3h 8m 24s. Rate: 7.8 symbols/min [2025-10-21T18:54:54.004047] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:54:54.004241] [DEBUG] [LOCAL ] GCO: No existing data file found in primary storage. [2025-10-21T18:54:54.004290] [WARN ] [MAIN ] GCO: No existing data found, performing full refresh instead. [2025-10-21T18:54:54.004400] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-21T18:54:54.004441] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-21T18:54:54.004480] [DEBUG] [LOCAL ] GCO: No primary data file found to delete. [2025-10-21T18:54:54.004511] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-21T18:54:54.365727] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:54:54.388698] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T18:54:54.551040] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-21T18:54:55.315123] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T18:54:55.350986] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-21T18:54:55.915557] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T18:54:56.151008] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-21T18:54:56.951055] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-21T18:54:57.089467] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T18:54:57.097088] [INFO ] [REMOTE ] GBCI: Full fetch complete (59434 records). [2025-10-21T18:54:57.097226] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-21T18:54:57.505040] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-21T18:54:57.505219] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-21T18:54:57.506054] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-21T18:54:57.506138] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-21T18:54:57.522230] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T18:54:57.527334] [DEBUG] [LOCAL ] GBCI: Trimmed 59434 records to 41232 (keeping 200 days of data) [2025-10-21T18:54:57.751093] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-21T18:54:57.776015] [DEBUG] [LOCAL ] GBCI: Primary data saved (41232 records). [2025-10-21T18:54:57.776114] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-21T18:54:57.776193] [INFO ] [MAIN ] Update Progress: 897/2366 symbols completed. GBCI took 49.5s. Estimated remaining: 3h 8m 10s. Rate: 7.8 symbols/min [2025-10-21T18:54:57.943718] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:54:57.963830] [DEBUG] [LOCAL ] GCTS: Loaded 20245 existing records from primary storage. [2025-10-21T18:54:57.964057] [INFO ] [MAIN ] GCTS: Loaded 20245 existing records. [2025-10-21T18:54:58.139112] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:54:58.139305] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-21T18:54:58.139351] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-21T18:54:58.139500] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-21T18:54:58.139537] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-21T18:54:58.501613] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:54:58.550978] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-21T18:54:58.812022] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T18:54:59.261437] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-21T18:54:59.307564] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T18:54:59.351004] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-21T18:55:00.151026] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-21T18:55:00.312325] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-21T18:55:00.951027] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-21T18:55:01.750998] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-21T18:55:01.953798] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T18:55:02.149559] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-21T18:55:02.156734] [INFO ] [REMOTE ] GBTG: Full fetch complete (56802 records). [2025-10-21T18:55:02.156909] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-21T18:55:02.553160] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-21T18:55:02.596725] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-21T18:55:02.596854] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-21T18:55:02.597924] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-21T18:55:02.598138] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-21T18:55:02.612284] [DEBUG] [LOCAL ] GBTG: Trimmed 56802 records to 40249 (keeping 200 days of data) [2025-10-21T18:55:02.612920] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T18:55:02.858564] [DEBUG] [LOCAL ] GBTG: Primary data saved (40249 records). [2025-10-21T18:55:02.858724] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-21T18:55:02.858813] [INFO ] [MAIN ] Update Progress: 898/2366 symbols completed. GBTG took 36.8s. Estimated remaining: 3h 7m 58s. Rate: 7.8 symbols/min [2025-10-21T18:55:03.046480] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:55:03.057743] [DEBUG] [LOCAL ] GCV: Loaded 7831 existing records from primary storage. [2025-10-21T18:55:03.058012] [INFO ] [MAIN ] GCV: Loaded 7831 existing records. [2025-10-21T18:55:03.260842] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:55:03.261108] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-21T18:55:03.261179] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-21T18:55:03.261355] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-21T18:55:03.261418] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-21T18:55:03.356189] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-21T18:55:03.669458] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:55:04.150998] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-21T18:55:04.310087] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T18:55:04.432606] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-21T18:55:04.951008] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-21T18:55:05.179195] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-21T18:55:05.750994] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-21T18:55:05.917352] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T18:55:06.551045] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-21T18:55:07.351034] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-21T18:55:07.394431] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T18:55:07.977452] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-21T18:55:08.038822] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-21T18:55:08.151048] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-21T18:55:08.951047] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-21T18:55:09.324803] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-21T18:55:09.751030] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-21T18:55:10.551021] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-21T18:55:10.616354] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T18:55:10.992169] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T18:55:11.344152] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-21T18:55:11.350974] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-21T18:55:12.151077] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-21T18:55:12.951035] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-21T18:55:13.009418] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-21T18:55:13.037206] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T18:55:13.751106] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-21T18:55:14.344248] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T18:55:14.551027] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-21T18:55:15.351040] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-21T18:55:15.442574] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T18:55:15.449900] [INFO ] [REMOTE ] GCI: Full fetch complete (63284 records). [2025-10-21T18:55:15.450059] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-21T18:55:15.709209] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T18:55:15.862908] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-21T18:55:15.862996] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-21T18:55:15.863824] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-21T18:55:15.863886] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-21T18:55:15.865209] [DEBUG] [LOCAL ] GCI: Trimmed 63284 records to 43632 (keeping 200 days of data) [2025-10-21T18:55:16.105217] [DEBUG] [LOCAL ] GCI: Primary data saved (43632 records). [2025-10-21T18:55:16.105348] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-21T18:55:16.105988] [INFO ] [MAIN ] Update Progress: 899/2366 symbols completed. GCI took 40.1s. Estimated remaining: 3h 7m 59s. Rate: 7.8 symbols/min [2025-10-21T18:55:16.161363] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-21T18:55:16.281573] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:55:16.325233] [DEBUG] [LOCAL ] GD: Loaded 46577 existing records from primary storage. [2025-10-21T18:55:16.325509] [INFO ] [MAIN ] GD: Loaded 46577 existing records. [2025-10-21T18:55:16.501439] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:55:16.501632] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-21T18:55:16.501730] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-21T18:55:16.501976] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-21T18:55:16.502032] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-21T18:55:16.846011] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T18:55:16.881046] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:55:16.950974] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-21T18:55:17.107393] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-21T18:55:17.751028] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-21T18:55:18.551056] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-21T18:55:18.756917] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T18:55:18.832157] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-21T18:55:19.015047] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-21T18:55:19.351025] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-21T18:55:20.151033] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-21T18:55:20.951097] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-21T18:55:21.098634] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T18:55:21.164287] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-21T18:55:21.751034] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-21T18:55:22.124674] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T18:55:22.128019] [INFO ] [REMOTE ] GCTS: Full fetch complete (26748 records). [2025-10-21T18:55:22.128104] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-21T18:55:22.496623] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-21T18:55:22.496755] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-21T18:55:22.497272] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-21T18:55:22.497311] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-21T18:55:22.498075] [DEBUG] [LOCAL ] GCTS: Trimmed 26748 records to 20218 (keeping 200 days of data) [2025-10-21T18:55:22.575741] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-21T18:55:22.614034] [DEBUG] [LOCAL ] GCTS: Primary data saved (20218 records). [2025-10-21T18:55:22.614140] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-21T18:55:22.614213] [INFO ] [MAIN ] Update Progress: 900/2366 symbols completed. GCTS took 24.8s. Estimated remaining: 3h 7m 50s. Rate: 7.8 symbols/min [2025-10-21T18:55:22.808321] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:55:22.854140] [DEBUG] [LOCAL ] GDDY: Loaded 49758 existing records from primary storage. [2025-10-21T18:55:22.854433] [INFO ] [MAIN ] GDDY: Loaded 49758 existing records. [2025-10-21T18:55:23.032189] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:55:23.032404] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-21T18:55:23.037090] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-21T18:55:23.037691] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-21T18:55:23.039911] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-21T18:55:23.040281] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-21T18:55:23.351271] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-21T18:55:23.408070] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:55:23.439411] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T18:55:24.134465] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-21T18:55:24.150989] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-21T18:55:24.951047] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-21T18:55:25.751028] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-21T18:55:25.820480] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T18:55:26.201061] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-21T18:55:26.551073] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-21T18:55:26.793328] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T18:55:27.214151] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-21T18:55:27.351030] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-21T18:55:28.151060] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-21T18:55:28.404908] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T18:55:28.604289] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-21T18:55:28.951013] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-21T18:55:29.751036] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-21T18:55:29.803035] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-21T18:55:29.805192] [INFO ] [REMOTE ] GCV: Full fetch complete (9876 records). [2025-10-21T18:55:29.805268] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-21T18:55:30.171384] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-21T18:55:30.171462] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-21T18:55:30.171718] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-21T18:55:30.171778] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-21T18:55:30.172209] [DEBUG] [LOCAL ] GCV: Trimmed 9876 records to 7809 (keeping 200 days of data) [2025-10-21T18:55:30.217377] [DEBUG] [LOCAL ] GCV: Primary data saved (7809 records). [2025-10-21T18:55:30.217508] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-21T18:55:30.217584] [INFO ] [MAIN ] Update Progress: 901/2366 symbols completed. GCV took 27.4s. Estimated remaining: 3h 7m 42s. Rate: 7.8 symbols/min [2025-10-21T18:55:30.390473] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:55:30.396630] [DEBUG] [LOCAL ] GDIV: Loaded 3580 existing records from primary storage. [2025-10-21T18:55:30.396841] [INFO ] [MAIN ] GDIV: Loaded 3580 existing records. [2025-10-21T18:55:30.554781] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-21T18:55:30.578626] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:55:30.579016] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-21T18:55:30.579084] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-21T18:55:30.579209] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-21T18:55:30.579246] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-21T18:55:30.768779] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T18:55:30.855522] [INFO ] [REMOTE ] GCO: Full fetch complete (34763 records). [2025-10-21T18:55:30.877952] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-21T18:55:31.064514] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:55:31.341102] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-21T18:55:31.341179] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-21T18:55:31.341790] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-21T18:55:31.341850] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-21T18:55:31.342682] [DEBUG] [LOCAL ] GCO: Trimmed 34763 records to 23035 (keeping 200 days of data) [2025-10-21T18:55:31.389778] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-21T18:55:31.476210] [DEBUG] [LOCAL ] GCO: Primary data saved (23035 records). [2025-10-21T18:55:31.476339] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-21T18:55:31.476409] [INFO ] [MAIN ] Update Progress: 902/2366 symbols completed. GCO took 37.6s. Estimated remaining: 3h 7m 24s. Rate: 7.8 symbols/min [2025-10-21T18:55:31.672988] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:55:31.677689] [DEBUG] [LOCAL ] GDL: Loaded 2525 existing records from primary storage. [2025-10-21T18:55:31.677879] [INFO ] [MAIN ] GDL: Loaded 2525 existing records. [2025-10-21T18:55:31.865627] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:55:31.865844] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-21T18:55:31.865892] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-21T18:55:31.866013] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-21T18:55:31.866051] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-21T18:55:32.151502] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-21T18:55:32.234332] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:55:32.367499] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T18:55:32.667934] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-21T18:55:32.838096] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T18:55:32.951021] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-21T18:55:33.751070] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-21T18:55:34.551012] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-21T18:55:34.782901] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T18:55:35.173060] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-21T18:55:35.351090] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-21T18:55:35.534896] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T18:55:35.661359] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-21T18:55:36.151030] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-21T18:55:36.598446] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-21T18:55:36.951097] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-21T18:55:37.590724] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T18:55:37.750992] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-21T18:55:38.371914] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-21T18:55:38.551013] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-21T18:55:39.158822] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-21T18:55:39.351103] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-21T18:55:40.151063] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-21T18:55:40.951102] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-21T18:55:41.418927] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-21T18:55:41.483409] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-21T18:55:41.750997] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-21T18:55:41.848091] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T18:55:42.551025] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-21T18:55:43.050750] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-21T18:55:43.062844] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-21T18:55:43.351035] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-21T18:55:43.819689] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-21T18:55:44.151052] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-21T18:55:44.951071] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-21T18:55:45.485923] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-21T18:55:45.753317] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-21T18:55:45.755902] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-21T18:55:46.288398] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-21T18:55:46.551098] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-21T18:55:47.351000] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-21T18:55:47.426366] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T18:55:47.433387] [INFO ] [REMOTE ] GD: Full fetch complete (69683 records). [2025-10-21T18:55:47.433522] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-21T18:55:47.834852] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-21T18:55:47.834983] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-21T18:55:47.835879] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-21T18:55:47.835941] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-21T18:55:47.837269] [DEBUG] [LOCAL ] GD: Trimmed 69683 records to 46538 (keeping 200 days of data) [2025-10-21T18:55:47.930875] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T18:55:48.133910] [DEBUG] [LOCAL ] GD: Primary data saved (46538 records). [2025-10-21T18:55:48.134052] [INFO ] [MAIN ] GD: Full history saved. [2025-10-21T18:55:48.135147] [INFO ] [MAIN ] Update Progress: 903/2366 symbols completed. GD took 32.0s. Estimated remaining: 3h 7m 30s. Rate: 7.8 symbols/min [2025-10-21T18:55:48.159521] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-21T18:55:48.319399] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:55:48.327460] [DEBUG] [LOCAL ] GDO: Loaded 5840 existing records from primary storage. [2025-10-21T18:55:48.327694] [INFO ] [MAIN ] GDO: Loaded 5840 existing records. [2025-10-21T18:55:48.505122] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:55:48.505342] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-21T18:55:48.505409] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-21T18:55:48.505682] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-21T18:55:48.505755] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-21T18:55:48.860825] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:55:48.951052] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-21T18:55:49.414203] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-21T18:55:49.750989] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-21T18:55:50.026897] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T18:55:50.551060] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-21T18:55:50.720055] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T18:55:51.351032] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-21T18:55:51.796083] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-21T18:55:51.970251] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T18:55:52.151025] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-21T18:55:52.782293] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-21T18:55:52.783739] [INFO ] [REMOTE ] GDIV: Full fetch complete (5418 records). [2025-10-21T18:55:52.783837] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-21T18:55:52.956381] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-21T18:55:53.147000] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-21T18:55:53.147076] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-21T18:55:53.147248] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-21T18:55:53.147287] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-21T18:55:53.147676] [DEBUG] [LOCAL ] GDIV: Trimmed 5418 records to 3542 (keeping 200 days of data) [2025-10-21T18:55:53.168677] [DEBUG] [LOCAL ] GDIV: Primary data saved (3542 records). [2025-10-21T18:55:53.168769] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-21T18:55:53.168858] [INFO ] [MAIN ] Update Progress: 904/2366 symbols completed. GDIV took 23.0s. Estimated remaining: 3h 7m 19s. Rate: 7.8 symbols/min [2025-10-21T18:55:53.343332] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:55:53.378214] [DEBUG] [LOCAL ] GDOT: Loaded 37755 existing records from primary storage. [2025-10-21T18:55:53.378480] [INFO ] [MAIN ] GDOT: Loaded 37755 existing records. [2025-10-21T18:55:53.560918] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-21T18:55:53.560628] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:55:53.563246] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-21T18:55:53.563305] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-21T18:55:53.563688] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-21T18:55:53.563745] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-21T18:55:53.756205] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-21T18:55:53.930775] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:55:54.436005] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-21T18:55:54.551058] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-21T18:55:55.241609] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-21T18:55:55.351068] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-21T18:55:55.937926] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-21T18:55:56.151061] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-21T18:55:56.951031] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-21T18:55:57.444231] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-21T18:55:57.569808] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-21T18:55:57.751029] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-21T18:55:58.294147] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-21T18:55:58.551017] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-21T18:55:59.147604] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-21T18:55:59.351029] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-21T18:56:00.151049] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-21T18:56:00.756026] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-21T18:56:00.950989] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-21T18:56:01.392434] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-21T18:56:01.571783] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-21T18:56:01.751051] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-21T18:56:02.417991] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-21T18:56:02.418911] [INFO ] [REMOTE ] GDL: Full fetch complete (3484 records). [2025-10-21T18:56:02.418976] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-21T18:56:02.559700] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-21T18:56:02.782798] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-21T18:56:02.782875] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-21T18:56:02.783000] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-21T18:56:02.783039] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-21T18:56:02.783378] [DEBUG] [LOCAL ] GDL: Trimmed 3484 records to 2519 (keeping 200 days of data) [2025-10-21T18:56:02.798637] [DEBUG] [LOCAL ] GDL: Primary data saved (2519 records). [2025-10-21T18:56:02.798727] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-21T18:56:02.798796] [INFO ] [MAIN ] Update Progress: 905/2366 symbols completed. GDL took 31.3s. Estimated remaining: 3h 7m 14s. Rate: 7.8 symbols/min [2025-10-21T18:56:02.972882] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:56:02.991012] [DEBUG] [LOCAL ] GDV: Loaded 19418 existing records from primary storage. [2025-10-21T18:56:02.991266] [INFO ] [MAIN ] GDV: Loaded 19418 existing records. [2025-10-21T18:56:03.176437] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:56:03.176695] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-21T18:56:03.176753] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-21T18:56:03.176980] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-21T18:56:03.177036] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-21T18:56:03.351996] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-21T18:56:03.539823] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:56:03.753015] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T18:56:04.156910] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T18:56:04.156032] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-21T18:56:04.951012] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-21T18:56:05.751002] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-21T18:56:06.041357] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T18:56:06.262507] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T18:56:06.355902] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-21T18:56:06.551272] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-21T18:56:07.185775] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-21T18:56:07.187169] [INFO ] [REMOTE ] GDO: Full fetch complete (8503 records). [2025-10-21T18:56:07.187251] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-21T18:56:07.367710] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-21T18:56:07.613528] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-21T18:56:07.613607] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-21T18:56:07.613867] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-21T18:56:07.613928] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-21T18:56:07.614341] [DEBUG] [LOCAL ] GDO: Trimmed 8503 records to 5860 (keeping 200 days of data) [2025-10-21T18:56:07.650436] [DEBUG] [LOCAL ] GDO: Primary data saved (5860 records). [2025-10-21T18:56:07.650571] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-21T18:56:07.650672] [INFO ] [MAIN ] Update Progress: 906/2366 symbols completed. GDO took 19.5s. Estimated remaining: 3h 7m 2s. Rate: 7.8 symbols/min [2025-10-21T18:56:07.836827] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:56:07.894386] [DEBUG] [LOCAL ] GE: Loaded 53698 existing records from primary storage. [2025-10-21T18:56:07.894716] [INFO ] [MAIN ] GE: Loaded 53698 existing records. [2025-10-21T18:56:08.073199] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:56:08.073404] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-21T18:56:08.073449] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-21T18:56:08.073874] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-21T18:56:08.073931] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-21T18:56:08.156236] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-21T18:56:08.423017] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:56:08.950997] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-21T18:56:09.131776] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T18:56:09.572585] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-21T18:56:09.751010] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-21T18:56:10.551075] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-21T18:56:11.078307] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-21T18:56:11.155253] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T18:56:11.163124] [INFO ] [REMOTE ] GDDY: Full fetch complete (72127 records). [2025-10-21T18:56:11.163236] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-21T18:56:11.275313] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-21T18:56:11.356111] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-21T18:56:11.568941] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-21T18:56:11.569028] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-21T18:56:11.569920] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-21T18:56:11.569983] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-21T18:56:11.571338] [DEBUG] [LOCAL ] GDDY: Trimmed 72127 records to 49671 (keeping 200 days of data) [2025-10-21T18:56:11.859088] [DEBUG] [LOCAL ] GDDY: Primary data saved (49671 records). [2025-10-21T18:56:11.859214] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-21T18:56:11.859289] [INFO ] [MAIN ] Update Progress: 907/2366 symbols completed. GDDY took 49.2s. Estimated remaining: 3h 6m 48s. Rate: 7.8 symbols/min [2025-10-21T18:56:12.025166] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:56:12.045839] [DEBUG] [LOCAL ] GEF: Loaded 20852 existing records from primary storage. [2025-10-21T18:56:12.046072] [INFO ] [MAIN ] GEF: Loaded 20852 existing records. [2025-10-21T18:56:12.156223] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-21T18:56:12.227179] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:56:12.227375] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-21T18:56:12.227421] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-21T18:56:12.227604] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-21T18:56:12.227692] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-21T18:56:12.578762] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:56:12.951004] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-21T18:56:12.979952] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T18:56:13.751019] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-21T18:56:13.995880] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T18:56:14.173001] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-21T18:56:14.551034] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-21T18:56:14.754460] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T18:56:15.351033] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-21T18:56:16.151003] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-21T18:56:16.473121] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-21T18:56:16.674695] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-21T18:56:16.840471] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T18:56:16.951001] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-21T18:56:17.751003] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-21T18:56:18.062184] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-21T18:56:18.551007] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-21T18:56:18.767467] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-21T18:56:19.351028] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-21T18:56:20.026163] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T18:56:20.151005] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-21T18:56:20.358506] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-21T18:56:20.951027] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-21T18:56:21.751011] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-21T18:56:22.050440] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T18:56:22.326531] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-21T18:56:22.551036] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-21T18:56:23.113300] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T18:56:23.351051] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-21T18:56:23.577614] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T18:56:24.151057] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-21T18:56:24.881757] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T18:56:24.950989] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-21T18:56:25.189070] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-21T18:56:25.751050] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-21T18:56:25.854852] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-21T18:56:26.551053] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-21T18:56:27.351052] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-21T18:56:27.559775] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-21T18:56:27.937252] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-21T18:56:28.151030] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-21T18:56:28.523012] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T18:56:28.951015] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-21T18:56:29.625810] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T18:56:29.733027] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-21T18:56:29.750992] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-21T18:56:30.551023] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-21T18:56:30.769584] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-21T18:56:31.351028] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-21T18:56:31.522243] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-21T18:56:31.525276] [INFO ] [REMOTE ] GDV: Full fetch complete (28393 records). [2025-10-21T18:56:31.525355] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-21T18:56:31.895243] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-21T18:56:31.895318] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-21T18:56:31.895870] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-21T18:56:31.895951] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-21T18:56:31.896600] [DEBUG] [LOCAL ] GDV: Trimmed 28393 records to 19319 (keeping 200 days of data) [2025-10-21T18:56:32.012226] [DEBUG] [LOCAL ] GDV: Primary data saved (19319 records). [2025-10-21T18:56:32.012320] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-21T18:56:32.012398] [INFO ] [MAIN ] Update Progress: 908/2366 symbols completed. GDV took 29.2s. Estimated remaining: 3h 7m 1s. Rate: 7.8 symbols/min [2025-10-21T18:56:32.158989] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-21T18:56:32.189161] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:56:32.222863] [DEBUG] [LOCAL ] GEL: Loaded 31500 existing records from primary storage. [2025-10-21T18:56:32.223139] [INFO ] [MAIN ] GEL: Loaded 31500 existing records. [2025-10-21T18:56:32.340772] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-21T18:56:32.427094] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:56:32.427323] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-21T18:56:32.427394] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-21T18:56:32.427628] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-21T18:56:32.427734] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-21T18:56:32.780027] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:56:32.951018] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-21T18:56:33.751035] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-21T18:56:34.350366] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-21T18:56:34.435678] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T18:56:34.551046] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-21T18:56:34.858092] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T18:56:34.861619] [INFO ] [REMOTE ] GEF: Full fetch complete (29325 records). [2025-10-21T18:56:34.861752] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-21T18:56:35.244414] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-21T18:56:35.244517] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-21T18:56:35.245157] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-21T18:56:35.245219] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-21T18:56:35.245956] [DEBUG] [LOCAL ] GEF: Trimmed 29325 records to 20751 (keeping 200 days of data) [2025-10-21T18:56:35.351703] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-21T18:56:35.370076] [DEBUG] [LOCAL ] GEF: Primary data saved (20751 records). [2025-10-21T18:56:35.370206] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-21T18:56:35.370306] [INFO ] [MAIN ] Update Progress: 909/2366 symbols completed. GEF took 23.5s. Estimated remaining: 3h 6m 46s. Rate: 7.8 symbols/min [2025-10-21T18:56:35.538526] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:56:35.586952] [DEBUG] [LOCAL ] GENI: Loaded 52943 existing records from primary storage. [2025-10-21T18:56:35.587249] [INFO ] [MAIN ] GENI: Loaded 52943 existing records. [2025-10-21T18:56:35.764469] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:56:35.764719] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-21T18:56:35.764776] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-21T18:56:35.765125] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-21T18:56:35.765182] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-21T18:56:36.126019] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:56:36.150986] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-21T18:56:36.201635] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T18:56:36.207616] [INFO ] [REMOTE ] GDOT: Full fetch complete (53644 records). [2025-10-21T18:56:36.207733] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-21T18:56:36.586498] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-21T18:56:36.586572] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-21T18:56:36.587318] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-21T18:56:36.587378] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-21T18:56:36.588499] [DEBUG] [LOCAL ] GDOT: Trimmed 53644 records to 37710 (keeping 200 days of data) [2025-10-21T18:56:36.705741] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T18:56:36.826433] [DEBUG] [LOCAL ] GDOT: Primary data saved (37710 records). [2025-10-21T18:56:36.826559] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-21T18:56:36.826634] [INFO ] [MAIN ] Update Progress: 910/2366 symbols completed. GDOT took 43.7s. Estimated remaining: 3h 6m 28s. Rate: 7.8 symbols/min [2025-10-21T18:56:36.965410] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-21T18:56:36.996119] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:56:37.043427] [DEBUG] [LOCAL ] GEO: Loaded 51753 existing records from primary storage. [2025-10-21T18:56:37.043767] [INFO ] [MAIN ] GEO: Loaded 51753 existing records. [2025-10-21T18:56:37.220937] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:56:37.221176] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-21T18:56:37.221250] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-21T18:56:37.221514] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-21T18:56:37.221553] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-21T18:56:37.596068] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:56:37.750991] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-21T18:56:37.845213] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T18:56:38.260256] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T18:56:38.551038] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-21T18:56:39.351055] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-21T18:56:39.717568] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-21T18:56:40.156823] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-21T18:56:40.174481] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T18:56:40.951082] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-21T18:56:41.703894] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-21T18:56:41.742035] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T18:56:41.750980] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-21T18:56:42.550999] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-21T18:56:42.800381] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T18:56:43.003373] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T18:56:43.351031] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-21T18:56:44.151000] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-21T18:56:44.344974] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T18:56:44.951130] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-21T18:56:45.016022] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T18:56:45.499015] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T18:56:45.751027] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-21T18:56:46.551005] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-21T18:56:46.802660] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T18:56:47.351053] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-21T18:56:47.925353] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-21T18:56:47.991421] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T18:56:48.150993] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-21T18:56:48.951003] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-21T18:56:49.215916] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T18:56:49.621180] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T18:56:49.750999] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-21T18:56:50.551044] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-21T18:56:51.127855] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-21T18:56:51.357504] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-21T18:56:51.362384] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T18:56:52.151043] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-21T18:56:52.284691] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T18:56:52.293169] [INFO ] [REMOTE ] GE: Full fetch complete (77865 records). [2025-10-21T18:56:52.293321] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-21T18:56:52.704758] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-21T18:56:52.738132] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-21T18:56:52.738549] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-21T18:56:52.739501] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-21T18:56:52.739584] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-21T18:56:52.741050] [DEBUG] [LOCAL ] GE: Trimmed 77865 records to 53698 (keeping 200 days of data) [2025-10-21T18:56:52.953317] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-21T18:56:53.074377] [DEBUG] [LOCAL ] GE: Primary data saved (53698 records). [2025-10-21T18:56:53.074501] [INFO ] [MAIN ] GE: Full history saved. [2025-10-21T18:56:53.075197] [INFO ] [MAIN ] Update Progress: 911/2366 symbols completed. GE took 45.4s. Estimated remaining: 3h 6m 34s. Rate: 7.8 symbols/min [2025-10-21T18:56:53.257986] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:56:53.294181] [DEBUG] [LOCAL ] GES: Loaded 38154 existing records from primary storage. [2025-10-21T18:56:53.294450] [INFO ] [MAIN ] GES: Loaded 38154 existing records. [2025-10-21T18:56:53.407980] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-21T18:56:53.491489] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:56:53.491769] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-21T18:56:53.491822] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-21T18:56:53.492105] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-21T18:56:53.492143] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-21T18:56:53.759272] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-21T18:56:53.846701] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:56:54.551059] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-21T18:56:54.803084] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-21T18:56:55.070815] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T18:56:55.074598] [INFO ] [REMOTE ] GEL: Full fetch complete (48043 records). [2025-10-21T18:56:55.074725] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-21T18:56:55.358262] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-21T18:56:55.454887] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-21T18:56:55.454970] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-21T18:56:55.455676] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-21T18:56:55.455737] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-21T18:56:55.456708] [DEBUG] [LOCAL ] GEL: Trimmed 48043 records to 31309 (keeping 200 days of data) [2025-10-21T18:56:55.642944] [DEBUG] [LOCAL ] GEL: Primary data saved (31309 records). [2025-10-21T18:56:55.643068] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-21T18:56:55.643681] [INFO ] [MAIN ] Update Progress: 912/2366 symbols completed. GEL took 23.6s. Estimated remaining: 3h 6m 19s. Rate: 7.8 symbols/min [2025-10-21T18:56:55.816016] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:56:55.842422] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-21T18:56:55.880488] [DEBUG] [LOCAL ] GETY: Loaded 35268 existing records from primary storage. [2025-10-21T18:56:55.880774] [INFO ] [MAIN ] GETY: Loaded 35268 existing records. [2025-10-21T18:56:56.053847] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:56:56.054041] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-21T18:56:56.054087] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-21T18:56:56.054300] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-21T18:56:56.054355] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-21T18:56:56.152509] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-21T18:56:56.407586] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:56:56.951032] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-21T18:56:57.268989] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-21T18:56:57.550683] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-21T18:56:57.751029] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-21T18:56:58.473947] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T18:56:58.551014] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-21T18:56:59.350991] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-21T18:56:59.506259] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T18:57:00.151049] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-21T18:57:00.483434] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T18:57:00.951056] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-21T18:57:01.180737] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T18:57:01.751087] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-21T18:57:02.264814] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-21T18:57:02.551062] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-21T18:57:02.731887] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T18:57:03.351073] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-21T18:57:03.478126] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T18:57:04.150999] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-21T18:57:04.202197] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T18:57:04.666291] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-21T18:57:04.951061] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-21T18:57:05.685118] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T18:57:05.750992] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-21T18:57:05.986455] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-21T18:57:06.551017] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-21T18:57:07.350997] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-21T18:57:07.552123] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-21T18:57:08.151046] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-21T18:57:08.411818] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T18:57:08.756397] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T18:57:08.951099] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-21T18:57:09.613604] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-21T18:57:09.751071] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-21T18:57:10.550988] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-21T18:57:10.790396] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T18:57:11.350985] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-21T18:57:11.529004] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T18:57:11.536915] [INFO ] [REMOTE ] GEO: Full fetch complete (75538 records). [2025-10-21T18:57:11.537055] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-21T18:57:11.928170] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-21T18:57:11.928253] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-21T18:57:11.929178] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-21T18:57:11.929275] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-21T18:57:11.930661] [DEBUG] [LOCAL ] GEO: Trimmed 75538 records to 51739 (keeping 200 days of data) [2025-10-21T18:57:12.158434] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-21T18:57:12.163539] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T18:57:12.259724] [DEBUG] [LOCAL ] GEO: Primary data saved (51739 records). [2025-10-21T18:57:12.259865] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-21T18:57:12.260788] [INFO ] [MAIN ] Update Progress: 913/2366 symbols completed. GEO took 35.4s. Estimated remaining: 3h 6m 25s. Rate: 7.8 symbols/min [2025-10-21T18:57:12.431073] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:57:12.490567] [DEBUG] [LOCAL ] GEV: Loaded 52992 existing records from primary storage. [2025-10-21T18:57:12.491066] [INFO ] [MAIN ] GEV: Loaded 52992 existing records. [2025-10-21T18:57:12.672892] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:57:12.673099] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-21T18:57:12.673146] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-21T18:57:12.673367] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-21T18:57:12.673424] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-21T18:57:12.958083] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-21T18:57:13.039319] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:57:13.535359] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-21T18:57:13.543868] [INFO ] [REMOTE ] GENI: Full fetch complete (76087 records). [2025-10-21T18:57:13.544002] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-21T18:57:13.733888] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T18:57:13.753900] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-21T18:57:13.987025] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-21T18:57:13.987115] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-21T18:57:13.988083] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-21T18:57:13.988210] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-21T18:57:13.989630] [DEBUG] [LOCAL ] GENI: Trimmed 76087 records to 52937 (keeping 200 days of data) [2025-10-21T18:57:14.293624] [DEBUG] [LOCAL ] GENI: Primary data saved (52937 records). [2025-10-21T18:57:14.293800] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-21T18:57:14.293885] [INFO ] [MAIN ] Update Progress: 914/2366 symbols completed. GENI took 38.9s. Estimated remaining: 3h 6m 8s. Rate: 7.8 symbols/min [2025-10-21T18:57:14.478389] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:57:14.500395] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T18:57:14.502337] [DEBUG] [LOCAL ] GF: Loaded 2662 existing records from primary storage. [2025-10-21T18:57:14.509566] [INFO ] [MAIN ] GF: Loaded 2662 existing records. [2025-10-21T18:57:14.556171] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-21T18:57:14.697236] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:57:14.697505] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-21T18:57:14.697551] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-21T18:57:14.697715] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-21T18:57:14.697770] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-21T18:57:15.053236] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:57:15.351072] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-21T18:57:15.902259] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-21T18:57:15.993679] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-21T18:57:16.059707] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T18:57:16.150977] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-21T18:57:16.951075] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-21T18:57:17.546142] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T18:57:17.751050] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-21T18:57:18.412912] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T18:57:18.551110] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-21T18:57:18.943801] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-21T18:57:19.351058] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-21T18:57:20.033004] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T18:57:20.038973] [INFO ] [REMOTE ] GETY: Full fetch complete (55653 records). [2025-10-21T18:57:20.039071] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-21T18:57:20.156100] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-21T18:57:20.423069] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-21T18:57:20.423141] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-21T18:57:20.423922] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-21T18:57:20.423985] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-21T18:57:20.425160] [DEBUG] [LOCAL ] GETY: Trimmed 55653 records to 35197 (keeping 200 days of data) [2025-10-21T18:57:20.615234] [DEBUG] [LOCAL ] GETY: Primary data saved (35197 records). [2025-10-21T18:57:20.615364] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-21T18:57:20.615989] [INFO ] [MAIN ] Update Progress: 915/2366 symbols completed. GETY took 25.0s. Estimated remaining: 3h 5m 59s. Rate: 7.8 symbols/min [2025-10-21T18:57:20.804930] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:57:20.835908] [DEBUG] [LOCAL ] GFF: Loaded 29664 existing records from primary storage. [2025-10-21T18:57:20.836161] [INFO ] [MAIN ] GFF: Loaded 29664 existing records. [2025-10-21T18:57:20.953904] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-21T18:57:20.955003] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-21T18:57:21.029977] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:57:21.030281] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-21T18:57:21.030337] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-21T18:57:21.030709] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-21T18:57:21.030767] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-21T18:57:21.389485] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:57:21.756736] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-21T18:57:21.764808] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-21T18:57:22.332155] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-21T18:57:22.551067] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-21T18:57:22.624614] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T18:57:23.186155] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-21T18:57:23.351063] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-21T18:57:24.151077] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-21T18:57:24.661213] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-21T18:57:24.726539] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-21T18:57:24.951052] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-21T18:57:25.751033] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-21T18:57:26.199967] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-21T18:57:26.394370] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-21T18:57:26.399905] [INFO ] [REMOTE ] GES: Full fetch complete (58409 records). [2025-10-21T18:57:26.400004] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-21T18:57:26.556139] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-21T18:57:26.796796] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-21T18:57:26.796874] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-21T18:57:26.797622] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-21T18:57:26.797696] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-21T18:57:26.798833] [DEBUG] [LOCAL ] GES: Trimmed 58409 records to 37978 (keeping 200 days of data) [2025-10-21T18:57:27.027023] [DEBUG] [LOCAL ] GES: Primary data saved (37978 records). [2025-10-21T18:57:27.027162] [INFO ] [MAIN ] GES: Full history saved. [2025-10-21T18:57:27.027865] [INFO ] [MAIN ] Update Progress: 916/2366 symbols completed. GES took 34.0s. Estimated remaining: 3h 5m 49s. Rate: 7.8 symbols/min [2025-10-21T18:57:27.132370] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-21T18:57:27.202404] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:57:27.252214] [DEBUG] [LOCAL ] GFI: Loaded 53116 existing records from primary storage. [2025-10-21T18:57:27.252546] [INFO ] [MAIN ] GFI: Loaded 53116 existing records. [2025-10-21T18:57:27.351357] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-21T18:57:27.431016] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:57:27.431225] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-21T18:57:27.431291] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-21T18:57:27.431495] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-21T18:57:27.431535] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-21T18:57:27.803807] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:57:27.845764] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-21T18:57:28.151030] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-21T18:57:28.951034] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-21T18:57:29.751029] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-21T18:57:30.111857] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-21T18:57:30.175192] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T18:57:30.551017] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-21T18:57:31.351033] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-21T18:57:32.151013] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-21T18:57:32.190754] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-21T18:57:32.401675] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-21T18:57:32.598177] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-21T18:57:32.599051] [INFO ] [REMOTE ] GF: Full fetch complete (4787 records). [2025-10-21T18:57:32.599127] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-21T18:57:32.890054] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T18:57:32.956085] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-21T18:57:33.016388] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-21T18:57:33.016483] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-21T18:57:33.016728] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-21T18:57:33.016801] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-21T18:57:33.017290] [DEBUG] [LOCAL ] GF: Trimmed 4787 records to 2646 (keeping 200 days of data) [2025-10-21T18:57:33.034226] [DEBUG] [LOCAL ] GF: Primary data saved (2646 records). [2025-10-21T18:57:33.034350] [INFO ] [MAIN ] GF: Full history saved. [2025-10-21T18:57:33.034432] [INFO ] [MAIN ] Update Progress: 917/2366 symbols completed. GF took 18.7s. Estimated remaining: 3h 5m 38s. Rate: 7.8 symbols/min [2025-10-21T18:57:33.751075] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-21T18:57:34.448075] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T18:57:34.551054] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-21T18:57:35.351052] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-21T18:57:36.094021] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T18:57:36.150978] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-21T18:57:36.190310] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-21T18:57:36.951059] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-21T18:57:37.290940] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T18:57:37.473335] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-21T18:57:37.751091] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-21T18:57:38.550993] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-21T18:57:38.961156] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-21T18:57:39.104866] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-21T18:57:39.350987] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-21T18:57:40.151047] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-21T18:57:40.247633] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T18:57:40.951047] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-21T18:57:41.403585] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T18:57:41.751015] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-21T18:57:41.792104] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-21T18:57:42.459722] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T18:57:42.550989] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-21T18:57:42.692366] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-21T18:57:43.351144] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-21T18:57:44.151004] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-21T18:57:44.473943] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-21T18:57:44.519623] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-21T18:57:44.951082] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-21T18:57:45.750992] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-21T18:57:46.140204] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T18:57:46.144418] [INFO ] [REMOTE ] GFF: Full fetch complete (43736 records). [2025-10-21T18:57:46.144517] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-21T18:57:46.532440] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-21T18:57:46.532673] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-21T18:57:46.533375] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-21T18:57:46.533446] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-21T18:57:46.534533] [DEBUG] [LOCAL ] GFF: Trimmed 43736 records to 29542 (keeping 200 days of data) [2025-10-21T18:57:46.653540] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-21T18:57:46.676263] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-21T18:57:46.756982] [DEBUG] [LOCAL ] GFF: Primary data saved (29542 records). [2025-10-21T18:57:46.757108] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-21T18:57:46.757667] [INFO ] [MAIN ] Update Progress: 918/2366 symbols completed. GFF took 26.1s. Estimated remaining: 3h 5m 40s. Rate: 7.8 symbols/min [2025-10-21T18:57:47.564290] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T18:57:47.576774] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-21T18:57:49.031536] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-21T18:57:49.043765] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-21T18:57:49.549540] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-21T18:57:49.560867] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-21T18:57:51.633560] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-21T18:57:51.645906] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-21T18:57:51.850542] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.81 seconds). [2025-10-21T18:57:51.859066] [INFO ] [REMOTE ] GEV: Full fetch complete (77045 records). [2025-10-21T18:57:51.859171] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-21T18:57:52.253142] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-21T18:57:52.253267] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-21T18:57:52.254290] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-21T18:57:52.254356] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-21T18:57:52.255988] [DEBUG] [LOCAL ] GEV: Trimmed 77045 records to 52992 (keeping 200 days of data) [2025-10-21T18:57:52.593443] [DEBUG] [LOCAL ] GEV: Primary data saved (52992 records). [2025-10-21T18:57:52.593573] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-21T18:57:52.594431] [INFO ] [MAIN ] Update Progress: 919/2366 symbols completed. GEV took 40.3s. Estimated remaining: 3h 5m 30s. Rate: 7.8 symbols/min [2025-10-21T18:57:53.820350] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-21T18:57:53.828762] [INFO ] [REMOTE ] GFI: Full fetch complete (76959 records). [2025-10-21T18:57:53.828889] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-21T18:57:54.216280] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-21T18:57:54.216388] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-21T18:57:54.217420] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-21T18:57:54.217486] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-21T18:57:54.219173] [DEBUG] [LOCAL ] GFI: Trimmed 76959 records to 53116 (keeping 200 days of data) [2025-10-21T18:57:54.536001] [DEBUG] [LOCAL ] GFI: Primary data saved (53116 records). [2025-10-21T18:57:54.536127] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-21T18:57:54.536740] [INFO ] [MAIN ] Update Progress: 920/2366 symbols completed. GFI took 27.5s. Estimated remaining: 3h 5m 13s. Rate: 7.8 symbols/min [2025-10-21T18:57:55.104535] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:57:55.190013] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:57:55.236430] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:57:55.240074] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:57:55.252254] [DEBUG] [LOCAL ] GFR: Loaded 7510 existing records from primary storage. [2025-10-21T18:57:55.252885] [INFO ] [MAIN ] GFR: Loaded 7510 existing records. [2025-10-21T18:57:55.483977] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:57:55.485429] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-21T18:57:55.500455] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-21T18:57:55.515133] [DEBUG] [LOCAL ] GGG: Loaded 40585 existing records from primary storage. [2025-10-21T18:57:55.516090] [DEBUG] [LOCAL ] GFL: Loaded 47569 existing records from primary storage. [2025-10-21T18:57:55.516294] [INFO ] [MAIN ] GGG: Loaded 40585 existing records. [2025-10-21T18:57:55.516415] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-21T18:57:55.517340] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-21T18:57:55.517092] [DEBUG] [LOCAL ] GGB: Loaded 51536 existing records from primary storage. [2025-10-21T18:57:55.558124] [INFO ] [MAIN ] GFL: Loaded 47569 existing records. [2025-10-21T18:57:55.573471] [INFO ] [MAIN ] GGB: Loaded 51536 existing records. [2025-10-21T18:57:56.157151] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:57:56.229738] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-21T18:57:56.273040] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:57:56.304025] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-21T18:57:56.304163] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-21T18:57:56.328304] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-21T18:57:56.394820] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-21T18:57:56.389604] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-21T18:57:56.395094] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-21T18:57:56.395022] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-21T18:57:56.389557] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:57:56.454914] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-21T18:57:56.460157] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-21T18:57:56.537327] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-21T18:57:56.560825] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-21T18:57:56.590498] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:57:56.620018] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-21T18:57:57.496961] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:57:57.470893] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:57:57.503638] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-21T18:57:57.522129] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T18:57:57.509234] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-21T18:57:57.529945] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-21T18:57:57.592212] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:57:57.592755] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-21T18:57:58.295740] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T18:57:58.297990] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-21T18:57:59.093268] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-21T18:57:59.104993] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-21T18:57:59.137383] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-21T18:57:59.138915] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T18:57:59.151466] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-21T18:57:59.153091] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-21T18:57:59.186805] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-21T18:57:59.202265] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-21T18:58:00.001981] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-21T18:58:00.005235] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-21T18:58:00.648555] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T18:58:00.656473] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-21T18:58:00.694251] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T18:58:00.703430] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-21T18:58:00.910040] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-21T18:58:00.950988] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-21T18:58:01.391987] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-21T18:58:01.700161] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T18:58:01.751011] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-21T18:58:02.212048] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T18:58:02.253705] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-21T18:58:02.551076] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-21T18:58:02.605313] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T18:58:03.213693] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-21T18:58:03.351050] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-21T18:58:04.151025] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-21T18:58:04.694421] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-21T18:58:04.951112] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-21T18:58:05.008297] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T18:58:05.646525] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-21T18:58:05.648163] [INFO ] [REMOTE ] GFR: Full fetch complete (12001 records). [2025-10-21T18:58:05.648246] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-21T18:58:05.759691] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-21T18:58:06.020093] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-21T18:58:06.020166] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-21T18:58:06.020415] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-21T18:58:06.020452] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-21T18:58:06.020910] [DEBUG] [LOCAL ] GFR: Trimmed 12001 records to 7423 (keeping 200 days of data) [2025-10-21T18:58:06.059951] [DEBUG] [LOCAL ] GFR: Primary data saved (7423 records). [2025-10-21T18:58:06.060035] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-21T18:58:06.060107] [INFO ] [MAIN ] Update Progress: 921/2366 symbols completed. GFR took 11.5s. Estimated remaining: 3h 5m 11s. Rate: 7.8 symbols/min [2025-10-21T18:58:06.225081] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:58:06.242025] [DEBUG] [LOCAL ] GGT: Loaded 14586 existing records from primary storage. [2025-10-21T18:58:06.242266] [INFO ] [MAIN ] GGT: Loaded 14586 existing records. [2025-10-21T18:58:06.414002] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:58:06.414178] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-21T18:58:06.414224] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-21T18:58:06.414434] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-21T18:58:06.414491] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-21T18:58:06.556163] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-21T18:58:06.765522] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:58:07.215611] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T18:58:07.350986] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-21T18:58:08.151072] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-21T18:58:08.349508] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T18:58:08.764134] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T18:58:08.951082] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-21T18:58:09.741335] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-21T18:58:09.750969] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-21T18:58:09.793381] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T18:58:10.492144] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-21T18:58:10.551046] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-21T18:58:11.351101] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-21T18:58:11.421685] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-21T18:58:12.151047] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-21T18:58:12.900633] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T18:58:12.951016] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-21T18:58:13.751081] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-21T18:58:13.828565] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T18:58:14.403566] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T18:58:14.551040] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-21T18:58:15.351056] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-21T18:58:15.468517] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T18:58:16.062471] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T18:58:16.151025] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-21T18:58:16.494703] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T18:58:16.951080] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-21T18:58:17.652092] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T18:58:17.750997] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-21T18:58:18.452792] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-21T18:58:18.459069] [INFO ] [REMOTE ] GGG: Full fetch complete (59444 records). [2025-10-21T18:58:18.459193] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-21T18:58:18.559704] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-21T18:58:18.860547] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-21T18:58:18.860686] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-21T18:58:18.861637] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-21T18:58:18.861720] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-21T18:58:18.862994] [DEBUG] [LOCAL ] GGG: Trimmed 59444 records to 40582 (keeping 200 days of data) [2025-10-21T18:58:19.116737] [DEBUG] [LOCAL ] GGG: Primary data saved (40582 records). [2025-10-21T18:58:19.140278] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-21T18:58:19.143242] [INFO ] [MAIN ] Update Progress: 922/2366 symbols completed. GGG took 24.6s. Estimated remaining: 3h 5m 12s. Rate: 7.8 symbols/min [2025-10-21T18:58:19.178697] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T18:58:19.331027] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:58:19.335698] [DEBUG] [LOCAL ] GGZ: Loaded 2412 existing records from primary storage. [2025-10-21T18:58:19.335845] [INFO ] [MAIN ] GGZ: Loaded 2412 existing records. [2025-10-21T18:58:19.356796] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-21T18:58:19.521329] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:58:19.521541] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-21T18:58:19.521591] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-21T18:58:19.521759] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-21T18:58:19.521815] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-21T18:58:19.877491] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:58:20.151038] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-21T18:58:20.206789] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T18:58:20.734739] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-21T18:58:20.951007] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-21T18:58:21.254315] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T18:58:21.751036] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-21T18:58:22.551559] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-21T18:58:22.554485] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T18:58:22.555977] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T18:58:23.083095] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-21T18:58:23.351042] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-21T18:58:23.808754] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-21T18:58:24.151022] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-21T18:58:24.717559] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-21T18:58:24.951086] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-21T18:58:25.751029] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-21T18:58:26.551003] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-21T18:58:26.637009] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T18:58:27.350997] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-21T18:58:27.412594] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T18:58:27.541317] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-21T18:58:28.151017] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-21T18:58:28.908754] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-21T18:58:28.916030] [INFO ] [REMOTE ] GFL: Full fetch complete (69626 records). [2025-10-21T18:58:28.916178] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-21T18:58:28.960715] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-21T18:58:29.320224] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-21T18:58:29.320311] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-21T18:58:29.321198] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-21T18:58:29.321260] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-21T18:58:29.322514] [DEBUG] [LOCAL ] GFL: Trimmed 69626 records to 47521 (keeping 200 days of data) [2025-10-21T18:58:29.613051] [DEBUG] [LOCAL ] GFL: Primary data saved (47521 records). [2025-10-21T18:58:29.613200] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-21T18:58:29.613441] [INFO ] [MAIN ] Update Progress: 923/2366 symbols completed. GFL took 35.1s. Estimated remaining: 3h 5m 9s. Rate: 7.8 symbols/min [2025-10-21T18:58:29.756605] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-21T18:58:29.789506] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:58:29.795402] [DEBUG] [LOCAL ] GHC: Loaded 2956 existing records from primary storage. [2025-10-21T18:58:29.795566] [INFO ] [MAIN ] GHC: Loaded 2956 existing records. [2025-10-21T18:58:29.936040] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T18:58:30.004265] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T18:58:30.065440] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:58:30.065666] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-21T18:58:30.065728] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-21T18:58:30.065854] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-21T18:58:30.065892] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-21T18:58:30.432540] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:58:30.428313] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-21T18:58:30.551036] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-21T18:58:31.069866] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-21T18:58:31.351021] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-21T18:58:31.821766] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-21T18:58:32.151018] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-21T18:58:32.624120] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-21T18:58:32.951037] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-21T18:58:33.484578] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-21T18:58:33.751064] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-21T18:58:34.551061] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-21T18:58:35.351059] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-21T18:58:35.499691] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T18:58:35.518096] [INFO ] [REMOTE ] GGB: Full fetch complete (74365 records). [2025-10-21T18:58:35.519133] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-21T18:58:35.519249] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-21T18:58:35.925816] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-21T18:58:35.925673] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-21T18:58:35.927161] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-21T18:58:35.928433] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-21T18:58:35.928509] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-21T18:58:35.930296] [DEBUG] [LOCAL ] GGB: Trimmed 74365 records to 51551 (keeping 200 days of data) [2025-10-21T18:58:36.153856] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-21T18:58:36.226330] [DEBUG] [LOCAL ] GGB: Primary data saved (51551 records). [2025-10-21T18:58:36.226452] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-21T18:58:36.226546] [INFO ] [MAIN ] Update Progress: 924/2366 symbols completed. GGB took 41.7s. Estimated remaining: 3h 4m 59s. Rate: 7.8 symbols/min [2025-10-21T18:58:36.399724] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:58:36.404153] [DEBUG] [LOCAL ] GHG: Loaded 3282 existing records from primary storage. [2025-10-21T18:58:36.404316] [INFO ] [MAIN ] GHG: Loaded 3282 existing records. [2025-10-21T18:58:36.591617] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:58:36.591855] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-21T18:58:36.591950] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-21T18:58:36.592128] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-21T18:58:36.592185] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-21T18:58:36.677764] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-21T18:58:36.956214] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-21T18:58:36.960603] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:58:37.404029] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-21T18:58:37.751095] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-21T18:58:38.271250] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-21T18:58:38.551042] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-21T18:58:39.351036] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-21T18:58:39.414436] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T18:58:39.720063] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-21T18:58:40.151037] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-21T18:58:40.723443] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-21T18:58:40.724386] [INFO ] [REMOTE ] GGZ: Full fetch complete (3879 records). [2025-10-21T18:58:40.724465] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-21T18:58:40.956155] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-21T18:58:41.097140] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-21T18:58:41.097212] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-21T18:58:41.097333] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-21T18:58:41.097371] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-21T18:58:41.097741] [DEBUG] [LOCAL ] GGZ: Trimmed 3879 records to 2395 (keeping 200 days of data) [2025-10-21T18:58:41.112669] [DEBUG] [LOCAL ] GGZ: Primary data saved (2395 records). [2025-10-21T18:58:41.112735] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-21T18:58:41.112799] [INFO ] [MAIN ] Update Progress: 925/2366 symbols completed. GGZ took 22.0s. Estimated remaining: 3h 4m 47s. Rate: 7.8 symbols/min [2025-10-21T18:58:41.288287] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:58:41.297456] [DEBUG] [LOCAL ] GHI: Loaded 7558 existing records from primary storage. [2025-10-21T18:58:41.297701] [INFO ] [MAIN ] GHI: Loaded 7558 existing records. [2025-10-21T18:58:41.483937] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:58:41.484144] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-21T18:58:41.484190] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-21T18:58:41.484386] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-21T18:58:41.484442] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-21T18:58:41.588438] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-21T18:58:41.756270] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-21T18:58:41.854896] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:58:42.281753] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-21T18:58:42.551065] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-21T18:58:43.168258] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-21T18:58:43.351063] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-21T18:58:44.151023] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-21T18:58:44.188287] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-21T18:58:44.689636] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-21T18:58:44.951009] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-21T18:58:45.517326] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-21T18:58:45.751009] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-21T18:58:46.351615] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-21T18:58:46.551065] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-21T18:58:47.150461] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-21T18:58:47.151926] [INFO ] [REMOTE ] GHC: Full fetch complete (3678 records). [2025-10-21T18:58:47.151997] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-21T18:58:47.356179] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-21T18:58:47.533149] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-21T18:58:47.533268] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-21T18:58:47.533441] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-21T18:58:47.533481] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-21T18:58:47.533862] [DEBUG] [LOCAL ] GHC: Trimmed 3678 records to 2964 (keeping 200 days of data) [2025-10-21T18:58:47.552705] [DEBUG] [LOCAL ] GHC: Primary data saved (2964 records). [2025-10-21T18:58:47.552779] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-21T18:58:47.552849] [INFO ] [MAIN ] Update Progress: 926/2366 symbols completed. GHC took 17.9s. Estimated remaining: 3h 4m 38s. Rate: 7.8 symbols/min [2025-10-21T18:58:47.719477] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:58:47.725913] [DEBUG] [LOCAL ] GHLD: Loaded 4301 existing records from primary storage. [2025-10-21T18:58:47.726082] [INFO ] [MAIN ] GHLD: Loaded 4301 existing records. [2025-10-21T18:58:47.905220] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:58:47.905462] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-21T18:58:47.905512] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-21T18:58:47.905674] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-21T18:58:47.905732] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-21T18:58:48.156712] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-21T18:58:48.279494] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:58:48.404116] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T18:58:48.887775] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-21T18:58:48.951144] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-21T18:58:49.751019] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-21T18:58:49.980958] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T18:58:49.983780] [INFO ] [REMOTE ] GGT: Full fetch complete (18975 records). [2025-10-21T18:58:49.983849] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-21T18:58:50.347073] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-21T18:58:50.347151] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-21T18:58:50.347553] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-21T18:58:50.347595] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-21T18:58:50.348163] [DEBUG] [LOCAL ] GGT: Trimmed 18975 records to 14524 (keeping 200 days of data) [2025-10-21T18:58:50.414831] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-21T18:58:50.438513] [DEBUG] [LOCAL ] GGT: Primary data saved (14524 records). [2025-10-21T18:58:50.438604] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-21T18:58:50.438696] [INFO ] [MAIN ] Update Progress: 927/2366 symbols completed. GGT took 44.4s. Estimated remaining: 3h 4m 22s. Rate: 7.8 symbols/min [2025-10-21T18:58:50.556192] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-21T18:58:50.608890] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:58:50.623716] [DEBUG] [LOCAL ] GHM: Loaded 14369 existing records from primary storage. [2025-10-21T18:58:50.623915] [INFO ] [MAIN ] GHM: Loaded 14369 existing records. [2025-10-21T18:58:50.798105] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:58:50.798301] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-21T18:58:50.798367] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-21T18:58:50.798537] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-21T18:58:50.798609] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-21T18:58:51.064363] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-21T18:58:51.161820] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:58:51.350987] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-21T18:58:52.151009] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-21T18:58:52.264547] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T18:58:52.602413] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-21T18:58:52.951039] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-21T18:58:53.300572] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-21T18:58:53.751006] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-21T18:58:54.477136] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-21T18:58:54.551018] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-21T18:58:55.007739] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-21T18:58:55.351026] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-21T18:58:55.797525] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-21T18:58:56.151073] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-21T18:58:56.749819] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-21T18:58:56.951058] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-21T18:58:57.515540] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-21T18:58:57.751069] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-21T18:58:58.206091] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-21T18:58:58.551088] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-21T18:58:58.997523] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-21T18:58:59.351068] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-21T18:58:59.943342] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-21T18:59:00.151023] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-21T18:59:00.951010] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-21T18:59:01.209161] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-21T18:59:01.561182] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-21T18:59:01.751061] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-21T18:59:02.245204] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-21T18:59:02.551061] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-21T18:59:03.159832] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-21T18:59:03.351038] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-21T18:59:03.922067] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-21T18:59:04.151091] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-21T18:59:04.951115] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-21T18:59:05.119431] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-21T18:59:05.670418] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T18:59:05.751109] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-21T18:59:06.551008] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-21T18:59:06.615046] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-21T18:59:07.025772] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-21T18:59:07.351014] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-21T18:59:08.151044] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-21T18:59:08.270158] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T18:59:08.742094] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T18:59:08.951061] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-21T18:59:09.715104] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-21T18:59:09.751081] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-21T18:59:10.348390] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-21T18:59:10.349520] [INFO ] [REMOTE ] GHG: Full fetch complete (4178 records). [2025-10-21T18:59:10.349588] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-21T18:59:10.561226] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-21T18:59:10.727563] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-21T18:59:10.727683] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-21T18:59:10.727914] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-21T18:59:10.727975] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-21T18:59:10.728367] [DEBUG] [LOCAL ] GHG: Trimmed 4178 records to 3279 (keeping 200 days of data) [2025-10-21T18:59:10.746382] [DEBUG] [LOCAL ] GHG: Primary data saved (3279 records). [2025-10-21T18:59:10.746483] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-21T18:59:10.746572] [INFO ] [MAIN ] Update Progress: 928/2366 symbols completed. GHG took 34.5s. Estimated remaining: 3h 4m 34s. Rate: 7.8 symbols/min [2025-10-21T18:59:10.921816] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:59:10.943991] [DEBUG] [LOCAL ] GHY: Loaded 20931 existing records from primary storage. [2025-10-21T18:59:10.944269] [INFO ] [MAIN ] GHY: Loaded 20931 existing records. [2025-10-21T18:59:11.123969] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:59:11.124213] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-21T18:59:11.124261] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-21T18:59:11.124429] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-21T18:59:11.124468] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-21T18:59:11.356248] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-21T18:59:11.490904] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:59:11.625825] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-21T18:59:12.151754] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-21T18:59:12.153536] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T18:59:12.951027] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-21T18:59:13.546000] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T18:59:13.560708] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-21T18:59:13.751046] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-21T18:59:14.551005] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-21T18:59:14.689724] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T18:59:14.691999] [INFO ] [REMOTE ] GHI: Full fetch complete (11207 records). [2025-10-21T18:59:14.692071] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-21T18:59:15.045491] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-21T18:59:15.045580] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-21T18:59:15.045886] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-21T18:59:15.046766] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-21T18:59:15.047209] [DEBUG] [LOCAL ] GHI: Trimmed 11207 records to 7700 (keeping 200 days of data) [2025-10-21T18:59:15.092561] [DEBUG] [LOCAL ] GHI: Primary data saved (7700 records). [2025-10-21T18:59:15.092684] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-21T18:59:15.092791] [INFO ] [MAIN ] Update Progress: 929/2366 symbols completed. GHI took 34.0s. Estimated remaining: 3h 4m 21s. Rate: 7.8 symbols/min [2025-10-21T18:59:15.262762] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:59:15.293745] [DEBUG] [LOCAL ] GIB: Loaded 31496 existing records from primary storage. [2025-10-21T18:59:15.294061] [INFO ] [MAIN ] GIB: Loaded 31496 existing records. [2025-10-21T18:59:15.356262] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-21T18:59:15.473125] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:59:15.473349] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-21T18:59:15.473397] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-21T18:59:15.473597] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-21T18:59:15.473691] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-21T18:59:15.629539] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T18:59:15.840761] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:59:15.935434] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T18:59:16.151041] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-21T18:59:16.775204] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-21T18:59:16.776450] [INFO ] [REMOTE ] GHLD: Full fetch complete (5078 records). [2025-10-21T18:59:16.776517] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-21T18:59:16.953800] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-21T18:59:17.147753] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-21T18:59:17.147858] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-21T18:59:17.148037] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-21T18:59:17.148076] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-21T18:59:17.148431] [DEBUG] [LOCAL ] GHLD: Trimmed 5078 records to 4289 (keeping 200 days of data) [2025-10-21T18:59:17.173901] [DEBUG] [LOCAL ] GHLD: Primary data saved (4289 records). [2025-10-21T18:59:17.173967] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-21T18:59:17.174034] [INFO ] [MAIN ] Update Progress: 930/2366 symbols completed. GHLD took 29.6s. Estimated remaining: 3h 4m 5s. Rate: 7.8 symbols/min [2025-10-21T18:59:17.344219] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:59:17.358180] [DEBUG] [LOCAL ] GIC: Loaded 13388 existing records from primary storage. [2025-10-21T18:59:17.358458] [INFO ] [MAIN ] GIC: Loaded 13388 existing records. [2025-10-21T18:59:17.538107] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:59:17.538324] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-21T18:59:17.538380] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-21T18:59:17.538532] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-21T18:59:17.538571] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-21T18:59:17.756202] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-21T18:59:17.913279] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:59:17.972761] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-21T18:59:18.551074] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-21T18:59:18.972236] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T18:59:19.351034] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-21T18:59:19.603951] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T18:59:20.150999] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-21T18:59:20.700491] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T18:59:20.951066] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-21T18:59:21.142593] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T18:59:21.751015] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-21T18:59:22.060404] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-21T18:59:22.551059] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-21T18:59:23.170745] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-21T18:59:23.285095] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-21T18:59:23.350984] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-21T18:59:24.151008] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-21T18:59:24.362266] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T18:59:24.812478] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T18:59:24.951089] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-21T18:59:25.751021] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-21T18:59:26.422497] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-21T18:59:26.550991] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-21T18:59:26.699291] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-21T18:59:27.350992] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-21T18:59:27.712970] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-21T18:59:28.151005] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-21T18:59:28.396738] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-21T18:59:28.951037] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-21T18:59:29.385944] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T18:59:29.751003] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-21T18:59:29.760888] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T18:59:30.551078] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-21T18:59:31.095871] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-21T18:59:31.351021] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-21T18:59:31.511386] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-21T18:59:32.151015] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-21T18:59:32.692459] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T18:59:32.951021] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-21T18:59:33.039321] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-21T18:59:33.489248] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-21T18:59:33.751033] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-21T18:59:34.551044] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-21T18:59:34.881567] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-21T18:59:35.351058] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-21T18:59:35.888102] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-21T18:59:36.150998] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-21T18:59:36.385109] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T18:59:36.944338] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T18:59:36.947394] [INFO ] [REMOTE ] GHM: Full fetch complete (22032 records). [2025-10-21T18:59:36.947466] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-21T18:59:36.958851] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-21T18:59:37.321535] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-21T18:59:37.321615] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-21T18:59:37.322173] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-21T18:59:37.322229] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-21T18:59:37.322849] [DEBUG] [LOCAL ] GHM: Trimmed 22032 records to 14348 (keeping 200 days of data) [2025-10-21T18:59:37.405845] [DEBUG] [LOCAL ] GHM: Primary data saved (14348 records). [2025-10-21T18:59:37.405983] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-21T18:59:37.406063] [INFO ] [MAIN ] Update Progress: 931/2366 symbols completed. GHM took 47.0s. Estimated remaining: 3h 4m 17s. Rate: 7.8 symbols/min [2025-10-21T18:59:37.580192] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:59:37.619695] [DEBUG] [LOCAL ] GIL: Loaded 43989 existing records from primary storage. [2025-10-21T18:59:37.619985] [INFO ] [MAIN ] GIL: Loaded 43989 existing records. [2025-10-21T18:59:37.756180] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-21T18:59:37.809740] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:59:37.810050] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-21T18:59:37.810100] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-21T18:59:37.810434] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-21T18:59:37.810493] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-21T18:59:38.145059] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T18:59:38.209854] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:59:38.551091] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-21T18:59:39.284731] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T18:59:39.291100] [INFO ] [REMOTE ] GIB: Full fetch complete (46334 records). [2025-10-21T18:59:39.291206] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-21T18:59:39.361301] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-21T18:59:39.504191] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-21T18:59:39.606851] [INFO ] [REMOTE ] GHY: Full fetch complete (32419 records). [2025-10-21T18:59:39.631884] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-21T18:59:39.874223] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-21T18:59:39.887196] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-21T18:59:39.898587] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-21T18:59:39.898702] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-21T18:59:40.001837] [DEBUG] [LOCAL ] GIB: Trimmed 46334 records to 31436 (keeping 200 days of data) [2025-10-21T18:59:40.152624] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-21T18:59:40.220608] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-21T18:59:40.222917] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-21T18:59:40.224097] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-21T18:59:40.224590] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-21T18:59:40.232717] [DEBUG] [LOCAL ] GHY: Trimmed 32419 records to 20916 (keeping 200 days of data) [2025-10-21T18:59:40.403090] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-21T18:59:40.457175] [DEBUG] [LOCAL ] GIB: Primary data saved (31436 records). [2025-10-21T18:59:40.461494] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-21T18:59:40.463479] [INFO ] [MAIN ] Update Progress: 932/2366 symbols completed. GIB took 25.4s. Estimated remaining: 3h 4m 2s. Rate: 7.8 symbols/min [2025-10-21T18:59:40.462734] [DEBUG] [LOCAL ] GHY: Primary data saved (20916 records). [2025-10-21T18:59:40.506108] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-21T18:59:40.526777] [INFO ] [MAIN ] Update Progress: 933/2366 symbols completed. GHY took 29.8s. Estimated remaining: 3h 3m 42s. Rate: 7.8 symbols/min [2025-10-21T18:59:40.788480] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:59:40.789802] [DEBUG] [LOCAL ] GIS: No existing data file found in primary storage. [2025-10-21T18:59:40.790807] [WARN ] [MAIN ] GIS: No existing data found, performing full refresh instead. [2025-10-21T18:59:40.807043] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-21T18:59:40.806917] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:59:40.807106] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-21T18:59:40.807254] [DEBUG] [LOCAL ] GIS: No primary data file found to delete. [2025-10-21T18:59:40.807316] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-21T18:59:40.960549] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-21T18:59:41.143332] [DEBUG] [LOCAL ] GKOS: Loaded 42502 existing records from primary storage. [2025-10-21T18:59:41.175605] [INFO ] [MAIN ] GKOS: Loaded 42502 existing records. [2025-10-21T18:59:41.200966] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:59:41.378687] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:59:41.378895] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-21T18:59:41.378966] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-21T18:59:41.379202] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-21T18:59:41.379261] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-21T18:59:41.749286] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:59:41.757965] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-21T18:59:41.773586] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T18:59:42.060827] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-21T18:59:42.551030] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-21T18:59:43.272972] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T18:59:43.350981] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-21T18:59:43.504162] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-21T18:59:44.151011] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-21T18:59:44.750841] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T18:59:44.951009] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-21T18:59:45.539235] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-21T18:59:45.751081] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-21T18:59:46.550983] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-21T18:59:46.586361] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T18:59:47.351023] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-21T18:59:47.578099] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-21T18:59:48.103478] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T18:59:48.151052] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-21T18:59:48.254485] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T18:59:48.256783] [INFO ] [REMOTE ] GIC: Full fetch complete (19820 records). [2025-10-21T18:59:48.256852] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-21T18:59:48.623008] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-21T18:59:48.623094] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-21T18:59:48.623592] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-21T18:59:48.623632] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-21T18:59:48.624495] [DEBUG] [LOCAL ] GIC: Trimmed 19820 records to 13257 (keeping 200 days of data) [2025-10-21T18:59:48.702989] [DEBUG] [LOCAL ] GIC: Primary data saved (13257 records). [2025-10-21T18:59:48.703128] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-21T18:59:48.703205] [INFO ] [MAIN ] Update Progress: 934/2366 symbols completed. GIC took 31.5s. Estimated remaining: 3h 3m 35s. Rate: 7.8 symbols/min [2025-10-21T18:59:48.870903] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:59:48.913376] [DEBUG] [LOCAL ] GL: Loaded 37483 existing records from primary storage. [2025-10-21T18:59:48.913695] [INFO ] [MAIN ] GL: Loaded 37483 existing records. [2025-10-21T18:59:48.956268] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-21T18:59:49.099004] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:59:49.099445] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-21T18:59:49.099498] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-21T18:59:49.099841] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-21T18:59:49.099897] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-21T18:59:49.451022] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:59:49.751014] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-21T18:59:49.816542] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T18:59:50.197861] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-21T18:59:50.551022] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-21T18:59:51.351016] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-21T18:59:51.415062] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T18:59:51.836984] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T18:59:52.151035] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-21T18:59:52.951007] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-21T18:59:53.011284] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T18:59:53.734370] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T18:59:53.750979] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-21T18:59:54.422936] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T18:59:54.551020] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-21T18:59:55.327861] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T18:59:55.350979] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-21T18:59:56.151006] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-21T18:59:56.458040] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T18:59:56.951086] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-21T18:59:57.617404] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-21T18:59:57.689982] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T18:59:57.751074] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-21T18:59:58.512234] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T18:59:58.551035] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-21T18:59:59.351059] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-21T18:59:59.390834] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T19:00:00.151064] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-21T19:00:00.397309] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T19:00:00.951017] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-21T19:00:01.608740] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-21T19:00:01.732178] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T19:00:01.750992] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-21T19:00:02.551114] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-21T19:00:02.920588] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-21T19:00:03.360017] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-21T19:00:03.364809] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T19:00:04.073950] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T19:00:04.151035] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-21T19:00:04.962447] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-21T19:00:04.970479] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T19:00:05.751011] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-21T19:00:06.304481] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-21T19:00:06.550991] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-21T19:00:06.962263] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-21T19:00:06.968948] [INFO ] [REMOTE ] GKOS: Full fetch complete (60527 records). [2025-10-21T19:00:06.969069] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-21T19:00:07.361477] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-21T19:00:07.364942] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-21T19:00:07.365546] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-21T19:00:07.367883] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-21T19:00:07.368295] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-21T19:00:07.370701] [DEBUG] [LOCAL ] GKOS: Trimmed 60527 records to 42499 (keeping 200 days of data) [2025-10-21T19:00:07.635758] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T19:00:07.653774] [INFO ] [REMOTE ] GIL: Full fetch complete (62511 records). [2025-10-21T19:00:07.659983] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-21T19:00:07.661217] [DEBUG] [LOCAL ] GKOS: Primary data saved (42499 records). [2025-10-21T19:00:07.661432] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-21T19:00:07.661519] [INFO ] [MAIN ] Update Progress: 935/2366 symbols completed. GKOS took 27.1s. Estimated remaining: 3h 3m 45s. Rate: 7.8 symbols/min [2025-10-21T19:00:08.031749] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:00:08.245524] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T19:00:08.332526] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-21T19:00:08.332630] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-21T19:00:08.332973] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-21T19:00:08.333920] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-21T19:00:08.334819] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-21T19:00:08.336212] [DEBUG] [LOCAL ] GIL: Trimmed 62511 records to 43981 (keeping 200 days of data) [2025-10-21T19:00:08.414273] [DEBUG] [LOCAL ] GLOB: Loaded 48058 existing records from primary storage. [2025-10-21T19:00:08.440928] [INFO ] [MAIN ] GLOB: Loaded 48058 existing records. [2025-10-21T19:00:08.652286] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:00:08.664037] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-21T19:00:08.664149] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-21T19:00:08.664494] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-21T19:00:08.664592] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-21T19:00:08.940189] [DEBUG] [LOCAL ] GIL: Primary data saved (43981 records). [2025-10-21T19:00:08.940851] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-21T19:00:08.946590] [INFO ] [MAIN ] Update Progress: 936/2366 symbols completed. GIL took 31.5s. Estimated remaining: 3h 3m 27s. Rate: 7.8 symbols/min [2025-10-21T19:00:09.330950] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:00:09.391766] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:00:09.392134] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-21T19:00:09.431231] [DEBUG] [LOCAL ] GLP: Loaded 9318 existing records from primary storage. [2025-10-21T19:00:09.431520] [INFO ] [MAIN ] GLP: Loaded 9318 existing records. [2025-10-21T19:00:09.504289] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-21T19:00:09.622839] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:00:09.623056] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-21T19:00:09.623103] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-21T19:00:09.623272] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-21T19:00:09.623327] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-21T19:00:09.761900] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-21T19:00:09.982570] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:00:10.035086] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T19:00:10.551047] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-21T19:00:10.819707] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T19:00:11.351028] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-21T19:00:11.745377] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-21T19:00:11.969841] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-21T19:00:12.151010] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-21T19:00:12.951031] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-21T19:00:13.052814] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T19:00:13.750997] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-21T19:00:14.235150] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-21T19:00:14.472594] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T19:00:14.550984] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-21T19:00:15.349725] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-21T19:00:15.358438] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-21T19:00:16.151051] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-21T19:00:16.244502] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-21T19:00:16.951004] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-21T19:00:17.256779] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (2.71 seconds). [2025-10-21T19:00:17.262581] [INFO ] [REMOTE ] GL: Full fetch complete (54947 records). [2025-10-21T19:00:17.262708] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-21T19:00:17.648350] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-21T19:00:17.648426] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-21T19:00:17.649204] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-21T19:00:17.649266] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-21T19:00:17.650377] [DEBUG] [LOCAL ] GL: Trimmed 54947 records to 37443 (keeping 200 days of data) [2025-10-21T19:00:17.755094] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-21T19:00:17.886534] [DEBUG] [LOCAL ] GL: Primary data saved (37443 records). [2025-10-21T19:00:17.886733] [INFO ] [MAIN ] GL: Full history saved. [2025-10-21T19:00:17.886842] [INFO ] [MAIN ] Update Progress: 937/2366 symbols completed. GL took 29.2s. Estimated remaining: 3h 3m 22s. Rate: 7.8 symbols/min [2025-10-21T19:00:18.056962] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:00:18.104928] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-10-21T19:00:18.105236] [INFO ] [MAIN ] GLW: Loaded 53635 existing records. [2025-10-21T19:00:18.283139] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:00:18.283381] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-21T19:00:18.283496] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-21T19:00:18.283867] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-21T19:00:18.283923] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-21T19:00:18.494755] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-21T19:00:18.562050] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-21T19:00:18.567774] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-21T19:00:18.713846] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:00:18.738400] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T19:00:19.351021] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-21T19:00:19.494142] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T19:00:19.502423] [INFO ] [REMOTE ] GIS: Full fetch complete (77841 records). [2025-10-21T19:00:19.502541] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-21T19:00:19.889664] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-21T19:00:19.889766] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-21T19:00:19.890706] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-21T19:00:19.890771] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-21T19:00:19.892210] [DEBUG] [LOCAL ] GIS: Trimmed 77841 records to 53675 (keeping 200 days of data) [2025-10-21T19:00:19.994395] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T19:00:20.151324] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-21T19:00:20.249608] [DEBUG] [LOCAL ] GIS: Primary data saved (53675 records). [2025-10-21T19:00:20.249782] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-21T19:00:20.249877] [INFO ] [MAIN ] Update Progress: 938/2366 symbols completed. GIS took 39.8s. Estimated remaining: 3h 3m 6s. Rate: 7.8 symbols/min [2025-10-21T19:00:20.424355] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:00:20.472881] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-21T19:00:20.473185] [INFO ] [MAIN ] GM: Loaded 53729 existing records. [2025-10-21T19:00:20.645501] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:00:20.645747] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-21T19:00:20.645797] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-21T19:00:20.646003] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-21T19:00:20.646059] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-21T19:00:20.955940] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-21T19:00:21.016493] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:00:21.023085] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-21T19:00:21.751029] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-21T19:00:22.551035] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-21T19:00:22.784733] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T19:00:23.351010] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-21T19:00:23.399366] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-21T19:00:23.458616] [DEBUG] [REMOTE ] GLOB: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-21T19:00:23.458988] [WARN ] [REMOTE ] GLOB: No data returned for month 2025-06 [2025-10-21T19:00:23.459079] [FATAL] [REMOTE ] GLOB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:00:23.459160] [FATAL] [MAIN ] GLOB: Failed to fetch primary data. [2025-10-21T19:00:23.459196] [WARN ] [MAIN ] GLOB: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:00:23.459234] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-21T19:00:23.459289] [DEBUG] [LOCAL ] GLOB: No primary data file found to delete. [2025-10-21T19:00:23.459322] [INFO ] [LOCAL ] GLOB: Starting deletion of derivative data. [2025-10-21T19:00:23.459488] [DEBUG] [LOCAL ] GLOB: Deleted derivative data file. [2025-10-21T19:00:23.460239] [INFO ] [MAIN ] Update Progress: 939/2366 symbols completed. GLOB took 15.8s. Estimated remaining: 3h 2m 51s. Rate: 7.8 symbols/min [2025-10-21T19:00:23.637283] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:00:23.690578] [DEBUG] [LOCAL ] GME: Loaded 53781 existing records from primary storage. [2025-10-21T19:00:23.690906] [INFO ] [MAIN ] GME: Loaded 53781 existing records. [2025-10-21T19:00:23.887414] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:00:23.907356] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-21T19:00:23.910318] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-21T19:00:23.911081] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-21T19:00:23.911147] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-21T19:00:23.912636] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-21T19:00:24.157759] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-21T19:00:24.300793] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:00:24.817976] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-21T19:00:24.951282] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-21T19:00:25.751079] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-21T19:00:26.525580] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-21T19:00:26.550975] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-21T19:00:27.139706] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-21T19:00:27.351009] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-21T19:00:27.423196] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-21T19:00:28.151061] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-21T19:00:28.951062] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-21T19:00:28.991698] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-21T19:00:29.571133] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-21T19:00:29.751013] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-21T19:00:30.551016] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-21T19:00:30.577491] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T19:00:30.579469] [INFO ] [REMOTE ] GLP: Full fetch complete (14248 records). [2025-10-21T19:00:30.579539] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-21T19:00:30.991337] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-21T19:00:30.991415] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-21T19:00:30.991794] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-21T19:00:30.991858] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-21T19:00:30.992388] [DEBUG] [LOCAL ] GLP: Trimmed 14248 records to 9296 (keeping 200 days of data) [2025-10-21T19:00:31.049161] [DEBUG] [LOCAL ] GLP: Primary data saved (9296 records). [2025-10-21T19:00:31.049372] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-21T19:00:31.049551] [INFO ] [MAIN ] Update Progress: 940/2366 symbols completed. GLP took 22.1s. Estimated remaining: 3h 2m 44s. Rate: 7.8 symbols/min [2025-10-21T19:00:31.233624] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:00:31.277473] [DEBUG] [LOCAL ] GMED: Loaded 48170 existing records from primary storage. [2025-10-21T19:00:31.277797] [INFO ] [MAIN ] GMED: Loaded 48170 existing records. [2025-10-21T19:00:31.354608] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-21T19:00:31.462968] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:00:31.463292] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-21T19:00:31.463405] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-21T19:00:31.472931] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-21T19:00:31.486254] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-21T19:00:31.591211] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-10-21T19:00:31.854496] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:00:32.151052] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-21T19:00:32.599118] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-21T19:00:32.951007] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-21T19:00:33.210320] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-21T19:00:33.751009] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-21T19:00:33.789322] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T19:00:34.551068] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-21T19:00:35.351035] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-21T19:00:35.560967] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-10-21T19:00:35.842038] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-21T19:00:36.059323] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T19:00:36.151006] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-21T19:00:36.951022] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-21T19:00:37.181771] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T19:00:37.751014] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-21T19:00:37.818024] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T19:00:38.551042] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-21T19:00:39.351025] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-21T19:00:39.723812] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-21T19:00:39.967945] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-21T19:00:40.151005] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-21T19:00:40.569381] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-21T19:00:40.857016] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T19:00:40.951070] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-21T19:00:41.751084] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-21T19:00:42.551049] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-21T19:00:42.867283] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-21T19:00:42.992324] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-21T19:00:43.350996] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-21T19:00:43.452628] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T19:00:44.151161] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-21T19:00:44.152975] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T19:00:44.951089] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-21T19:00:45.561528] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-21T19:00:45.754098] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-21T19:00:45.759605] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T19:00:46.550994] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-21T19:00:46.902808] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-21T19:00:47.351036] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-21T19:00:48.150999] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-21T19:00:48.423741] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-21T19:00:48.695547] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-21T19:00:48.951057] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-21T19:00:49.316016] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-21T19:00:49.408422] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-21T19:00:49.751056] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-21T19:00:50.551090] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-21T19:00:51.312917] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-21T19:00:51.350985] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-21T19:00:51.845958] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-21T19:00:52.151028] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-21T19:00:52.341480] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T19:00:52.951042] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-21T19:00:53.737735] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-21T19:00:53.750991] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-21T19:00:53.880213] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T19:00:54.551007] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-21T19:00:55.019842] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-21T19:00:55.351061] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-21T19:00:55.462758] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-21T19:00:55.471181] [INFO ] [REMOTE ] GLW: Full fetch complete (77796 records). [2025-10-21T19:00:55.471332] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-21T19:00:55.855445] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-21T19:00:55.855525] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-21T19:00:55.856484] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-21T19:00:55.856548] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-21T19:00:55.858134] [DEBUG] [LOCAL ] GLW: Trimmed 77796 records to 53635 (keeping 200 days of data) [2025-10-21T19:00:56.163400] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-21T19:00:56.190107] [DEBUG] [LOCAL ] GLW: Primary data saved (53635 records). [2025-10-21T19:00:56.190401] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-21T19:00:56.190495] [INFO ] [MAIN ] Update Progress: 941/2366 symbols completed. GLW took 38.3s. Estimated remaining: 3h 3m 2s. Rate: 7.8 symbols/min [2025-10-21T19:00:56.360705] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:00:56.385394] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.63 seconds). [2025-10-21T19:00:56.394260] [INFO ] [REMOTE ] GME: Full fetch complete (77923 records). [2025-10-21T19:00:56.394432] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-21T19:00:56.659325] [DEBUG] [LOCAL ] GMRE: Loaded 36823 existing records from primary storage. [2025-10-21T19:00:56.694688] [INFO ] [MAIN ] GMRE: Loaded 36823 existing records. [2025-10-21T19:00:56.994557] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:00:57.018549] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-21T19:00:57.019129] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-21T19:00:57.018664] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-21T19:00:57.020299] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-21T19:00:57.020459] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-21T19:00:57.020593] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-21T19:00:57.021025] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-21T19:00:57.021137] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-21T19:00:57.100467] [DEBUG] [LOCAL ] GME: Trimmed 77923 records to 53781 (keeping 200 days of data) [2025-10-21T19:00:57.635411] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-21T19:00:57.665600] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:00:57.673222] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-21T19:00:57.767233] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T19:00:57.767324] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-21T19:00:57.803136] [DEBUG] [LOCAL ] GME: Primary data saved (53781 records). [2025-10-21T19:00:57.803248] [INFO ] [MAIN ] GME: Full history saved. [2025-10-21T19:00:57.804085] [INFO ] [MAIN ] Update Progress: 942/2366 symbols completed. GME took 34.3s. Estimated remaining: 3h 2m 45s. Rate: 7.8 symbols/min [2025-10-21T19:00:57.983117] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:00:58.005368] [DEBUG] [LOCAL ] GNE: Loaded 18091 existing records from primary storage. [2025-10-21T19:00:58.005594] [INFO ] [MAIN ] GNE: Loaded 18091 existing records. [2025-10-21T19:00:58.180792] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:00:58.180974] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-21T19:00:58.181050] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-21T19:00:58.181197] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-21T19:00:58.181234] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-21T19:00:58.551360] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-21T19:00:58.551299] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:00:58.665710] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T19:00:58.674621] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-10-21T19:00:58.674811] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-21T19:00:59.066257] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-21T19:00:59.066425] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-21T19:00:59.067443] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-21T19:00:59.067632] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-21T19:00:59.069291] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 53729 (keeping 200 days of data) [2025-10-21T19:00:59.202819] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T19:00:59.374803] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-21T19:00:59.425540] [DEBUG] [LOCAL ] GM: Primary data saved (53729 records). [2025-10-21T19:00:59.425716] [INFO ] [MAIN ] GM: Full history saved. [2025-10-21T19:00:59.426529] [INFO ] [MAIN ] Update Progress: 943/2366 symbols completed. GM took 39.2s. Estimated remaining: 3h 2m 28s. Rate: 7.8 symbols/min [2025-10-21T19:00:59.598310] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:00:59.637916] [DEBUG] [LOCAL ] GNK: Loaded 39773 existing records from primary storage. [2025-10-21T19:00:59.638203] [INFO ] [MAIN ] GNK: Loaded 39773 existing records. [2025-10-21T19:00:59.815414] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:00:59.815633] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-21T19:00:59.815716] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-21T19:00:59.815942] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-21T19:00:59.815997] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-21T19:01:00.159076] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-21T19:01:00.188502] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:01:00.229785] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T19:01:00.328061] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T19:01:00.951021] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-21T19:01:01.103380] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-21T19:01:01.751061] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-21T19:01:02.422486] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T19:01:02.551053] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-21T19:01:03.351075] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-21T19:01:03.570869] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-21T19:01:03.578307] [INFO ] [REMOTE ] GMED: Full fetch complete (70057 records). [2025-10-21T19:01:03.578445] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-21T19:01:03.900083] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-21T19:01:03.991633] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-21T19:01:03.991783] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-21T19:01:03.992731] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-21T19:01:03.992893] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-21T19:01:04.015176] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T19:01:04.013939] [DEBUG] [LOCAL ] GMED: Trimmed 70057 records to 48118 (keeping 200 days of data) [2025-10-21T19:01:04.185581] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-21T19:01:04.301502] [DEBUG] [LOCAL ] GMED: Primary data saved (48118 records). [2025-10-21T19:01:04.301661] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-21T19:01:04.302141] [INFO ] [MAIN ] Update Progress: 944/2366 symbols completed. GMED took 33.3s. Estimated remaining: 3h 2m 17s. Rate: 7.8 symbols/min [2025-10-21T19:01:04.469193] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:01:04.516802] [DEBUG] [LOCAL ] GNL: Loaded 46630 existing records from primary storage. [2025-10-21T19:01:04.517128] [INFO ] [MAIN ] GNL: Loaded 46630 existing records. [2025-10-21T19:01:04.694843] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:01:04.695186] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-21T19:01:04.695265] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-21T19:01:04.695612] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-21T19:01:04.695764] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-21T19:01:04.870216] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-21T19:01:04.956133] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-21T19:01:05.066795] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:01:05.751076] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-21T19:01:06.550997] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-21T19:01:06.560066] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-21T19:01:06.691967] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T19:01:07.351074] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-21T19:01:07.704817] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-21T19:01:08.151016] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-21T19:01:08.951143] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-21T19:01:09.022107] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T19:01:09.152983] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-21T19:01:09.751025] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-21T19:01:10.562744] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-21T19:01:10.593781] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T19:01:10.889341] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T19:01:11.351099] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-21T19:01:12.147898] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T19:01:12.156122] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-21T19:01:12.916380] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T19:01:12.950992] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-21T19:01:13.316407] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T19:01:13.751073] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-21T19:01:14.409163] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T19:01:14.551022] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-21T19:01:15.351000] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-21T19:01:15.426277] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T19:01:16.100557] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T19:01:16.150987] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-21T19:01:16.915897] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T19:01:16.950992] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-21T19:01:17.353852] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-21T19:01:17.751045] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-21T19:01:18.518436] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T19:01:18.551018] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-21T19:01:19.351108] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-21T19:01:19.457855] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-21T19:01:20.088911] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T19:01:20.151038] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-21T19:01:20.331067] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-21T19:01:20.951074] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-21T19:01:21.758817] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-21T19:01:21.765819] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T19:01:22.550998] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-21T19:01:22.586414] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T19:01:23.322102] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T19:01:23.351023] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-21T19:01:24.155000] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-21T19:01:24.160827] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T19:01:24.309394] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-21T19:01:24.951032] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-21T19:01:25.503387] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T19:01:25.751094] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-21T19:01:26.551010] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-21T19:01:26.615518] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T19:01:27.035114] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T19:01:27.039759] [INFO ] [REMOTE ] GMRE: Full fetch complete (52096 records). [2025-10-21T19:01:27.039891] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-21T19:01:27.356108] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-21T19:01:27.435418] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-21T19:01:27.435500] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-21T19:01:27.436313] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-21T19:01:27.436390] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-21T19:01:27.437512] [DEBUG] [LOCAL ] GMRE: Trimmed 52096 records to 36650 (keeping 200 days of data) [2025-10-21T19:01:27.666766] [DEBUG] [LOCAL ] GMRE: Primary data saved (36650 records). [2025-10-21T19:01:27.666907] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-21T19:01:27.666988] [INFO ] [MAIN ] Update Progress: 945/2366 symbols completed. GMRE took 31.5s. Estimated remaining: 3h 2m 32s. Rate: 7.8 symbols/min [2025-10-21T19:01:27.782753] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T19:01:27.796431] [INFO ] [REMOTE ] GNE: Full fetch complete (22594 records). [2025-10-21T19:01:27.806815] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-21T19:01:27.936459] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:01:28.155317] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-21T19:01:28.257113] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-21T19:01:28.257994] [DEBUG] [LOCAL ] GNRC: Loaded 45450 existing records from primary storage. [2025-10-21T19:01:28.258087] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-21T19:01:28.258677] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-21T19:01:28.258751] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-21T19:01:28.259307] [INFO ] [MAIN ] GNRC: Loaded 45450 existing records. [2025-10-21T19:01:28.317456] [DEBUG] [LOCAL ] GNE: Trimmed 22594 records to 18119 (keeping 200 days of data) [2025-10-21T19:01:28.533134] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:01:28.542894] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-21T19:01:28.542949] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-21T19:01:28.547593] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-21T19:01:28.548415] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-21T19:01:28.649151] [DEBUG] [LOCAL ] GNE: Primary data saved (18119 records). [2025-10-21T19:01:28.672782] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-21T19:01:28.678563] [INFO ] [MAIN ] Update Progress: 946/2366 symbols completed. GNE took 30.9s. Estimated remaining: 3h 2m 15s. Rate: 7.8 symbols/min [2025-10-21T19:01:29.043903] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:01:29.128392] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:01:29.133053] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-21T19:01:29.133313] [DEBUG] [LOCAL ] GNT: Loaded 8645 existing records from primary storage. [2025-10-21T19:01:29.134577] [INFO ] [MAIN ] GNT: Loaded 8645 existing records. [2025-10-21T19:01:29.260730] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T19:01:29.350156] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:01:29.350369] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-21T19:01:29.350427] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-21T19:01:29.350600] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-21T19:01:29.350692] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-21T19:01:29.708933] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:01:29.751011] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-21T19:01:29.803356] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T19:01:30.551150] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-21T19:01:30.848252] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T19:01:30.960397] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T19:01:30.966690] [INFO ] [REMOTE ] GNK: Full fetch complete (57300 records). [2025-10-21T19:01:30.966851] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-21T19:01:31.354058] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-21T19:01:31.390966] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-21T19:01:31.391041] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-21T19:01:31.391836] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-21T19:01:31.391899] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-21T19:01:31.393196] [DEBUG] [LOCAL ] GNK: Trimmed 57300 records to 39630 (keeping 200 days of data) [2025-10-21T19:01:31.631562] [DEBUG] [LOCAL ] GNK: Primary data saved (39630 records). [2025-10-21T19:01:31.631743] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-21T19:01:31.632633] [INFO ] [MAIN ] Update Progress: 947/2366 symbols completed. GNK took 32.2s. Estimated remaining: 3h 1m 60s. Rate: 7.8 symbols/min [2025-10-21T19:01:31.827324] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:01:31.879046] [DEBUG] [LOCAL ] GNW: Loaded 51392 existing records from primary storage. [2025-10-21T19:01:31.879372] [INFO ] [MAIN ] GNW: Loaded 51392 existing records. [2025-10-21T19:01:32.077682] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:01:32.084712] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-21T19:01:32.086501] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-21T19:01:32.085728] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-21T19:01:32.110512] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-21T19:01:32.113312] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-21T19:01:32.121193] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T19:01:32.156307] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-21T19:01:32.487130] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:01:32.841460] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T19:01:32.951057] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-21T19:01:33.751061] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-21T19:01:34.551069] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-21T19:01:34.665441] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T19:01:34.673783] [INFO ] [REMOTE ] GNL: Full fetch complete (68162 records). [2025-10-21T19:01:34.674005] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-21T19:01:35.065250] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-21T19:01:35.065342] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-21T19:01:35.066277] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-21T19:01:35.066343] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-21T19:01:35.067688] [DEBUG] [LOCAL ] GNL: Trimmed 68162 records to 46556 (keeping 200 days of data) [2025-10-21T19:01:35.305461] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-21T19:01:35.359570] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-21T19:01:35.410132] [DEBUG] [LOCAL ] GNL: Primary data saved (46556 records). [2025-10-21T19:01:35.410033] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T19:01:35.410313] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-21T19:01:35.419669] [INFO ] [MAIN ] Update Progress: 948/2366 symbols completed. GNL took 31.1s. Estimated remaining: 3h 1m 46s. Rate: 7.8 symbols/min [2025-10-21T19:01:35.601635] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:01:35.642482] [DEBUG] [LOCAL ] GOF: Loaded 42707 existing records from primary storage. [2025-10-21T19:01:35.642778] [INFO ] [MAIN ] GOF: Loaded 42707 existing records. [2025-10-21T19:01:35.815700] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:01:35.815891] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-21T19:01:35.815940] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-21T19:01:35.816294] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-21T19:01:35.816342] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-21T19:01:36.152709] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-21T19:01:36.176544] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:01:36.187510] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-21T19:01:36.951079] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-21T19:01:37.760277] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-21T19:01:37.763724] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T19:01:38.551056] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-21T19:01:38.608445] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T19:01:39.351052] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-21T19:01:39.553945] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T19:01:40.093156] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-21T19:01:40.151468] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-21T19:01:40.156418] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-21T19:01:40.951081] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-21T19:01:41.751029] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-21T19:01:41.882125] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T19:01:42.527260] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-21T19:01:42.526504] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T19:01:42.550995] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-21T19:01:43.261469] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-21T19:01:43.351042] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-21T19:01:44.151014] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-21T19:01:44.758890] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T19:01:44.951057] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-21T19:01:45.033692] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T19:01:45.751065] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-21T19:01:46.551006] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-21T19:01:46.666697] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T19:01:46.739446] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T19:01:47.351038] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-21T19:01:48.151074] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-21T19:01:48.479065] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T19:01:48.481396] [INFO ] [REMOTE ] GNT: Full fetch complete (11436 records). [2025-10-21T19:01:48.481630] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-21T19:01:48.677391] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-21T19:01:48.901019] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-21T19:01:48.901097] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-21T19:01:48.901371] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-21T19:01:48.901408] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-21T19:01:48.901878] [DEBUG] [LOCAL ] GNT: Trimmed 11436 records to 8676 (keeping 200 days of data) [2025-10-21T19:01:48.951255] [DEBUG] [LOCAL ] GNT: Primary data saved (8676 records). [2025-10-21T19:01:48.951126] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-21T19:01:48.951543] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-21T19:01:48.952509] [INFO ] [MAIN ] Update Progress: 949/2366 symbols completed. GNT took 20.3s. Estimated remaining: 3h 1m 47s. Rate: 7.8 symbols/min [2025-10-21T19:01:49.121988] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:01:49.152671] [DEBUG] [LOCAL ] GOLF: Loaded 30669 existing records from primary storage. [2025-10-21T19:01:49.152943] [INFO ] [MAIN ] GOLF: Loaded 30669 existing records. [2025-10-21T19:01:49.327187] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:01:49.327393] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-21T19:01:49.327439] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-21T19:01:49.327612] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-21T19:01:49.327682] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-21T19:01:49.679821] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:01:49.751033] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-21T19:01:50.009919] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T19:01:50.550991] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-21T19:01:50.742217] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T19:01:50.888583] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T19:01:51.351028] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-21T19:01:52.151015] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-21T19:01:52.210805] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T19:01:52.770932] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T19:01:52.951084] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-21T19:01:53.741274] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T19:01:53.750898] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-21T19:01:54.441757] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T19:01:54.551043] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-21T19:01:55.324005] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T19:01:55.350989] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-21T19:01:55.615764] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-21T19:01:56.151025] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-21T19:01:56.951006] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-21T19:01:57.130630] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T19:01:57.756141] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-21T19:01:57.773312] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T19:01:58.414350] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T19:01:58.551027] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-21T19:01:59.351052] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-21T19:01:59.506589] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T19:01:59.809202] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-21T19:02:00.151044] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-21T19:02:00.951006] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-21T19:02:01.036105] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T19:02:01.689887] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T19:02:01.750989] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-21T19:02:02.551034] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-21T19:02:03.341875] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-21T19:02:03.351334] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-21T19:02:03.539636] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T19:02:04.108509] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T19:02:04.151085] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-21T19:02:04.776433] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T19:02:04.951089] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-21T19:02:05.750998] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-21T19:02:05.863186] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T19:02:06.551004] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-21T19:02:06.685027] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T19:02:06.949503] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-21T19:02:07.351074] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-21T19:02:08.151010] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-21T19:02:08.274921] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T19:02:08.650104] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T19:02:08.654489] [INFO ] [REMOTE ] GOLF: Full fetch complete (45307 records). [2025-10-21T19:02:08.654599] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-21T19:02:08.956099] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-21T19:02:09.023821] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-21T19:02:09.023892] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-21T19:02:09.024563] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-21T19:02:09.024623] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-21T19:02:09.025580] [DEBUG] [LOCAL ] GOLF: Trimmed 45307 records to 30473 (keeping 200 days of data) [2025-10-21T19:02:09.211973] [DEBUG] [LOCAL ] GOLF: Primary data saved (30473 records). [2025-10-21T19:02:09.212324] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-21T19:02:09.212421] [INFO ] [MAIN ] Update Progress: 950/2366 symbols completed. GOLF took 20.3s. Estimated remaining: 3h 1m 58s. Rate: 7.8 symbols/min [2025-10-21T19:02:09.377140] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:02:09.418792] [DEBUG] [LOCAL ] GOOS: Loaded 44284 existing records from primary storage. [2025-10-21T19:02:09.419139] [INFO ] [MAIN ] GOOS: Loaded 44284 existing records. [2025-10-21T19:02:09.595220] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:02:09.595507] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-21T19:02:09.595569] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-21T19:02:09.596155] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-21T19:02:09.596213] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-21T19:02:09.753963] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-21T19:02:09.959030] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:02:10.030711] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T19:02:10.038175] [INFO ] [REMOTE ] GNRC: Full fetch complete (65639 records). [2025-10-21T19:02:10.038321] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-21T19:02:10.422929] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-21T19:02:10.423005] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-21T19:02:10.423851] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-21T19:02:10.423913] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-21T19:02:10.425495] [DEBUG] [LOCAL ] GNRC: Trimmed 65639 records to 45398 (keeping 200 days of data) [2025-10-21T19:02:10.595408] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-21T19:02:10.698907] [DEBUG] [LOCAL ] GNRC: Primary data saved (45398 records). [2025-10-21T19:02:10.699041] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-21T19:02:10.699117] [INFO ] [MAIN ] Update Progress: 951/2366 symbols completed. GNRC took 43.0s. Estimated remaining: 3h 1m 41s. Rate: 7.8 symbols/min [2025-10-21T19:02:10.871468] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:02:10.898135] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T19:02:10.935794] [DEBUG] [LOCAL ] GOTU: Loaded 36945 existing records from primary storage. [2025-10-21T19:02:10.936078] [INFO ] [MAIN ] GOTU: Loaded 36945 existing records. [2025-10-21T19:02:11.115687] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:02:11.115933] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-21T19:02:11.116021] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-21T19:02:11.116295] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-21T19:02:11.116352] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-21T19:02:11.362201] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-21T19:02:11.511160] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:02:11.667416] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T19:02:11.675870] [INFO ] [REMOTE ] GNW: Full fetch complete (73847 records). [2025-10-21T19:02:11.675998] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-21T19:02:12.073240] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-21T19:02:12.073425] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-21T19:02:12.074732] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-21T19:02:12.074910] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-21T19:02:12.076725] [DEBUG] [LOCAL ] GNW: Trimmed 73847 records to 51379 (keeping 200 days of data) [2025-10-21T19:02:12.155154] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-21T19:02:12.200600] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T19:02:12.397923] [DEBUG] [LOCAL ] GNW: Primary data saved (51379 records). [2025-10-21T19:02:12.398067] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-21T19:02:12.398697] [INFO ] [MAIN ] Update Progress: 952/2366 symbols completed. GNW took 40.8s. Estimated remaining: 3h 1m 25s. Rate: 7.8 symbols/min [2025-10-21T19:02:12.566532] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:02:12.611036] [DEBUG] [LOCAL ] GPC: Loaded 45947 existing records from primary storage. [2025-10-21T19:02:12.611345] [INFO ] [MAIN ] GPC: Loaded 45947 existing records. [2025-10-21T19:02:12.786051] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:02:12.786314] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-21T19:02:12.786371] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-21T19:02:12.786697] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-21T19:02:12.786752] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-21T19:02:12.953813] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-21T19:02:13.186808] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:02:13.369160] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-21T19:02:13.376237] [INFO ] [REMOTE ] GOF: Full fetch complete (62601 records). [2025-10-21T19:02:13.376332] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-21T19:02:13.757549] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-21T19:02:13.761999] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-21T19:02:13.762182] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-21T19:02:13.763329] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-21T19:02:13.763505] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-21T19:02:13.765134] [DEBUG] [LOCAL ] GOF: Trimmed 62601 records to 42730 (keeping 200 days of data) [2025-10-21T19:02:13.903737] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-21T19:02:14.085755] [DEBUG] [LOCAL ] GOF: Primary data saved (42730 records). [2025-10-21T19:02:14.085896] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-21T19:02:14.086270] [INFO ] [MAIN ] Update Progress: 953/2366 symbols completed. GOF took 38.7s. Estimated remaining: 3h 1m 8s. Rate: 7.8 symbols/min [2025-10-21T19:02:14.257567] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:02:14.274380] [DEBUG] [LOCAL ] GPI: Loaded 14844 existing records from primary storage. [2025-10-21T19:02:14.274606] [INFO ] [MAIN ] GPI: Loaded 14844 existing records. [2025-10-21T19:02:14.455185] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:02:14.455426] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-21T19:02:14.455474] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-21T19:02:14.455624] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-21T19:02:14.455709] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-21T19:02:14.554268] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-21T19:02:14.815856] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:02:14.846567] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-21T19:02:15.351114] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-21T19:02:15.396761] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T19:02:16.151067] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-21T19:02:16.260617] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-21T19:02:16.346245] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T19:02:16.951105] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-21T19:02:17.751035] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-21T19:02:17.848785] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T19:02:17.865598] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-21T19:02:18.551080] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-21T19:02:19.335416] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T19:02:19.350985] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-21T19:02:20.151067] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-21T19:02:20.402876] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T19:02:20.951049] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-21T19:02:21.064039] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-21T19:02:21.286135] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-21T19:02:21.751028] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-21T19:02:22.551030] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-21T19:02:22.766742] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T19:02:22.997926] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T19:02:23.351089] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-21T19:02:24.022405] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-21T19:02:24.151024] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-21T19:02:24.509615] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T19:02:24.951080] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-21T19:02:25.723785] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T19:02:25.751027] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-21T19:02:25.773488] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T19:02:26.551028] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-21T19:02:27.350991] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-21T19:02:27.444949] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T19:02:27.465458] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-21T19:02:28.151020] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-21T19:02:28.942323] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T19:02:28.950982] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-21T19:02:29.751013] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-21T19:02:29.785104] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T19:02:30.035623] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-21T19:02:30.551004] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-21T19:02:30.764621] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-21T19:02:31.351024] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-21T19:02:32.151000] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-21T19:02:32.243176] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-21T19:02:32.278777] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T19:02:32.951076] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-21T19:02:33.572161] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T19:02:33.751030] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-21T19:02:34.211770] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-21T19:02:34.550996] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-21T19:02:35.351063] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-21T19:02:35.426710] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T19:02:35.542763] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T19:02:36.151051] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-21T19:02:36.859179] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-21T19:02:36.951001] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-21T19:02:37.116605] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-21T19:02:37.751025] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-21T19:02:38.550999] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-21T19:02:38.635701] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T19:02:39.238373] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-21T19:02:39.351004] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-21T19:02:39.539691] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T19:02:39.542961] [INFO ] [REMOTE ] GPI: Full fetch complete (21783 records). [2025-10-21T19:02:39.543041] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-21T19:02:39.912757] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-21T19:02:39.912852] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-21T19:02:39.913302] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-21T19:02:39.913362] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-21T19:02:39.913952] [DEBUG] [LOCAL ] GPI: Trimmed 21783 records to 14752 (keeping 200 days of data) [2025-10-21T19:02:40.002990] [DEBUG] [LOCAL ] GPI: Primary data saved (14752 records). [2025-10-21T19:02:40.003122] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-21T19:02:40.003197] [INFO ] [MAIN ] Update Progress: 954/2366 symbols completed. GPI took 25.9s. Estimated remaining: 3h 1m 27s. Rate: 7.8 symbols/min [2025-10-21T19:02:40.152421] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-21T19:02:40.171600] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:02:40.178026] [DEBUG] [LOCAL ] GPJA: Loaded 4118 existing records from primary storage. [2025-10-21T19:02:40.178386] [INFO ] [MAIN ] GPJA: Loaded 4118 existing records. [2025-10-21T19:02:40.353536] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:02:40.353772] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-21T19:02:40.353848] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-21T19:02:40.354016] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-21T19:02:40.354056] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-21T19:02:40.707234] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:02:40.951024] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-21T19:02:41.157820] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T19:02:41.165032] [INFO ] [REMOTE ] GPC: Full fetch complete (68685 records). [2025-10-21T19:02:41.165147] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-21T19:02:41.569564] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-21T19:02:41.569679] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-21T19:02:41.570710] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-21T19:02:41.570930] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-21T19:02:41.572501] [DEBUG] [LOCAL ] GPC: Trimmed 68685 records to 45944 (keeping 200 days of data) [2025-10-21T19:02:41.696482] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T19:02:41.789946] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-21T19:02:41.900861] [DEBUG] [LOCAL ] GPC: Primary data saved (45944 records). [2025-10-21T19:02:41.901006] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-21T19:02:41.901721] [INFO ] [MAIN ] Update Progress: 955/2366 symbols completed. GPC took 29.5s. Estimated remaining: 3h 1m 11s. Rate: 7.8 symbols/min [2025-10-21T19:02:42.089615] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:02:42.111321] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T19:02:42.169513] [DEBUG] [LOCAL ] GPK: Loaded 52784 existing records from primary storage. [2025-10-21T19:02:42.169876] [INFO ] [MAIN ] GPK: Loaded 52784 existing records. [2025-10-21T19:02:42.370410] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:02:42.370608] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-21T19:02:42.370715] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-21T19:02:42.370925] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-21T19:02:42.370981] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-21T19:02:42.567080] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-21T19:02:42.777131] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:02:43.351050] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-21T19:02:43.482946] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T19:02:43.490058] [INFO ] [REMOTE ] GOOS: Full fetch complete (64687 records). [2025-10-21T19:02:43.490166] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-21T19:02:43.601341] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T19:02:43.893212] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-21T19:02:43.893351] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-21T19:02:43.894348] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-21T19:02:43.894413] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-21T19:02:43.895743] [DEBUG] [LOCAL ] GOOS: Trimmed 64687 records to 44145 (keeping 200 days of data) [2025-10-21T19:02:44.152294] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-21T19:02:44.158712] [DEBUG] [LOCAL ] GOOS: Primary data saved (44145 records). [2025-10-21T19:02:44.158906] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-21T19:02:44.159039] [INFO ] [MAIN ] Update Progress: 956/2366 symbols completed. GOOS took 34.9s. Estimated remaining: 3h 0m 55s. Rate: 7.8 symbols/min [2025-10-21T19:02:44.334340] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:02:44.362297] [DEBUG] [LOCAL ] GPMT: Loaded 25982 existing records from primary storage. [2025-10-21T19:02:44.362591] [INFO ] [MAIN ] GPMT: Loaded 25982 existing records. [2025-10-21T19:02:44.559195] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:02:44.565049] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-21T19:02:44.574241] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-21T19:02:44.575787] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T19:02:44.584940] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-21T19:02:44.585583] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-21T19:02:44.585726] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-21T19:02:44.619681] [INFO ] [REMOTE ] GOTU: Full fetch complete (58435 records). [2025-10-21T19:02:44.651753] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-21T19:02:44.960915] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-21T19:02:45.309783] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:02:45.391259] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-21T19:02:45.391342] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-21T19:02:45.392285] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-21T19:02:45.392349] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-21T19:02:45.393508] [DEBUG] [LOCAL ] GOTU: Trimmed 58435 records to 37040 (keeping 200 days of data) [2025-10-21T19:02:45.575165] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-21T19:02:45.602481] [DEBUG] [LOCAL ] GOTU: Primary data saved (37040 records). [2025-10-21T19:02:45.602628] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-21T19:02:45.602747] [INFO ] [MAIN ] Update Progress: 957/2366 symbols completed. GOTU took 34.9s. Estimated remaining: 3h 0m 38s. Rate: 7.8 symbols/min [2025-10-21T19:02:45.751084] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-21T19:02:46.327234] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-21T19:02:46.551010] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-21T19:02:47.351070] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-21T19:02:47.905073] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-21T19:02:48.151126] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-21T19:02:48.278338] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T19:02:48.512934] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-21T19:02:48.951077] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-21T19:02:49.583068] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-21T19:02:49.751024] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-21T19:02:50.329697] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-21T19:02:50.551068] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-21T19:02:51.156230] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-21T19:02:51.351031] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-21T19:02:52.151098] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-21T19:02:52.421214] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T19:02:52.951065] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-21T19:02:53.688543] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T19:02:53.750972] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-21T19:02:53.983556] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T19:02:54.551066] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-21T19:02:55.350994] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-21T19:02:55.446145] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T19:02:55.727042] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-21T19:02:55.992455] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-21T19:02:55.993461] [INFO ] [REMOTE ] GPJA: Full fetch complete (6846 records). [2025-10-21T19:02:55.993529] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-21T19:02:56.151538] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-21T19:02:56.367169] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-21T19:02:56.367244] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-21T19:02:56.367424] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-21T19:02:56.367461] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-21T19:02:56.367880] [DEBUG] [LOCAL ] GPJA: Trimmed 6846 records to 4112 (keeping 200 days of data) [2025-10-21T19:02:56.392492] [DEBUG] [LOCAL ] GPJA: Primary data saved (4112 records). [2025-10-21T19:02:56.392590] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-21T19:02:56.392685] [INFO ] [MAIN ] Update Progress: 958/2366 symbols completed. GPJA took 16.4s. Estimated remaining: 3h 0m 35s. Rate: 7.8 symbols/min [2025-10-21T19:02:56.951106] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-21T19:02:58.045556] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T19:02:58.059706] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-21T19:02:58.109023] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T19:02:58.551078] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-21T19:02:59.669735] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-21T19:02:59.676491] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-21T19:02:59.987352] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-21T19:03:00.150991] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-21T19:03:01.331170] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T19:03:01.340022] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-21T19:03:02.180363] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T19:03:02.191352] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-21T19:03:02.425936] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-21T19:03:02.551045] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-21T19:03:03.524361] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-21T19:03:03.529200] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-21T19:03:04.062952] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T19:03:04.151068] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-21T19:03:04.476932] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-21T19:03:04.951086] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-21T19:03:05.881792] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T19:03:05.893162] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-21T19:03:06.168191] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T19:03:06.171711] [INFO ] [REMOTE ] GPMT: Full fetch complete (36477 records). [2025-10-21T19:03:06.171797] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-21T19:03:06.543599] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-21T19:03:06.543722] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-21T19:03:06.544347] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-21T19:03:06.544386] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-21T19:03:06.545406] [DEBUG] [LOCAL ] GPMT: Trimmed 36477 records to 26021 (keeping 200 days of data) [2025-10-21T19:03:06.697925] [DEBUG] [LOCAL ] GPMT: Primary data saved (26021 records). [2025-10-21T19:03:06.698046] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-21T19:03:06.698123] [INFO ] [MAIN ] Update Progress: 959/2366 symbols completed. GPMT took 22.5s. Estimated remaining: 3h 0m 31s. Rate: 7.8 symbols/min [2025-10-21T19:03:07.826342] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T19:03:07.838675] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-21T19:03:09.574988] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T19:03:09.583074] [INFO ] [REMOTE ] GPK: Full fetch complete (76057 records). [2025-10-21T19:03:09.583210] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-21T19:03:09.973269] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-21T19:03:09.973360] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-21T19:03:09.974341] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-21T19:03:09.974405] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-21T19:03:09.975885] [DEBUG] [LOCAL ] GPK: Trimmed 76057 records to 52780 (keeping 200 days of data) [2025-10-21T19:03:10.310711] [DEBUG] [LOCAL ] GPK: Primary data saved (52780 records). [2025-10-21T19:03:10.310849] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-21T19:03:10.311532] [INFO ] [MAIN ] Update Progress: 960/2366 symbols completed. GPK took 28.4s. Estimated remaining: 3h 0m 18s. Rate: 7.8 symbols/min [2025-10-21T19:03:10.879205] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:03:10.954444] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:03:11.017107] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:03:11.065532] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:03:11.106743] [DEBUG] [LOCAL ] GPRK: Loaded 39821 existing records from primary storage. [2025-10-21T19:03:11.107469] [DEBUG] [LOCAL ] GPOR: Loaded 23397 existing records from primary storage. [2025-10-21T19:03:11.107614] [INFO ] [MAIN ] GPRK: Loaded 39821 existing records. [2025-10-21T19:03:11.107824] [INFO ] [MAIN ] GPOR: Loaded 23397 existing records. [2025-10-21T19:03:11.337373] [DEBUG] [LOCAL ] GRBK: Loaded 26937 existing records from primary storage. [2025-10-21T19:03:11.338740] [INFO ] [MAIN ] GRBK: Loaded 26937 existing records. [2025-10-21T19:03:11.541277] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:03:11.571091] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-21T19:03:11.565801] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:03:11.603764] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-21T19:03:11.631061] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-21T19:03:11.631003] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-21T19:03:11.631235] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-21T19:03:11.645386] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-21T19:03:11.646535] [DEBUG] [LOCAL ] GPN: Loaded 51943 existing records from primary storage. [2025-10-21T19:03:11.687096] [INFO ] [MAIN ] GPN: Loaded 51943 existing records. [2025-10-21T19:03:11.681849] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-21T19:03:11.731980] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-21T19:03:11.849216] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:03:11.953964] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-21T19:03:11.993434] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-21T19:03:12.027573] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-21T19:03:12.065107] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-21T19:03:12.398083] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:03:12.419233] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-21T19:03:12.590010] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-21T19:03:12.819723] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:03:12.746272] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-21T19:03:12.820092] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-21T19:03:12.844613] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-21T19:03:13.013404] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:03:13.058355] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-21T19:03:13.191057] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:03:13.213089] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-21T19:03:13.425892] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:03:13.426231] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-21T19:03:14.358224] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T19:03:14.364038] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-21T19:03:14.632498] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-21T19:03:14.639545] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-21T19:03:14.755602] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T19:03:14.764309] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-21T19:03:14.791664] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T19:03:14.802076] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-21T19:03:15.567413] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-21T19:03:15.572239] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-21T19:03:16.288697] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T19:03:16.308518] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-21T19:03:16.309267] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T19:03:16.317883] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-21T19:03:16.449576] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T19:03:16.459571] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-21T19:03:16.711259] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-21T19:03:16.951008] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-21T19:03:17.490849] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-21T19:03:17.636091] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-21T19:03:17.751030] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-21T19:03:18.082398] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-21T19:03:18.298200] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T19:03:18.551028] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-21T19:03:19.351019] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-21T19:03:19.467345] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T19:03:20.151014] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-21T19:03:20.441696] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T19:03:20.755994] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-21T19:03:20.951021] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-21T19:03:21.254386] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T19:03:21.751083] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-21T19:03:22.551089] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-21T19:03:22.585411] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T19:03:22.927888] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-21T19:03:23.351011] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-21T19:03:23.639756] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T19:03:24.151019] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-21T19:03:24.951019] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-21T19:03:25.054855] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T19:03:25.111702] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T19:03:25.751061] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-21T19:03:26.438596] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T19:03:26.551026] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-21T19:03:26.909554] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T19:03:27.351016] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-21T19:03:28.151029] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-21T19:03:28.340536] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T19:03:28.633769] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T19:03:28.950999] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-21T19:03:29.329390] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T19:03:29.751023] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-21T19:03:30.551045] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-21T19:03:30.815352] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T19:03:30.881889] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T19:03:31.351011] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-21T19:03:31.652448] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-21T19:03:32.151057] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-21T19:03:32.850300] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T19:03:32.950997] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-21T19:03:33.751007] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-21T19:03:33.891397] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T19:03:34.045772] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T19:03:34.550991] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-21T19:03:34.945744] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T19:03:35.351035] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-21T19:03:35.991742] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T19:03:36.151030] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-21T19:03:36.665502] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T19:03:36.669961] [INFO ] [REMOTE ] GRBK: Full fetch complete (40028 records). [2025-10-21T19:03:36.670071] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-21T19:03:36.956257] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-21T19:03:37.069899] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-21T19:03:37.069993] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-21T19:03:37.070685] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-21T19:03:37.070749] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-21T19:03:37.071790] [DEBUG] [LOCAL ] GRBK: Trimmed 40028 records to 26836 (keeping 200 days of data) [2025-10-21T19:03:37.225508] [DEBUG] [LOCAL ] GRBK: Primary data saved (26836 records). [2025-10-21T19:03:37.225631] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-21T19:03:37.225748] [INFO ] [MAIN ] Update Progress: 961/2366 symbols completed. GRBK took 26.9s. Estimated remaining: 3h 0m 38s. Rate: 7.8 symbols/min [2025-10-21T19:03:37.394449] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:03:37.405247] [DEBUG] [LOCAL ] GRC: Loaded 9306 existing records from primary storage. [2025-10-21T19:03:37.405442] [INFO ] [MAIN ] GRC: Loaded 9306 existing records. [2025-10-21T19:03:37.581767] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:03:37.582020] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-21T19:03:37.582073] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-21T19:03:37.582216] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-21T19:03:37.582253] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-21T19:03:37.762218] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-21T19:03:37.906573] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-21T19:03:37.963688] [INFO ] [REMOTE ] GPRK: Full fetch complete (58358 records). [2025-10-21T19:03:37.979185] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-21T19:03:37.984425] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:03:38.370806] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-21T19:03:38.370900] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-21T19:03:38.371814] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-21T19:03:38.371895] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-21T19:03:38.388801] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T19:03:38.394736] [DEBUG] [LOCAL ] GPRK: Trimmed 58358 records to 39820 (keeping 200 days of data) [2025-10-21T19:03:38.552084] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-21T19:03:38.624358] [DEBUG] [LOCAL ] GPRK: Primary data saved (39820 records). [2025-10-21T19:03:38.624850] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-21T19:03:38.625059] [INFO ] [MAIN ] Update Progress: 962/2366 symbols completed. GPRK took 28.3s. Estimated remaining: 3h 0m 21s. Rate: 7.8 symbols/min [2025-10-21T19:03:38.788933] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:03:38.809695] [DEBUG] [LOCAL ] GRDN: Loaded 21063 existing records from primary storage. [2025-10-21T19:03:38.809933] [INFO ] [MAIN ] GRDN: Loaded 21063 existing records. [2025-10-21T19:03:38.982346] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:03:38.982547] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-21T19:03:38.982593] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-21T19:03:38.982771] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-21T19:03:38.982825] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-21T19:03:39.329144] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:03:39.350978] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-21T19:03:39.606019] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T19:03:39.614211] [INFO ] [REMOTE ] GPN: Full fetch complete (75060 records). [2025-10-21T19:03:39.614359] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-21T19:03:40.040499] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T19:03:40.040881] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-21T19:03:40.045850] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-21T19:03:40.046953] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-21T19:03:40.047048] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-21T19:03:40.047210] [INFO ] [REMOTE ] GPOR: Full fetch complete (34851 records). [2025-10-21T19:03:40.047620] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-21T19:03:40.126538] [DEBUG] [LOCAL ] GPN: Trimmed 75060 records to 51923 (keeping 200 days of data) [2025-10-21T19:03:40.155965] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-21T19:03:40.297964] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T19:03:40.687024] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-21T19:03:40.688361] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-21T19:03:40.689027] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-21T19:03:40.691510] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-21T19:03:40.712189] [DEBUG] [LOCAL ] GPOR: Trimmed 34851 records to 23342 (keeping 200 days of data) [2025-10-21T19:03:40.912147] [DEBUG] [LOCAL ] GPN: Primary data saved (51923 records). [2025-10-21T19:03:40.913555] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-21T19:03:40.915449] [INFO ] [MAIN ] Update Progress: 963/2366 symbols completed. GPN took 30.6s. Estimated remaining: 3h 0m 6s. Rate: 7.8 symbols/min [2025-10-21T19:03:40.963166] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-21T19:03:40.970530] [DEBUG] [LOCAL ] GPOR: Primary data saved (23342 records). [2025-10-21T19:03:41.002004] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-21T19:03:41.002217] [INFO ] [MAIN ] Update Progress: 964/2366 symbols completed. GPOR took 30.7s. Estimated remaining: 2h 59m 47s. Rate: 7.8 symbols/min [2025-10-21T19:03:41.098063] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-21T19:03:41.275915] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:03:41.277604] [DEBUG] [LOCAL ] GRMN: No existing data file found in primary storage. [2025-10-21T19:03:41.294446] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:03:41.292279] [WARN ] [MAIN ] GRMN: No existing data found, performing full refresh instead. [2025-10-21T19:03:41.294949] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-21T19:03:41.295001] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-21T19:03:41.295045] [DEBUG] [LOCAL ] GRMN: No primary data file found to delete. [2025-10-21T19:03:41.295077] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-21T19:03:41.631740] [DEBUG] [LOCAL ] GRND: Loaded 50199 existing records from primary storage. [2025-10-21T19:03:41.655981] [INFO ] [MAIN ] GRND: Loaded 50199 existing records. [2025-10-21T19:03:41.734926] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:03:41.757916] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-21T19:03:41.885517] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:03:41.885920] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-21T19:03:41.885972] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-21T19:03:41.886190] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-21T19:03:41.886248] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-21T19:03:42.008372] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T19:03:42.255590] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:03:42.341868] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T19:03:42.551063] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-21T19:03:43.351103] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-21T19:03:44.143779] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T19:03:44.151745] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-21T19:03:44.947322] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T19:03:44.956200] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-21T19:03:44.967899] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-21T19:03:45.750988] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-21T19:03:45.967372] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-21T19:03:46.551072] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-21T19:03:47.190876] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T19:03:47.350993] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-21T19:03:47.508278] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-21T19:03:48.150992] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-21T19:03:48.233317] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-21T19:03:48.951071] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-21T19:03:49.751091] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-21T19:03:49.787297] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T19:03:50.540379] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T19:03:50.550990] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-21T19:03:50.633617] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T19:03:51.273986] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T19:03:51.351063] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-21T19:03:52.151051] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-21T19:03:52.951102] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-21T19:03:53.042270] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T19:03:53.215147] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-21T19:03:53.711208] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-21T19:03:53.750985] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-21T19:03:54.551028] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-21T19:03:55.350998] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-21T19:03:55.517846] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T19:03:55.564115] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-21T19:03:56.151030] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-21T19:03:56.338021] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-21T19:03:56.951056] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-21T19:03:57.751049] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-21T19:03:57.926497] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-21T19:03:58.551023] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-21T19:03:58.742875] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T19:03:58.743509] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T19:03:59.005933] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-21T19:03:59.351048] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-21T19:04:00.151121] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-21T19:04:00.235227] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T19:04:00.237926] [INFO ] [REMOTE ] GRC: Full fetch complete (13413 records). [2025-10-21T19:04:00.237997] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-21T19:04:00.598795] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-21T19:04:00.598875] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-21T19:04:00.599282] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-21T19:04:00.599320] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-21T19:04:00.599808] [DEBUG] [LOCAL ] GRC: Trimmed 13413 records to 9277 (keeping 200 days of data) [2025-10-21T19:04:00.656450] [DEBUG] [LOCAL ] GRC: Primary data saved (9277 records). [2025-10-21T19:04:00.656588] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-21T19:04:00.656694] [INFO ] [MAIN ] Update Progress: 965/2366 symbols completed. GRC took 23.4s. Estimated remaining: 2h 59m 57s. Rate: 7.8 symbols/min [2025-10-21T19:04:00.827075] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:04:00.858979] [DEBUG] [LOCAL ] GRNT: Loaded 33992 existing records from primary storage. [2025-10-21T19:04:00.859241] [INFO ] [MAIN ] GRNT: Loaded 33992 existing records. [2025-10-21T19:04:00.957536] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-21T19:04:01.048281] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:04:01.048549] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-21T19:04:01.048699] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-21T19:04:01.050147] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-21T19:04:01.050206] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-21T19:04:01.413602] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:04:01.751075] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-21T19:04:01.870338] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T19:04:02.551006] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-21T19:04:02.617256] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T19:04:03.035687] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-21T19:04:03.351074] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-21T19:04:03.931355] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-21T19:04:04.151006] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-21T19:04:04.555512] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T19:04:04.951083] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-21T19:04:05.446744] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T19:04:05.751065] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-21T19:04:06.021718] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T19:04:06.551042] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-21T19:04:07.282635] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-21T19:04:07.350982] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-21T19:04:08.151007] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-21T19:04:08.327454] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T19:04:08.951006] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-21T19:04:09.095850] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T19:04:09.167861] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-21T19:04:09.751020] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-21T19:04:10.499382] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T19:04:10.551051] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-21T19:04:11.046439] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T19:04:11.351034] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-21T19:04:12.084496] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-21T19:04:12.151065] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-21T19:04:12.582455] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T19:04:12.586918] [INFO ] [REMOTE ] GRDN: Full fetch complete (26463 records). [2025-10-21T19:04:12.587020] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-21T19:04:12.956230] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-21T19:04:13.006363] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-21T19:04:13.006450] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-21T19:04:13.007241] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-21T19:04:13.007341] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-21T19:04:13.008793] [DEBUG] [LOCAL ] GRDN: Trimmed 26463 records to 21184 (keeping 200 days of data) [2025-10-21T19:04:13.136157] [DEBUG] [LOCAL ] GRDN: Primary data saved (21184 records). [2025-10-21T19:04:13.136290] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-21T19:04:13.136373] [INFO ] [MAIN ] Update Progress: 966/2366 symbols completed. GRDN took 34.5s. Estimated remaining: 2h 59m 56s. Rate: 7.8 symbols/min [2025-10-21T19:04:13.322728] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:04:13.334410] [DEBUG] [LOCAL ] GROV: Loaded 8747 existing records from primary storage. [2025-10-21T19:04:13.334686] [INFO ] [MAIN ] GROV: Loaded 8747 existing records. [2025-10-21T19:04:13.525961] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:04:13.526164] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-21T19:04:13.526212] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-21T19:04:13.526359] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-21T19:04:13.526415] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-21T19:04:13.756549] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-21T19:04:13.886443] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:04:14.049363] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T19:04:14.057794] [INFO ] [REMOTE ] GRND: Full fetch complete (71733 records). [2025-10-21T19:04:14.057975] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-21T19:04:14.483095] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-21T19:04:14.483276] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-21T19:04:14.484336] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-21T19:04:14.484586] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-21T19:04:14.512392] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T19:04:14.512564] [DEBUG] [LOCAL ] GRND: Trimmed 71733 records to 50203 (keeping 200 days of data) [2025-10-21T19:04:14.569196] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-21T19:04:14.814800] [DEBUG] [LOCAL ] GRND: Primary data saved (50203 records). [2025-10-21T19:04:14.814937] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-21T19:04:14.815014] [INFO ] [MAIN ] Update Progress: 967/2366 symbols completed. GRND took 33.8s. Estimated remaining: 2h 59m 39s. Rate: 7.8 symbols/min [2025-10-21T19:04:15.011986] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:04:15.017623] [DEBUG] [LOCAL ] GRX: Loaded 4840 existing records from primary storage. [2025-10-21T19:04:15.017800] [INFO ] [MAIN ] GRX: Loaded 4840 existing records. [2025-10-21T19:04:15.200721] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:04:15.200922] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-21T19:04:15.200969] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-21T19:04:15.201115] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-21T19:04:15.201171] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-21T19:04:15.361890] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-21T19:04:15.547917] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T19:04:15.589912] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:04:15.591219] [INFO ] [REMOTE ] GRMN: Full fetch complete (59542 records). [2025-10-21T19:04:15.591455] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-21T19:04:15.994036] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T19:04:16.031387] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-21T19:04:16.031520] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-21T19:04:16.039256] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-21T19:04:16.039969] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-21T19:04:16.041820] [DEBUG] [LOCAL ] GRMN: Trimmed 59542 records to 39939 (keeping 200 days of data) [2025-10-21T19:04:16.151037] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-21T19:04:16.302163] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-21T19:04:16.318412] [DEBUG] [LOCAL ] GRMN: Primary data saved (39939 records). [2025-10-21T19:04:16.318564] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-21T19:04:16.318639] [INFO ] [MAIN ] Update Progress: 968/2366 symbols completed. GRMN took 35.4s. Estimated remaining: 2h 59m 23s. Rate: 7.8 symbols/min [2025-10-21T19:04:16.497297] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:04:16.546500] [DEBUG] [LOCAL ] GS: Loaded 51784 existing records from primary storage. [2025-10-21T19:04:16.546828] [INFO ] [MAIN ] GS: Loaded 51784 existing records. [2025-10-21T19:04:16.735171] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:04:16.735770] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-21T19:04:16.735951] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-21T19:04:16.736158] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-21T19:04:16.736200] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-21T19:04:16.855796] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-21T19:04:16.956182] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-21T19:04:17.105310] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:04:17.348085] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-21T19:04:17.751063] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-21T19:04:18.551043] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-21T19:04:19.316476] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T19:04:19.350987] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-21T19:04:19.849081] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-21T19:04:20.150995] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-21T19:04:20.167582] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-21T19:04:20.728092] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-21T19:04:20.951031] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-21T19:04:21.751030] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-21T19:04:22.550992] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-21T19:04:23.016187] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-21T19:04:23.113089] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-21T19:04:23.134562] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T19:04:23.350999] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-21T19:04:23.963766] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-21T19:04:24.151005] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-21T19:04:24.951020] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-21T19:04:25.534292] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-21T19:04:25.675917] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-21T19:04:25.750995] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-21T19:04:26.315504] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-21T19:04:26.551012] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-21T19:04:27.122606] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-21T19:04:27.351104] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-21T19:04:27.961577] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T19:04:28.150993] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-21T19:04:28.922929] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-21T19:04:28.951007] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-21T19:04:29.666740] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-21T19:04:29.668150] [INFO ] [REMOTE ] GRX: Full fetch complete (6544 records). [2025-10-21T19:04:29.668219] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-21T19:04:29.756163] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-21T19:04:30.029056] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-21T19:04:30.029131] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-21T19:04:30.029314] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-21T19:04:30.029354] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-21T19:04:30.029781] [DEBUG] [LOCAL ] GRX: Trimmed 6544 records to 4844 (keeping 200 days of data) [2025-10-21T19:04:30.057955] [DEBUG] [LOCAL ] GRX: Primary data saved (4844 records). [2025-10-21T19:04:30.058062] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-21T19:04:30.058146] [INFO ] [MAIN ] Update Progress: 969/2366 symbols completed. GRX took 15.2s. Estimated remaining: 2h 59m 24s. Rate: 7.8 symbols/min [2025-10-21T19:04:30.237391] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:04:30.274510] [DEBUG] [LOCAL ] GSBD: Loaded 39645 existing records from primary storage. [2025-10-21T19:04:30.274827] [INFO ] [MAIN ] GSBD: Loaded 39645 existing records. [2025-10-21T19:04:30.448148] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:04:30.448406] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-21T19:04:30.448470] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-21T19:04:30.448765] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-21T19:04:30.448838] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-21T19:04:30.556126] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-21T19:04:30.801741] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:04:31.351013] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-21T19:04:31.414371] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-21T19:04:32.089024] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-21T19:04:32.151024] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-21T19:04:32.299876] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-21T19:04:32.873799] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T19:04:32.951041] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-21T19:04:33.751032] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-21T19:04:34.447858] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-21T19:04:34.550995] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-21T19:04:34.737611] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T19:04:35.351015] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-21T19:04:36.050623] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T19:04:36.137845] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T19:04:36.150993] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-21T19:04:36.806337] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-21T19:04:36.951032] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-21T19:04:37.751029] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-21T19:04:38.551016] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-21T19:04:39.147044] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T19:04:39.290548] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-21T19:04:39.350990] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-21T19:04:39.382291] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T19:04:39.383942] [INFO ] [REMOTE ] GROV: Full fetch complete (13681 records). [2025-10-21T19:04:39.384017] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-21T19:04:39.762279] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-21T19:04:39.762349] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-21T19:04:39.762680] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-21T19:04:39.762741] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-21T19:04:39.763233] [DEBUG] [LOCAL ] GROV: Trimmed 13681 records to 8701 (keeping 200 days of data) [2025-10-21T19:04:39.810253] [DEBUG] [LOCAL ] GROV: Primary data saved (8701 records). [2025-10-21T19:04:39.810383] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-21T19:04:39.810463] [INFO ] [MAIN ] Update Progress: 970/2366 symbols completed. GROV took 26.7s. Estimated remaining: 2h 59m 19s. Rate: 7.8 symbols/min [2025-10-21T19:04:39.985240] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:04:40.033872] [DEBUG] [LOCAL ] GSK: Loaded 53512 existing records from primary storage. [2025-10-21T19:04:40.034178] [INFO ] [MAIN ] GSK: Loaded 53512 existing records. [2025-10-21T19:04:40.156191] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-21T19:04:40.211409] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:04:40.211611] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-21T19:04:40.211719] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-21T19:04:40.212017] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-21T19:04:40.212056] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-21T19:04:40.557964] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:04:40.951092] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-21T19:04:41.612142] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-21T19:04:41.636803] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T19:04:41.642124] [INFO ] [REMOTE ] GRNT: Full fetch complete (48351 records). [2025-10-21T19:04:41.642208] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-21T19:04:41.756130] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-21T19:04:42.022062] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-21T19:04:42.022150] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-21T19:04:42.022878] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-21T19:04:42.022939] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-21T19:04:42.024033] [DEBUG] [LOCAL ] GRNT: Trimmed 48351 records to 34016 (keeping 200 days of data) [2025-10-21T19:04:42.220063] [DEBUG] [LOCAL ] GRNT: Primary data saved (34016 records). [2025-10-21T19:04:42.220200] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-21T19:04:42.221345] [INFO ] [MAIN ] Update Progress: 971/2366 symbols completed. GRNT took 41.6s. Estimated remaining: 2h 59m 4s. Rate: 7.8 symbols/min [2025-10-21T19:04:42.387829] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:04:42.422621] [DEBUG] [LOCAL ] GSL: Loaded 33197 existing records from primary storage. [2025-10-21T19:04:42.422906] [INFO ] [MAIN ] GSL: Loaded 33197 existing records. [2025-10-21T19:04:42.562888] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-21T19:04:42.604258] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:04:42.604702] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-21T19:04:42.604774] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-21T19:04:42.605092] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-21T19:04:42.605140] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-21T19:04:42.969444] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:04:43.016838] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-21T19:04:43.350996] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-21T19:04:43.455946] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T19:04:44.150981] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-21T19:04:44.485145] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-21T19:04:44.942291] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T19:04:44.951800] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-21T19:04:45.459024] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T19:04:45.751025] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-21T19:04:46.551077] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-21T19:04:47.044770] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T19:04:47.162676] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-21T19:04:47.351023] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-21T19:04:48.150994] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-21T19:04:48.562495] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T19:04:48.953745] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-21T19:04:48.958741] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T19:04:49.751108] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-21T19:04:50.109763] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-21T19:04:50.497746] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T19:04:50.550992] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-21T19:04:51.312622] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T19:04:51.350980] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-21T19:04:52.151063] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-21T19:04:52.573324] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-21T19:04:52.862262] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-21T19:04:52.950983] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-21T19:04:53.188060] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T19:04:53.751076] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-21T19:04:54.450430] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T19:04:54.551033] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-21T19:04:54.736245] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-21T19:04:55.351036] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-21T19:04:56.150997] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-21T19:04:56.410865] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T19:04:56.727287] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-21T19:04:56.951014] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-21T19:04:57.751082] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-21T19:04:58.173949] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-21T19:04:58.550992] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-21T19:04:59.057214] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-21T19:04:59.100233] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T19:04:59.141659] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-21T19:04:59.150442] [INFO ] [REMOTE ] GS: Full fetch complete (75838 records). [2025-10-21T19:04:59.150619] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-21T19:04:59.352259] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-21T19:04:59.634162] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-21T19:04:59.634285] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-21T19:04:59.635486] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-21T19:04:59.635557] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-21T19:04:59.637394] [DEBUG] [LOCAL ] GS: Trimmed 75838 records to 51777 (keeping 200 days of data) [2025-10-21T19:05:00.034267] [DEBUG] [LOCAL ] GS: Primary data saved (51777 records). [2025-10-21T19:05:00.034664] [INFO ] [MAIN ] GS: Full history saved. [2025-10-21T19:05:00.034780] [INFO ] [MAIN ] Update Progress: 972/2366 symbols completed. GS took 43.7s. Estimated remaining: 2h 59m 10s. Rate: 7.8 symbols/min [2025-10-21T19:05:00.156179] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-21T19:05:00.217422] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:05:00.264047] [DEBUG] [LOCAL ] GTES: Loaded 50321 existing records from primary storage. [2025-10-21T19:05:00.264376] [INFO ] [MAIN ] GTES: Loaded 50321 existing records. [2025-10-21T19:05:00.451292] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:05:00.451527] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-21T19:05:00.451574] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-21T19:05:00.451800] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-21T19:05:00.451855] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-21T19:05:00.830399] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:05:00.951009] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-21T19:05:01.137179] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T19:05:01.751075] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-21T19:05:02.369234] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T19:05:02.421375] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-21T19:05:02.551050] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-21T19:05:03.196144] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T19:05:03.351028] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-21T19:05:04.151066] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-21T19:05:04.289934] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T19:05:04.732694] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T19:05:04.951044] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-21T19:05:05.592483] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T19:05:05.751049] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-21T19:05:06.551000] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-21T19:05:06.590176] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T19:05:07.351005] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-21T19:05:07.594872] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T19:05:07.602077] [INFO ] [REMOTE ] GSBD: Full fetch complete (58530 records). [2025-10-21T19:05:07.602204] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-21T19:05:07.998599] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-21T19:05:07.998800] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-21T19:05:07.999683] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-21T19:05:07.999837] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-21T19:05:08.001117] [DEBUG] [LOCAL ] GSBD: Trimmed 58530 records to 39579 (keeping 200 days of data) [2025-10-21T19:05:08.131709] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T19:05:08.148452] [INFO ] [REMOTE ] GSL: Full fetch complete (48274 records). [2025-10-21T19:05:08.151958] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-21T19:05:08.159428] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-21T19:05:08.568816] [DEBUG] [LOCAL ] GSBD: Primary data saved (39579 records). [2025-10-21T19:05:08.579751] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-21T19:05:08.580141] [INFO ] [MAIN ] Update Progress: 973/2366 symbols completed. GSBD took 38.5s. Estimated remaining: 2h 59m 4s. Rate: 7.8 symbols/min [2025-10-21T19:05:08.800859] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-21T19:05:08.806098] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-21T19:05:08.812119] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-21T19:05:08.825702] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-21T19:05:08.857633] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:05:08.858378] [DEBUG] [LOCAL ] GSL: Trimmed 48274 records to 33081 (keeping 200 days of data) [2025-10-21T19:05:09.079213] [DEBUG] [LOCAL ] GTLS: Loaded 43326 existing records from primary storage. [2025-10-21T19:05:09.083462] [DEBUG] [LOCAL ] GSL: Primary data saved (33081 records). [2025-10-21T19:05:09.083726] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-21T19:05:09.084440] [INFO ] [MAIN ] Update Progress: 974/2366 symbols completed. GSL took 26.9s. Estimated remaining: 2h 58m 46s. Rate: 7.8 symbols/min [2025-10-21T19:05:09.084632] [INFO ] [MAIN ] GTLS: Loaded 43326 existing records. [2025-10-21T19:05:09.454249] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:05:09.484196] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:05:09.484903] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-21T19:05:09.485543] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-21T19:05:09.485924] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-21T19:05:09.486051] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-21T19:05:09.591399] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-21T19:05:09.638987] [INFO ] [REMOTE ] GSK: Full fetch complete (77636 records). [2025-10-21T19:05:09.644302] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-21T19:05:09.962553] [DEBUG] [LOCAL ] GTN: Loaded 44989 existing records from primary storage. [2025-10-21T19:05:09.966097] [INFO ] [MAIN ] GTN: Loaded 44989 existing records. [2025-10-21T19:05:10.313106] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:05:10.342895] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-21T19:05:10.442936] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-21T19:05:10.471951] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:05:10.490382] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-21T19:05:10.560322] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-21T19:05:10.545842] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-21T19:05:10.584002] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-21T19:05:10.584091] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-21T19:05:10.584062] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-21T19:05:10.585043] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-21T19:05:10.585227] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-21T19:05:10.585281] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-21T19:05:10.693098] [DEBUG] [LOCAL ] GSK: Trimmed 77636 records to 53512 (keeping 200 days of data) [2025-10-21T19:05:11.076984] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:05:11.128936] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-21T19:05:11.278780] [DEBUG] [LOCAL ] GSK: Primary data saved (53512 records). [2025-10-21T19:05:11.278920] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-21T19:05:11.279781] [INFO ] [MAIN ] Update Progress: 975/2366 symbols completed. GSK took 31.5s. Estimated remaining: 2h 58m 30s. Rate: 7.8 symbols/min [2025-10-21T19:05:11.450489] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:05:11.481318] [DEBUG] [LOCAL ] GTY: Loaded 30157 existing records from primary storage. [2025-10-21T19:05:11.481593] [INFO ] [MAIN ] GTY: Loaded 30157 existing records. [2025-10-21T19:05:11.660571] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:05:11.660875] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-21T19:05:11.660925] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-21T19:05:11.661125] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-21T19:05:11.661166] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-21T19:05:12.054595] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:05:12.055011] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-21T19:05:12.082822] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T19:05:12.151031] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-21T19:05:12.473125] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T19:05:12.526587] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T19:05:12.950998] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-21T19:05:13.347328] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-21T19:05:13.556925] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T19:05:13.751025] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-21T19:05:14.551007] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-21T19:05:14.750152] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T19:05:15.253202] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T19:05:15.350983] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-21T19:05:15.797730] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T19:05:16.151010] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-21T19:05:16.950997] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-21T19:05:17.037421] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T19:05:17.358345] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T19:05:17.750999] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-21T19:05:18.375742] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T19:05:18.551061] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-21T19:05:19.351036] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-21T19:05:19.423183] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T19:05:20.151018] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-21T19:05:20.199689] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T19:05:20.951007] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-21T19:05:21.279331] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T19:05:21.498748] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T19:05:21.751026] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-21T19:05:22.551045] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-21T19:05:22.615111] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T19:05:22.783637] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T19:05:23.351028] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-21T19:05:24.151036] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-21T19:05:24.303581] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-21T19:05:24.776349] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-21T19:05:24.951027] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-21T19:05:25.448700] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T19:05:25.751040] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-21T19:05:26.245484] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T19:05:26.551026] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-21T19:05:26.969254] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T19:05:27.351052] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-21T19:05:28.151002] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-21T19:05:28.227199] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T19:05:28.597030] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T19:05:28.951075] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-21T19:05:29.689277] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T19:05:29.750996] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-21T19:05:30.101186] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T19:05:30.551029] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-21T19:05:31.351049] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-21T19:05:31.501044] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T19:05:32.151007] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-21T19:05:32.327213] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T19:05:32.378383] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-21T19:05:32.951063] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-21T19:05:33.751086] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-21T19:05:33.802874] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T19:05:33.813622] [INFO ] [REMOTE ] GTES: Full fetch complete (73903 records). [2025-10-21T19:05:33.813789] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-21T19:05:34.194331] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-21T19:05:34.194409] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-21T19:05:34.195377] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-21T19:05:34.195442] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-21T19:05:34.196781] [DEBUG] [LOCAL ] GTES: Trimmed 73903 records to 50305 (keeping 200 days of data) [2025-10-21T19:05:34.483319] [DEBUG] [LOCAL ] GTES: Primary data saved (50305 records). [2025-10-21T19:05:34.483443] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-21T19:05:34.483518] [INFO ] [MAIN ] Update Progress: 976/2366 symbols completed. GTES took 34.4s. Estimated remaining: 2h 58m 45s. Rate: 7.8 symbols/min [2025-10-21T19:05:34.551793] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-21T19:05:34.665084] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:05:34.698667] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T19:05:34.714770] [DEBUG] [LOCAL ] GUG: Loaded 12194 existing records from primary storage. [2025-10-21T19:05:34.715008] [INFO ] [MAIN ] GUG: Loaded 12194 existing records. [2025-10-21T19:05:34.905700] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:05:34.905939] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-21T19:05:34.905987] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-21T19:05:34.906201] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-21T19:05:34.906258] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-21T19:05:35.291236] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:05:35.318905] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T19:05:35.350984] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-21T19:05:35.795157] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T19:05:36.151028] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-21T19:05:36.951013] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-21T19:05:37.136250] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T19:05:37.143118] [INFO ] [REMOTE ] GTN: Full fetch complete (65878 records). [2025-10-21T19:05:37.143227] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-21T19:05:37.305163] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-21T19:05:37.552428] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-21T19:05:37.552502] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-21T19:05:37.553345] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-21T19:05:37.553405] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-21T19:05:37.554606] [DEBUG] [LOCAL ] GTN: Trimmed 65878 records to 44864 (keeping 200 days of data) [2025-10-21T19:05:37.755847] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-21T19:05:37.827355] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T19:05:37.835231] [DEBUG] [LOCAL ] GTN: Primary data saved (44864 records). [2025-10-21T19:05:37.835333] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-21T19:05:37.842263] [INFO ] [MAIN ] Update Progress: 977/2366 symbols completed. GTN took 28.7s. Estimated remaining: 2h 58m 31s. Rate: 7.8 symbols/min [2025-10-21T19:05:38.008845] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:05:38.026167] [DEBUG] [LOCAL ] GUT: Loaded 15737 existing records from primary storage. [2025-10-21T19:05:38.026411] [INFO ] [MAIN ] GUT: Loaded 15737 existing records. [2025-10-21T19:05:38.199964] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:05:38.200175] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-21T19:05:38.200237] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-21T19:05:38.200384] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-21T19:05:38.200421] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-21T19:05:38.548880] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:05:38.550977] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-21T19:05:39.347515] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-21T19:05:39.356296] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-21T19:05:39.625329] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T19:05:40.151023] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-21T19:05:40.735391] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T19:05:40.740548] [INFO ] [REMOTE ] GTY: Full fetch complete (43853 records). [2025-10-21T19:05:40.740634] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-21T19:05:40.850391] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-21T19:05:40.961290] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-21T19:05:41.131702] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-21T19:05:41.131787] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-21T19:05:41.132486] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-21T19:05:41.132526] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-21T19:05:41.133408] [DEBUG] [LOCAL ] GTY: Trimmed 43853 records to 30068 (keeping 200 days of data) [2025-10-21T19:05:41.311732] [DEBUG] [LOCAL ] GTY: Primary data saved (30068 records). [2025-10-21T19:05:41.311856] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-21T19:05:41.311930] [INFO ] [MAIN ] Update Progress: 978/2366 symbols completed. GTY took 30.0s. Estimated remaining: 2h 58m 17s. Rate: 7.8 symbols/min [2025-10-21T19:05:41.478985] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:05:41.479141] [DEBUG] [LOCAL ] GVA: No existing data file found in primary storage. [2025-10-21T19:05:41.479176] [WARN ] [MAIN ] GVA: No existing data found, performing full refresh instead. [2025-10-21T19:05:41.479278] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-21T19:05:41.479318] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-21T19:05:41.479361] [DEBUG] [LOCAL ] GVA: No primary data file found to delete. [2025-10-21T19:05:41.479392] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-21T19:05:41.756090] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-21T19:05:41.826874] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:05:42.551078] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-21T19:05:42.576474] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T19:05:42.756017] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T19:05:42.762544] [INFO ] [REMOTE ] GTLS: Full fetch complete (61525 records). [2025-10-21T19:05:42.762690] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-21T19:05:43.154051] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-21T19:05:43.154135] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-21T19:05:43.154886] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-21T19:05:43.154947] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-21T19:05:43.156054] [DEBUG] [LOCAL ] GTLS: Trimmed 61525 records to 43183 (keeping 200 days of data) [2025-10-21T19:05:43.354078] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-21T19:05:43.406522] [DEBUG] [LOCAL ] GTLS: Primary data saved (43183 records). [2025-10-21T19:05:43.406680] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-21T19:05:43.407037] [INFO ] [MAIN ] Update Progress: 979/2366 symbols completed. GTLS took 34.8s. Estimated remaining: 2h 58m 1s. Rate: 7.8 symbols/min [2025-10-21T19:05:43.572944] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:05:43.591945] [DEBUG] [LOCAL ] GWH: Loaded 19537 existing records from primary storage. [2025-10-21T19:05:43.592183] [INFO ] [MAIN ] GWH: Loaded 19537 existing records. [2025-10-21T19:05:43.767613] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:05:43.767924] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-21T19:05:43.767999] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-21T19:05:43.768310] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-21T19:05:43.768368] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-21T19:05:44.081006] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T19:05:44.147766] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:05:44.150978] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-21T19:05:44.245486] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-21T19:05:44.849247] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-21T19:05:44.951025] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-21T19:05:45.751027] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-21T19:05:46.455875] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T19:05:46.550999] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-21T19:05:46.657696] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T19:05:47.351005] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-21T19:05:48.054587] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T19:05:48.150992] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-21T19:05:48.326616] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-21T19:05:48.951057] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-21T19:05:49.754394] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-21T19:05:49.757223] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T19:05:49.935403] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T19:05:50.551039] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-21T19:05:50.606035] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-21T19:05:51.351006] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-21T19:05:51.470243] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T19:05:52.081831] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T19:05:52.151058] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-21T19:05:52.951095] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-21T19:05:53.613139] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T19:05:53.711977] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-21T19:05:53.751072] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-21T19:05:54.551087] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-21T19:05:54.663568] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-21T19:05:55.351029] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-21T19:05:55.532676] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T19:05:56.151025] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-21T19:05:56.214076] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T19:05:56.957760] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-21T19:05:56.960127] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-21T19:05:57.696879] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-21T19:05:57.751034] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-21T19:05:58.551078] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-21T19:05:59.071851] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T19:05:59.351018] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-21T19:05:59.424664] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-21T19:06:00.151025] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-21T19:06:00.951010] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-21T19:06:01.161197] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T19:06:01.191212] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T19:06:01.751035] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-21T19:06:02.098490] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T19:06:02.551073] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-21T19:06:02.877959] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T19:06:03.351041] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-21T19:06:03.937429] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-21T19:06:04.151036] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-21T19:06:04.471527] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-21T19:06:04.951026] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-21T19:06:05.519148] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T19:06:05.751004] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-21T19:06:05.820828] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T19:06:05.823055] [INFO ] [REMOTE ] GUG: Full fetch complete (18879 records). [2025-10-21T19:06:05.823123] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-21T19:06:06.198363] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-21T19:06:06.198437] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-21T19:06:06.198858] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-21T19:06:06.198919] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-21T19:06:06.199427] [DEBUG] [LOCAL ] GUG: Trimmed 18879 records to 12192 (keeping 200 days of data) [2025-10-21T19:06:06.272077] [DEBUG] [LOCAL ] GUG: Primary data saved (12192 records). [2025-10-21T19:06:06.272202] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-21T19:06:06.272275] [INFO ] [MAIN ] Update Progress: 980/2366 symbols completed. GUG took 31.8s. Estimated remaining: 2h 58m 15s. Rate: 7.8 symbols/min [2025-10-21T19:06:06.445752] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:06:06.483946] [DEBUG] [LOCAL ] GWRE: Loaded 39801 existing records from primary storage. [2025-10-21T19:06:06.484218] [INFO ] [MAIN ] GWRE: Loaded 39801 existing records. [2025-10-21T19:06:06.552672] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-21T19:06:06.662874] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:06:06.663158] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-21T19:06:06.663216] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-21T19:06:06.663776] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-21T19:06:06.663831] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-21T19:06:06.798918] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T19:06:07.025704] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:06:07.351020] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-21T19:06:07.932399] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-21T19:06:08.151072] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-21T19:06:08.396075] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-21T19:06:08.401325] [INFO ] [REMOTE ] GVA: Full fetch complete (48379 records). [2025-10-21T19:06:08.401437] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-21T19:06:08.782740] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-21T19:06:08.782820] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-21T19:06:08.783543] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-21T19:06:08.783604] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-21T19:06:08.784669] [DEBUG] [LOCAL ] GVA: Trimmed 48379 records to 32612 (keeping 200 days of data) [2025-10-21T19:06:08.959408] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-21T19:06:08.984359] [DEBUG] [LOCAL ] GVA: Primary data saved (32612 records). [2025-10-21T19:06:08.984455] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-21T19:06:08.984521] [INFO ] [MAIN ] Update Progress: 981/2366 symbols completed. GVA took 27.7s. Estimated remaining: 2h 58m 0s. Rate: 7.8 symbols/min [2025-10-21T19:06:09.168908] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:06:09.192352] [DEBUG] [LOCAL ] GWW: Loaded 19418 existing records from primary storage. [2025-10-21T19:06:09.192577] [INFO ] [MAIN ] GWW: Loaded 19418 existing records. [2025-10-21T19:06:09.373121] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:06:09.373382] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-21T19:06:09.373464] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-21T19:06:09.373759] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-21T19:06:09.373831] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-21T19:06:09.756927] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-21T19:06:09.760040] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:06:09.765569] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T19:06:09.979431] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T19:06:09.982371] [INFO ] [REMOTE ] GUT: Full fetch complete (22506 records). [2025-10-21T19:06:09.982441] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-21T19:06:10.354986] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-21T19:06:10.355068] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-21T19:06:10.355581] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-21T19:06:10.355622] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-21T19:06:10.356338] [DEBUG] [LOCAL ] GUT: Trimmed 22506 records to 15651 (keeping 200 days of data) [2025-10-21T19:06:10.446715] [DEBUG] [LOCAL ] GUT: Primary data saved (15651 records). [2025-10-21T19:06:10.446851] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-21T19:06:10.446928] [INFO ] [MAIN ] Update Progress: 982/2366 symbols completed. GUT took 32.6s. Estimated remaining: 2h 57m 44s. Rate: 7.8 symbols/min [2025-10-21T19:06:10.551506] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-21T19:06:10.628872] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:06:10.670528] [DEBUG] [LOCAL ] GXO: Loaded 46617 existing records from primary storage. [2025-10-21T19:06:10.670879] [INFO ] [MAIN ] GXO: Loaded 46617 existing records. [2025-10-21T19:06:10.806039] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-21T19:06:10.868839] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:06:10.869043] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-21T19:06:10.869090] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-21T19:06:10.869335] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-21T19:06:10.869372] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-21T19:06:11.218103] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:06:11.351078] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-21T19:06:11.765872] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-21T19:06:12.151005] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-21T19:06:12.460400] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T19:06:12.951089] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-21T19:06:13.751031] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-21T19:06:13.796458] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T19:06:14.062354] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T19:06:14.551039] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-21T19:06:15.351063] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-21T19:06:15.710807] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T19:06:15.717622] [INFO ] [REMOTE ] GWH: Full fetch complete (24359 records). [2025-10-21T19:06:15.717790] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-21T19:06:16.092819] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-21T19:06:16.092917] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-21T19:06:16.093633] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-21T19:06:16.093732] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-21T19:06:16.094579] [DEBUG] [LOCAL ] GWH: Trimmed 24359 records to 19825 (keeping 200 days of data) [2025-10-21T19:06:16.160980] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-21T19:06:16.172430] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T19:06:16.239633] [DEBUG] [LOCAL ] GWH: Primary data saved (19825 records). [2025-10-21T19:06:16.239797] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-21T19:06:16.239879] [INFO ] [MAIN ] Update Progress: 983/2366 symbols completed. GWH took 32.8s. Estimated remaining: 2h 57m 33s. Rate: 7.8 symbols/min [2025-10-21T19:06:16.418635] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:06:16.436680] [DEBUG] [LOCAL ] GYLD: Loaded 1544 existing records from primary storage. [2025-10-21T19:06:16.437291] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-21T19:06:16.437607] [INFO ] [MAIN ] GYLD: Loaded 1544 existing records. [2025-10-21T19:06:16.625936] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:06:16.626166] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-21T19:06:16.626214] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-21T19:06:16.626371] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-21T19:06:16.626426] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-21T19:06:16.957520] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-21T19:06:16.979111] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:06:17.751031] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-21T19:06:17.905106] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T19:06:18.551069] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-21T19:06:18.710713] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-21T19:06:18.735004] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T19:06:18.840306] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-21T19:06:19.351092] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-21T19:06:20.151053] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-21T19:06:20.360936] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T19:06:20.951099] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-21T19:06:21.751005] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-21T19:06:21.839203] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T19:06:22.269867] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-21T19:06:22.551033] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-21T19:06:22.812585] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-21T19:06:23.351073] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-21T19:06:23.983003] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-21T19:06:24.151019] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-21T19:06:24.521449] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-21T19:06:24.951022] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-21T19:06:25.417146] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-21T19:06:25.751021] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-21T19:06:25.926470] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T19:06:26.205818] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-21T19:06:26.551049] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-21T19:06:27.351012] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-21T19:06:28.048717] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T19:06:28.150985] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-21T19:06:28.950998] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-21T19:06:29.048126] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T19:06:29.254742] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-21T19:06:29.278681] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T19:06:29.751047] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-21T19:06:30.109901] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-21T19:06:30.551038] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-21T19:06:30.974458] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-21T19:06:31.351029] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-21T19:06:32.151000] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-21T19:06:32.391150] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T19:06:32.951046] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-21T19:06:33.565455] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T19:06:33.751064] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-21T19:06:34.022676] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T19:06:34.551057] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-21T19:06:35.310414] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T19:06:35.351013] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-21T19:06:35.677492] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T19:06:36.151013] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-21T19:06:36.962082] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-21T19:06:36.966062] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T19:06:37.283073] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T19:06:37.286344] [INFO ] [REMOTE ] GWW: Full fetch complete (29059 records). [2025-10-21T19:06:37.286444] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-21T19:06:37.455540] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-21T19:06:37.691525] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-21T19:06:37.691664] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-21T19:06:37.692300] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-21T19:06:37.692401] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-21T19:06:37.693376] [DEBUG] [LOCAL ] GWW: Trimmed 29059 records to 19293 (keeping 200 days of data) [2025-10-21T19:06:37.755285] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-21T19:06:37.817975] [DEBUG] [LOCAL ] GWW: Primary data saved (19293 records). [2025-10-21T19:06:37.818117] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-21T19:06:37.818211] [INFO ] [MAIN ] Update Progress: 984/2366 symbols completed. GWW took 28.8s. Estimated remaining: 2h 57m 45s. Rate: 7.8 symbols/min [2025-10-21T19:06:37.983384] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:06:38.027050] [DEBUG] [LOCAL ] H: Loaded 44459 existing records from primary storage. [2025-10-21T19:06:38.027376] [INFO ] [MAIN ] H: Loaded 44459 existing records. [2025-10-21T19:06:38.217190] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:06:38.223865] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-21T19:06:38.223773] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-21T19:06:38.224111] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-21T19:06:38.225556] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-21T19:06:38.225635] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-21T19:06:38.556193] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-21T19:06:38.621198] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:06:39.350996] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-21T19:06:40.151047] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-21T19:06:40.268858] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T19:06:40.510105] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T19:06:40.515930] [INFO ] [REMOTE ] GWRE: Full fetch complete (60146 records). [2025-10-21T19:06:40.516042] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-21T19:06:40.629507] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-21T19:06:40.920850] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-21T19:06:40.920935] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-21T19:06:40.921802] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-21T19:06:40.921866] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-21T19:06:40.923059] [DEBUG] [LOCAL ] GWRE: Trimmed 60146 records to 39681 (keeping 200 days of data) [2025-10-21T19:06:40.972858] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-21T19:06:41.158819] [DEBUG] [LOCAL ] GWRE: Primary data saved (39681 records). [2025-10-21T19:06:41.159043] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-21T19:06:41.159128] [INFO ] [MAIN ] Update Progress: 985/2366 symbols completed. GWRE took 34.9s. Estimated remaining: 2h 57m 31s. Rate: 7.8 symbols/min [2025-10-21T19:06:41.323525] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:06:41.360259] [DEBUG] [LOCAL ] HAE: Loaded 39456 existing records from primary storage. [2025-10-21T19:06:41.360540] [INFO ] [MAIN ] HAE: Loaded 39456 existing records. [2025-10-21T19:06:41.532569] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:06:41.532820] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-21T19:06:41.532876] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-21T19:06:41.533108] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-21T19:06:41.533163] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-21T19:06:41.762546] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-21T19:06:41.888721] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:06:42.551088] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-21T19:06:42.663794] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T19:06:42.976501] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-21T19:06:42.977326] [INFO ] [REMOTE ] GYLD: Full fetch complete (2087 records). [2025-10-21T19:06:42.977393] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-21T19:06:43.359429] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-21T19:06:43.371957] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-21T19:06:43.372150] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-21T19:06:43.372406] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-21T19:06:43.372484] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-21T19:06:43.374415] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T19:06:43.381235] [DEBUG] [LOCAL ] GYLD: Trimmed 2087 records to 1549 (keeping 200 days of data) [2025-10-21T19:06:43.392021] [DEBUG] [LOCAL ] GYLD: Primary data saved (1549 records). [2025-10-21T19:06:43.392600] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-21T19:06:43.392751] [INFO ] [MAIN ] Update Progress: 986/2366 symbols completed. GYLD took 27.2s. Estimated remaining: 2h 57m 16s. Rate: 7.8 symbols/min [2025-10-21T19:06:43.557096] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:06:43.595083] [DEBUG] [LOCAL ] HAFN: Loaded 42843 existing records from primary storage. [2025-10-21T19:06:43.595369] [INFO ] [MAIN ] HAFN: Loaded 42843 existing records. [2025-10-21T19:06:43.768636] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:06:43.768901] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-21T19:06:43.768948] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-21T19:06:43.769130] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-21T19:06:43.769169] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-21T19:06:44.115347] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:06:44.150982] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-21T19:06:44.951112] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-21T19:06:45.270343] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T19:06:45.278069] [INFO ] [REMOTE ] GXO: Full fetch complete (69433 records). [2025-10-21T19:06:45.278267] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-21T19:06:45.700323] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-21T19:06:45.700444] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-21T19:06:45.701996] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-21T19:06:45.702064] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-21T19:06:45.704098] [DEBUG] [LOCAL ] GXO: Trimmed 69433 records to 46525 (keeping 200 days of data) [2025-10-21T19:06:45.756138] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-21T19:06:46.041370] [DEBUG] [LOCAL ] GXO: Primary data saved (46525 records). [2025-10-21T19:06:46.045204] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-21T19:06:46.045055] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-21T19:06:46.057303] [INFO ] [MAIN ] Update Progress: 987/2366 symbols completed. GXO took 35.6s. Estimated remaining: 2h 57m 1s. Rate: 7.8 symbols/min [2025-10-21T19:06:46.248635] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:06:46.274315] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T19:06:46.348412] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-21T19:06:46.348940] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-10-21T19:06:46.556140] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-21T19:06:46.592372] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:06:46.592757] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-21T19:06:46.593557] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-21T19:06:46.593837] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-21T19:06:46.593903] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-21T19:06:47.029818] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:06:47.157185] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T19:06:47.351080] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-21T19:06:48.151028] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-21T19:06:48.326450] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-21T19:06:48.950997] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-21T19:06:49.332290] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-21T19:06:49.612409] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T19:06:49.751044] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-21T19:06:50.551073] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-21T19:06:50.669357] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T19:06:51.351057] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-21T19:06:51.548791] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T19:06:52.151009] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-21T19:06:52.289037] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T19:06:52.951035] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-21T19:06:53.149576] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T19:06:53.751053] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-21T19:06:53.831729] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T19:06:54.267194] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T19:06:54.551072] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-21T19:06:55.254843] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-21T19:06:55.351063] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-21T19:06:56.144184] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T19:06:56.153181] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-21T19:06:56.951105] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-21T19:06:56.993245] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T19:06:57.555862] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-21T19:06:57.751078] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-21T19:06:58.551030] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-21T19:06:58.919122] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T19:06:58.951469] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T19:06:59.351037] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-21T19:07:00.093744] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T19:07:00.150989] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-21T19:07:00.869320] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T19:07:00.950984] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-21T19:07:01.751055] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-21T19:07:01.814049] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T19:07:02.026598] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T19:07:02.551030] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-21T19:07:03.248289] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T19:07:03.350987] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-21T19:07:04.151015] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-21T19:07:04.760393] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-21T19:07:04.824847] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T19:07:04.950985] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-21T19:07:05.677298] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-21T19:07:05.750992] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-21T19:07:06.551010] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-21T19:07:06.640204] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T19:07:07.305838] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-21T19:07:07.351028] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-21T19:07:08.151023] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-21T19:07:08.656456] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-21T19:07:08.699279] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T19:07:08.709111] [INFO ] [REMOTE ] HAE: Full fetch complete (59172 records). [2025-10-21T19:07:08.709379] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-21T19:07:08.960946] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-21T19:07:09.130040] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-21T19:07:09.130128] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-21T19:07:09.131007] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-21T19:07:09.131073] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-21T19:07:09.132256] [DEBUG] [LOCAL ] HAE: Trimmed 59172 records to 39378 (keeping 200 days of data) [2025-10-21T19:07:09.365200] [DEBUG] [LOCAL ] HAE: Primary data saved (39378 records). [2025-10-21T19:07:09.365350] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-21T19:07:09.365435] [INFO ] [MAIN ] Update Progress: 988/2366 symbols completed. HAE took 28.2s. Estimated remaining: 2h 57m 15s. Rate: 7.8 symbols/min [2025-10-21T19:07:09.539090] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:07:09.579623] [DEBUG] [LOCAL ] HASI: Loaded 47810 existing records from primary storage. [2025-10-21T19:07:09.579939] [INFO ] [MAIN ] HASI: Loaded 47810 existing records. [2025-10-21T19:07:09.756876] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-21T19:07:09.760548] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:07:09.761768] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-21T19:07:09.761951] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-21T19:07:09.762424] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-21T19:07:09.762573] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-21T19:07:09.952376] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-21T19:07:10.160855] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:07:10.551034] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-21T19:07:10.738047] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T19:07:10.744361] [INFO ] [REMOTE ] HAFN: Full fetch complete (64695 records). [2025-10-21T19:07:10.744479] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-21T19:07:11.134469] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-21T19:07:11.134550] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-21T19:07:11.135380] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-21T19:07:11.135442] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-21T19:07:11.136637] [DEBUG] [LOCAL ] HAFN: Trimmed 64695 records to 42724 (keeping 200 days of data) [2025-10-21T19:07:11.358820] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-21T19:07:11.396020] [DEBUG] [LOCAL ] HAFN: Primary data saved (42724 records). [2025-10-21T19:07:11.396168] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-21T19:07:11.396255] [INFO ] [MAIN ] Update Progress: 989/2366 symbols completed. HAFN took 28.0s. Estimated remaining: 2h 56m 60s. Rate: 7.8 symbols/min [2025-10-21T19:07:11.617768] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:07:11.663696] [DEBUG] [LOCAL ] HAYW: Loaded 48833 existing records from primary storage. [2025-10-21T19:07:11.664000] [INFO ] [MAIN ] HAYW: Loaded 48833 existing records. [2025-10-21T19:07:11.903501] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-21T19:07:11.908243] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:07:11.908830] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-21T19:07:11.919337] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-21T19:07:11.920931] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-21T19:07:11.921064] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-21T19:07:12.156800] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-21T19:07:12.310081] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:07:12.311961] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T19:07:12.950995] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-21T19:07:13.056323] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T19:07:13.751023] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-21T19:07:14.313030] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-21T19:07:14.434436] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T19:07:14.551009] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-21T19:07:15.340299] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T19:07:15.350988] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-21T19:07:16.151003] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-21T19:07:16.195806] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T19:07:16.890238] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T19:07:16.950978] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-21T19:07:17.751010] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-21T19:07:18.183673] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-21T19:07:18.551063] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-21T19:07:18.600718] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T19:07:19.351028] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-21T19:07:19.507077] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T19:07:20.151053] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-21T19:07:20.613489] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-21T19:07:20.951004] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-21T19:07:21.062600] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T19:07:21.069694] [INFO ] [REMOTE ] H: Full fetch complete (63277 records). [2025-10-21T19:07:21.069851] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-21T19:07:21.460903] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-21T19:07:21.461005] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-21T19:07:21.461861] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-21T19:07:21.462003] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-21T19:07:21.464347] [DEBUG] [LOCAL ] H: Trimmed 63277 records to 44375 (keeping 200 days of data) [2025-10-21T19:07:21.583933] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-21T19:07:21.751687] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-21T19:07:21.793460] [DEBUG] [LOCAL ] H: Primary data saved (44375 records). [2025-10-21T19:07:21.793572] [INFO ] [MAIN ] H: Full history saved. [2025-10-21T19:07:21.793666] [INFO ] [MAIN ] Update Progress: 990/2366 symbols completed. H took 44.0s. Estimated remaining: 2h 56m 56s. Rate: 7.8 symbols/min [2025-10-21T19:07:21.961172] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:07:21.970091] [DEBUG] [LOCAL ] HBB: Loaded 6459 existing records from primary storage. [2025-10-21T19:07:21.970293] [INFO ] [MAIN ] HBB: Loaded 6459 existing records. [2025-10-21T19:07:22.149333] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:07:22.149599] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-21T19:07:22.149683] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-21T19:07:22.149841] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-21T19:07:22.149881] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-21T19:07:22.532836] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T19:07:22.531732] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:07:22.541634] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-10-21T19:07:22.541756] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-21T19:07:22.556203] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-21T19:07:22.929494] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-21T19:07:22.929568] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-21T19:07:22.930486] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-21T19:07:22.930551] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-21T19:07:22.931920] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 53718 (keeping 200 days of data) [2025-10-21T19:07:23.250584] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-10-21T19:07:23.250734] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-21T19:07:23.251302] [INFO ] [MAIN ] Update Progress: 991/2366 symbols completed. HAL took 37.2s. Estimated remaining: 2h 56m 39s. Rate: 7.8 symbols/min [2025-10-21T19:07:23.352241] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-21T19:07:23.428329] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:07:23.480039] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T19:07:23.513332] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-21T19:07:23.533875] [DEBUG] [LOCAL ] HBI: Loaded 52948 existing records from primary storage. [2025-10-21T19:07:23.534194] [INFO ] [MAIN ] HBI: Loaded 52948 existing records. [2025-10-21T19:07:23.710815] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:07:23.711051] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-21T19:07:23.711127] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-21T19:07:23.711351] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-21T19:07:23.711417] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-21T19:07:24.058228] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:07:24.150987] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-21T19:07:24.924246] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T19:07:24.950984] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-21T19:07:25.751056] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-21T19:07:25.818758] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T19:07:26.195004] [DEBUG] [REMOTE ] HBB: Error fetching primary data for 2025-02: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-21T19:07:26.195198] [WARN ] [REMOTE ] HBB: No data returned for month 2025-02 [2025-10-21T19:07:26.195321] [FATAL] [REMOTE ] HBB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:07:26.195445] [FATAL] [MAIN ] HBB: Failed to fetch primary data. [2025-10-21T19:07:26.195566] [WARN ] [MAIN ] HBB: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:07:26.195750] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-21T19:07:26.195866] [DEBUG] [LOCAL ] HBB: No primary data file found to delete. [2025-10-21T19:07:26.195932] [INFO ] [LOCAL ] HBB: Starting deletion of derivative data. [2025-10-21T19:07:26.196154] [DEBUG] [LOCAL ] HBB: Deleted derivative data file. [2025-10-21T19:07:26.196222] [INFO ] [MAIN ] Update Progress: 992/2366 symbols completed. HBB took 4.4s. Estimated remaining: 2h 56m 25s. Rate: 7.8 symbols/min [2025-10-21T19:07:26.363740] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:07:26.413316] [DEBUG] [LOCAL ] HBM: Loaded 52976 existing records from primary storage. [2025-10-21T19:07:26.413611] [INFO ] [MAIN ] HBM: Loaded 52976 existing records. [2025-10-21T19:07:26.563299] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-21T19:07:26.594206] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:07:26.594515] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-21T19:07:26.594714] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-21T19:07:26.594989] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-21T19:07:26.595086] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-21T19:07:26.730957] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T19:07:27.002625] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:07:27.351024] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-21T19:07:28.151069] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-21T19:07:28.283940] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T19:07:28.951060] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-21T19:07:29.003928] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T19:07:29.597184] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T19:07:29.751023] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-21T19:07:30.216588] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T19:07:30.551025] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-21T19:07:30.852864] [DEBUG] [REMOTE ] HBM: Error fetching primary data for 2025-01: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-21T19:07:30.852996] [WARN ] [REMOTE ] HBM: No data returned for month 2025-01 [2025-10-21T19:07:30.853066] [FATAL] [REMOTE ] HBM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:07:30.853108] [FATAL] [MAIN ] HBM: Failed to fetch primary data. [2025-10-21T19:07:30.853139] [WARN ] [MAIN ] HBM: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:07:30.853199] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-21T19:07:30.853285] [DEBUG] [LOCAL ] HBM: No primary data file found to delete. [2025-10-21T19:07:30.853335] [INFO ] [LOCAL ] HBM: Starting deletion of derivative data. [2025-10-21T19:07:30.853481] [DEBUG] [LOCAL ] HBM: Deleted derivative data file. [2025-10-21T19:07:30.853548] [INFO ] [MAIN ] Update Progress: 993/2366 symbols completed. HBM took 4.7s. Estimated remaining: 2h 56m 13s. Rate: 7.8 symbols/min [2025-10-21T19:07:31.021501] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:07:31.067132] [DEBUG] [LOCAL ] HCA: Loaded 46957 existing records from primary storage. [2025-10-21T19:07:31.067406] [INFO ] [MAIN ] HCA: Loaded 46957 existing records. [2025-10-21T19:07:31.260167] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:07:31.260377] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-21T19:07:31.260443] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-21T19:07:31.260715] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-21T19:07:31.260787] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-21T19:07:31.359528] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-21T19:07:31.622229] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:07:31.862129] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T19:07:32.151068] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-21T19:07:32.951054] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-21T19:07:33.050313] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T19:07:33.750987] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-21T19:07:33.826715] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T19:07:34.531094] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T19:07:34.550978] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-21T19:07:35.327106] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T19:07:35.350992] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-21T19:07:35.971234] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T19:07:36.151106] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-21T19:07:36.951011] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-21T19:07:37.064196] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T19:07:37.071555] [INFO ] [REMOTE ] HASI: Full fetch complete (68319 records). [2025-10-21T19:07:37.071695] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-21T19:07:37.476518] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-21T19:07:37.476592] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-21T19:07:37.477448] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-21T19:07:37.477511] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-21T19:07:37.478795] [DEBUG] [LOCAL ] HASI: Trimmed 68319 records to 47751 (keeping 200 days of data) [2025-10-21T19:07:37.754678] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-21T19:07:37.762048] [DEBUG] [LOCAL ] HASI: Primary data saved (47751 records). [2025-10-21T19:07:37.763017] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-21T19:07:37.763108] [INFO ] [MAIN ] Update Progress: 994/2366 symbols completed. HASI took 28.4s. Estimated remaining: 2h 56m 4s. Rate: 7.8 symbols/min [2025-10-21T19:07:37.939828] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:07:37.985579] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T19:07:38.030235] [DEBUG] [LOCAL ] HCC: Loaded 45162 existing records from primary storage. [2025-10-21T19:07:38.030525] [INFO ] [MAIN ] HCC: Loaded 45162 existing records. [2025-10-21T19:07:38.213539] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:07:38.213748] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-21T19:07:38.213800] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-21T19:07:38.213983] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-21T19:07:38.214024] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-21T19:07:38.571834] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-21T19:07:38.577774] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:07:38.704397] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T19:07:39.351081] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-21T19:07:39.775137] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-21T19:07:40.151101] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-21T19:07:40.355718] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-21T19:07:40.951047] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-21T19:07:41.001267] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T19:07:41.009781] [INFO ] [REMOTE ] HAYW: Full fetch complete (70921 records). [2025-10-21T19:07:41.010002] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-21T19:07:41.426093] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-21T19:07:41.426203] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-21T19:07:41.427516] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-21T19:07:41.427584] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-21T19:07:41.429705] [DEBUG] [LOCAL ] HAYW: Trimmed 70921 records to 48821 (keeping 200 days of data) [2025-10-21T19:07:41.738900] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T19:07:41.752051] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-21T19:07:41.763464] [DEBUG] [LOCAL ] HAYW: Primary data saved (48821 records). [2025-10-21T19:07:41.763611] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-21T19:07:41.764290] [INFO ] [MAIN ] Update Progress: 995/2366 symbols completed. HAYW took 30.4s. Estimated remaining: 2h 55m 51s. Rate: 7.8 symbols/min [2025-10-21T19:07:41.933461] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:07:41.950335] [DEBUG] [LOCAL ] HCI: Loaded 14113 existing records from primary storage. [2025-10-21T19:07:41.950556] [INFO ] [MAIN ] HCI: Loaded 14113 existing records. [2025-10-21T19:07:42.124102] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:07:42.124282] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-21T19:07:42.124328] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-21T19:07:42.124486] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-21T19:07:42.124523] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-21T19:07:42.479589] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:07:42.515030] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T19:07:42.551031] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-21T19:07:43.311561] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T19:07:43.351057] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-21T19:07:43.937430] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T19:07:44.151025] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-21T19:07:44.951030] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-21T19:07:45.020593] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T19:07:45.709309] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T19:07:45.751008] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-21T19:07:46.551012] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-21T19:07:46.717972] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T19:07:46.735064] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-21T19:07:47.351046] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-21T19:07:48.151035] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-21T19:07:48.687874] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-21T19:07:48.934628] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T19:07:48.950981] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-21T19:07:49.456339] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-21T19:07:49.751044] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-21T19:07:50.551004] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-21T19:07:50.658099] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-21T19:07:50.823505] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T19:07:51.351053] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-21T19:07:52.151073] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-21T19:07:52.229392] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T19:07:52.960459] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-21T19:07:52.981636] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T19:07:53.096581] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T19:07:53.751030] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-21T19:07:54.535233] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T19:07:54.550981] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-21T19:07:55.351017] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-21T19:07:55.581808] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T19:07:55.590170] [INFO ] [REMOTE ] HBI: Full fetch complete (76990 records). [2025-10-21T19:07:55.590307] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-21T19:07:56.002883] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-21T19:07:56.002993] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-21T19:07:56.004041] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-21T19:07:56.004160] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-21T19:07:56.005697] [DEBUG] [LOCAL ] HBI: Trimmed 76990 records to 52933 (keeping 200 days of data) [2025-10-21T19:07:56.161628] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-21T19:07:56.233172] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T19:07:56.269483] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T19:07:56.268838] [INFO ] [REMOTE ] HCA: Full fetch complete (68930 records). [2025-10-21T19:07:56.298211] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-21T19:07:56.453200] [DEBUG] [LOCAL ] HBI: Primary data saved (52933 records). [2025-10-21T19:07:56.466199] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-21T19:07:56.466919] [INFO ] [MAIN ] Update Progress: 996/2366 symbols completed. HBI took 33.2s. Estimated remaining: 2h 55m 53s. Rate: 7.8 symbols/min [2025-10-21T19:07:56.856085] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:07:56.882272] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-21T19:07:56.908375] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-21T19:07:56.954859] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-21T19:07:56.941327] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-21T19:07:56.959848] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-21T19:07:56.959624] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-21T19:07:56.960016] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-21T19:07:56.960090] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-21T19:07:56.960173] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-21T19:07:57.010612] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-21T19:07:57.029862] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-21T19:07:57.078165] [DEBUG] [LOCAL ] HCA: Trimmed 68930 records to 46914 (keeping 200 days of data) [2025-10-21T19:07:57.479425] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:07:57.652680] [DEBUG] [LOCAL ] HCA: Primary data saved (46914 records). [2025-10-21T19:07:57.652835] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-21T19:07:57.652919] [INFO ] [MAIN ] Update Progress: 997/2366 symbols completed. HCA took 26.8s. Estimated remaining: 2h 55m 37s. Rate: 7.8 symbols/min [2025-10-21T19:07:57.751006] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-21T19:07:57.860622] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T19:07:57.975605] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-21T19:07:57.985111] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-21T19:07:58.551040] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-21T19:07:58.857482] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-21T19:07:59.351054] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-21T19:07:59.680315] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-21T19:08:00.151033] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-21T19:08:00.387194] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-21T19:08:00.951054] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-21T19:08:01.751030] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-21T19:08:02.551018] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-21T19:08:02.627185] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T19:08:02.754679] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-21T19:08:02.849303] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-21T19:08:03.351078] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-21T19:08:04.151054] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-21T19:08:04.930875] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T19:08:04.950979] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-21T19:08:05.066204] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-21T19:08:05.751007] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-21T19:08:06.077735] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-21T19:08:06.551003] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-21T19:08:06.807172] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-21T19:08:07.351063] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-21T19:08:07.541342] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-21T19:08:08.151029] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-21T19:08:08.932937] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T19:08:08.951004] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-21T19:08:09.132977] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T19:08:09.135709] [INFO ] [REMOTE ] HCI: Full fetch complete (19628 records). [2025-10-21T19:08:09.135794] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-21T19:08:09.507345] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-21T19:08:09.507675] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-21T19:08:09.508258] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-21T19:08:09.508318] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-21T19:08:09.508952] [DEBUG] [LOCAL ] HCI: Trimmed 19628 records to 14056 (keeping 200 days of data) [2025-10-21T19:08:09.596860] [DEBUG] [LOCAL ] HCI: Primary data saved (14056 records). [2025-10-21T19:08:09.596998] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-21T19:08:09.597076] [INFO ] [MAIN ] Update Progress: 998/2366 symbols completed. HCI took 27.8s. Estimated remaining: 2h 55m 35s. Rate: 7.8 symbols/min [2025-10-21T19:08:09.751053] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-21T19:08:10.106765] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-21T19:08:10.522306] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T19:08:10.550988] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-21T19:08:11.351065] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-21T19:08:11.683069] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-21T19:08:12.154406] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-21T19:08:12.157353] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T19:08:12.165513] [INFO ] [REMOTE ] HCC: Full fetch complete (64874 records). [2025-10-21T19:08:12.165715] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-21T19:08:12.467913] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-21T19:08:12.563033] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-21T19:08:12.563163] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-21T19:08:12.564028] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-21T19:08:12.564091] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-21T19:08:12.565324] [DEBUG] [LOCAL ] HCC: Trimmed 64874 records to 45053 (keeping 200 days of data) [2025-10-21T19:08:12.826141] [DEBUG] [LOCAL ] HCC: Primary data saved (45053 records). [2025-10-21T19:08:12.826266] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-21T19:08:12.826344] [INFO ] [MAIN ] Update Progress: 999/2366 symbols completed. HCC took 35.1s. Estimated remaining: 2h 55m 21s. Rate: 7.8 symbols/min [2025-10-21T19:08:12.950996] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-21T19:08:13.310034] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-21T19:08:13.310691] [INFO ] [REMOTE ] HCXY: Full fetch complete (513 records). [2025-10-21T19:08:13.310758] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-21T19:08:13.482484] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-10-21T19:08:13.482693] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:08:13.482764] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:08:13.482834] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-21T19:08:13.482895] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-21T19:08:13.482930] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-21T19:08:13.482984] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-21T19:08:13.483038] [INFO ] [MAIN ] Update Progress: 1000/2366 symbols completed. HCXY took 17.0s. Estimated remaining: 2h 55m 4s. Rate: 7.8 symbols/min [2025-10-21T19:08:14.075675] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:08:14.101320] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:08:14.165172] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:08:14.185147] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:08:14.256337] [DEBUG] [LOCAL ] HEI: Loaded 30890 existing records from primary storage. [2025-10-21T19:08:14.270054] [INFO ] [MAIN ] HEI: Loaded 30890 existing records. [2025-10-21T19:08:14.342487] [DEBUG] [LOCAL ] HE: Loaded 48865 existing records from primary storage. [2025-10-21T19:08:14.373436] [INFO ] [MAIN ] HE: Loaded 48865 existing records. [2025-10-21T19:08:14.373244] [DEBUG] [LOCAL ] HD: Loaded 53482 existing records from primary storage. [2025-10-21T19:08:14.451232] [DEBUG] [LOCAL ] HDB: Loaded 51936 existing records from primary storage. [2025-10-21T19:08:14.446877] [INFO ] [MAIN ] HD: Loaded 53482 existing records. [2025-10-21T19:08:14.505158] [INFO ] [MAIN ] HDB: Loaded 51936 existing records. [2025-10-21T19:08:14.760831] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:08:14.900970] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-21T19:08:14.911394] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-21T19:08:14.928079] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:08:14.996947] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-21T19:08:14.985070] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-21T19:08:15.009416] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-21T19:08:15.023463] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:08:15.041665] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-21T19:08:15.084917] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-21T19:08:15.098183] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-21T19:08:15.092987] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-21T19:08:15.115540] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-21T19:08:15.087780] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:08:15.136747] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-21T19:08:15.147115] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-21T19:08:15.152401] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-21T19:08:15.171084] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-21T19:08:15.244560] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-21T19:08:15.280382] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-21T19:08:16.244299] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:08:16.313347] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-21T19:08:16.440614] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:08:16.466459] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-21T19:08:16.535372] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:08:16.563180] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-21T19:08:16.562725] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:08:16.564361] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-21T19:08:17.857518] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T19:08:17.865544] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-21T19:08:18.226209] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T19:08:18.237159] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-21T19:08:18.282881] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T19:08:18.365030] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T19:08:18.551076] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-21T19:08:19.301957] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T19:08:19.350995] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-21T19:08:20.151026] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-21T19:08:20.243861] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T19:08:20.350369] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-21T19:08:20.898777] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T19:08:20.951030] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-21T19:08:21.751011] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-21T19:08:21.909520] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T19:08:22.551072] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-21T19:08:23.098073] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-21T19:08:23.336745] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T19:08:23.350975] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-21T19:08:24.151009] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-21T19:08:24.275211] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T19:08:24.948932] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T19:08:24.951792] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-21T19:08:25.751007] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-21T19:08:25.903764] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-21T19:08:26.551026] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-21T19:08:26.876929] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T19:08:26.940494] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-21T19:08:27.351138] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-21T19:08:28.151044] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-21T19:08:28.294132] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T19:08:28.660232] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-21T19:08:28.951030] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-21T19:08:29.751039] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-21T19:08:30.397739] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-21T19:08:30.413365] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T19:08:30.551055] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-21T19:08:31.203287] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T19:08:31.351031] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-21T19:08:32.151019] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-21T19:08:32.227195] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T19:08:32.951028] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-21T19:08:33.535118] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-21T19:08:33.751000] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-21T19:08:33.828045] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T19:08:34.551034] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-21T19:08:35.066255] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-21T19:08:35.351023] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-21T19:08:36.151046] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-21T19:08:36.184667] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-21T19:08:36.601281] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-21T19:08:36.951002] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-21T19:08:37.028192] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T19:08:37.469767] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T19:08:37.751031] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-21T19:08:38.551096] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-21T19:08:39.023627] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T19:08:39.028102] [INFO ] [REMOTE ] HEI: Full fetch complete (47436 records). [2025-10-21T19:08:39.028229] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-21T19:08:39.353577] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-21T19:08:39.454857] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-21T19:08:39.455034] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-21T19:08:39.455936] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-21T19:08:39.456141] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-21T19:08:39.457475] [DEBUG] [LOCAL ] HEI: Trimmed 47436 records to 30723 (keeping 200 days of data) [2025-10-21T19:08:39.591285] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-21T19:08:39.704344] [DEBUG] [LOCAL ] HEI: Primary data saved (30723 records). [2025-10-21T19:08:39.704467] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-21T19:08:39.705362] [INFO ] [MAIN ] Update Progress: 1001/2366 symbols completed. HEI took 26.2s. Estimated remaining: 2h 55m 21s. Rate: 7.8 symbols/min [2025-10-21T19:08:39.873369] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:08:39.883702] [DEBUG] [LOCAL ] HEQ: Loaded 6822 existing records from primary storage. [2025-10-21T19:08:39.883918] [INFO ] [MAIN ] HEQ: Loaded 6822 existing records. [2025-10-21T19:08:40.062562] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:08:40.062761] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-21T19:08:40.062829] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-21T19:08:40.062963] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-21T19:08:40.063000] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-21T19:08:40.163549] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-21T19:08:40.438014] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:08:40.468421] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-21T19:08:40.951035] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-21T19:08:41.179288] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T19:08:41.555197] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-21T19:08:41.751021] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-21T19:08:41.948291] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T19:08:42.551067] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-21T19:08:43.351009] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-21T19:08:43.503556] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T19:08:44.007908] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T19:08:44.151013] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-21T19:08:44.313959] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-21T19:08:44.517895] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-21T19:08:44.951037] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-21T19:08:45.670133] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-21T19:08:45.751045] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-21T19:08:46.551046] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-21T19:08:47.351022] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-21T19:08:47.677023] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-21T19:08:47.685499] [INFO ] [REMOTE ] HDB: Full fetch complete (75648 records). [2025-10-21T19:08:47.685710] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-21T19:08:48.005032] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-21T19:08:48.091546] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-21T19:08:48.091630] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-21T19:08:48.092574] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-21T19:08:48.092626] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-21T19:08:48.094047] [DEBUG] [LOCAL ] HDB: Trimmed 75648 records to 51909 (keeping 200 days of data) [2025-10-21T19:08:48.155821] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-21T19:08:48.425462] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T19:08:48.436171] [DEBUG] [LOCAL ] HDB: Primary data saved (51909 records). [2025-10-21T19:08:48.436573] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-21T19:08:48.436701] [INFO ] [MAIN ] Update Progress: 1002/2366 symbols completed. HDB took 35.0s. Estimated remaining: 2h 55m 15s. Rate: 7.8 symbols/min [2025-10-21T19:08:48.480130] [INFO ] [REMOTE ] HE: Full fetch complete (72115 records). [2025-10-21T19:08:48.512370] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-21T19:08:48.708664] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:08:48.797357] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-21T19:08:48.952080] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-21T19:08:49.046979] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-21T19:08:49.047090] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-21T19:08:49.048190] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-21T19:08:49.048276] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-21T19:08:49.049849] [DEBUG] [LOCAL ] HESM: Loaded 48651 existing records from primary storage. [2025-10-21T19:08:49.050363] [INFO ] [MAIN ] HESM: Loaded 48651 existing records. [2025-10-21T19:08:49.135114] [DEBUG] [LOCAL ] HE: Trimmed 72115 records to 48826 (keeping 200 days of data) [2025-10-21T19:08:49.382748] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:08:49.390046] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-21T19:08:49.393030] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-21T19:08:49.415055] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-21T19:08:49.418816] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-21T19:08:49.762585] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-21T19:08:49.785459] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-21T19:08:50.091974] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:08:50.181419] [DEBUG] [LOCAL ] HE: Primary data saved (48826 records). [2025-10-21T19:08:50.181596] [INFO ] [MAIN ] HE: Full history saved. [2025-10-21T19:08:50.181750] [INFO ] [MAIN ] Update Progress: 1003/2366 symbols completed. HE took 36.7s. Estimated remaining: 2h 54m 59s. Rate: 7.8 symbols/min [2025-10-21T19:08:50.424381] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:08:50.424569] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-21T19:08:50.424605] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-21T19:08:50.424932] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-21T19:08:50.424974] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-21T19:08:50.425014] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-21T19:08:50.425044] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-21T19:08:50.556119] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-21T19:08:50.796044] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:08:51.323259] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T19:08:51.351047] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-21T19:08:51.670173] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-21T19:08:51.970003] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-21T19:08:52.150995] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-21T19:08:52.911517] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-21T19:08:52.951008] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-21T19:08:53.751024] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-21T19:08:53.853256] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T19:08:53.855690] [INFO ] [REMOTE ] HEQ: Full fetch complete (9535 records). [2025-10-21T19:08:53.855770] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-21T19:08:54.243349] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-21T19:08:54.243440] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-21T19:08:54.243747] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-21T19:08:54.243807] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-21T19:08:54.244218] [DEBUG] [LOCAL ] HEQ: Trimmed 9535 records to 6795 (keeping 200 days of data) [2025-10-21T19:08:54.286208] [DEBUG] [LOCAL ] HEQ: Primary data saved (6795 records). [2025-10-21T19:08:54.286341] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-21T19:08:54.286419] [INFO ] [MAIN ] Update Progress: 1004/2366 symbols completed. HEQ took 14.6s. Estimated remaining: 2h 54m 47s. Rate: 7.8 symbols/min [2025-10-21T19:08:54.463299] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:08:54.463529] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-21T19:08:54.463632] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-21T19:08:54.463883] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-21T19:08:54.463994] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-21T19:08:54.464116] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-21T19:08:54.464226] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-21T19:08:54.560905] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-21T19:08:54.871966] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-21T19:08:54.875757] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:08:54.885154] [INFO ] [REMOTE ] HD: Full fetch complete (77558 records). [2025-10-21T19:08:54.885300] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-21T19:08:54.956865] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-21T19:08:55.274693] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-21T19:08:55.274818] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-21T19:08:55.275797] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-21T19:08:55.275859] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-21T19:08:55.277318] [DEBUG] [LOCAL ] HD: Trimmed 77558 records to 53476 (keeping 200 days of data) [2025-10-21T19:08:55.366987] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-21T19:08:55.611201] [DEBUG] [LOCAL ] HD: Primary data saved (53476 records). [2025-10-21T19:08:55.611350] [INFO ] [MAIN ] HD: Full history saved. [2025-10-21T19:08:55.612176] [INFO ] [MAIN ] Update Progress: 1005/2366 symbols completed. HD took 42.1s. Estimated remaining: 2h 54m 30s. Rate: 7.8 symbols/min [2025-10-21T19:08:55.779279] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:08:55.797602] [DEBUG] [LOCAL ] HFRO: Loaded 16506 existing records from primary storage. [2025-10-21T19:08:55.797873] [INFO ] [MAIN ] HFRO: Loaded 16506 existing records. [2025-10-21T19:08:55.972282] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:08:55.972484] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-21T19:08:55.972531] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-21T19:08:55.972729] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-21T19:08:55.972785] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-21T19:08:56.157363] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-21T19:08:56.339176] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:08:56.924206] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-21T19:08:56.951175] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T19:08:56.951394] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-21T19:08:57.244716] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-21T19:08:57.751060] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-21T19:08:58.551022] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-21T19:08:59.351031] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-21T19:08:59.412239] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T19:08:59.664317] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-21T19:08:59.821967] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-21T19:09:00.151120] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-21T19:09:00.720153] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-21T19:09:00.951072] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-21T19:09:01.522720] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-21T19:09:01.751115] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-21T19:09:02.551047] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-21T19:09:03.351053] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-21T19:09:03.397420] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T19:09:03.625710] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T19:09:03.708430] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-21T19:09:04.151083] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-21T19:09:04.951023] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-21T19:09:05.751041] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-21T19:09:05.803005] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T19:09:06.067090] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T19:09:06.224316] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-21T19:09:06.551054] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-21T19:09:06.945979] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-21T19:09:07.351023] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-21T19:09:08.151076] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-21T19:09:08.948303] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T19:09:08.957595] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-21T19:09:09.300418] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-21T19:09:09.312436] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T19:09:09.751088] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-21T19:09:10.557094] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-21T19:09:10.558725] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T19:09:10.981956] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-21T19:09:11.351017] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-21T19:09:11.595585] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-21T19:09:12.151086] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-21T19:09:12.390678] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-21T19:09:12.951074] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-21T19:09:13.355121] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-21T19:09:13.751025] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-21T19:09:14.550999] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-21T19:09:14.695568] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-21T19:09:15.351046] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-21T19:09:16.148571] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T19:09:16.157694] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-21T19:09:16.332201] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-21T19:09:16.416752] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-21T19:09:16.951023] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-21T19:09:17.184634] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-21T19:09:17.751032] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-21T19:09:18.551076] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-21T19:09:18.903392] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-21T19:09:18.904072] [INFO ] [REMOTE ] HF: Full fetch complete (416 records). [2025-10-21T19:09:18.904172] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-21T19:09:19.080162] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-21T19:09:19.080321] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:09:19.080366] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:09:19.080429] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-21T19:09:19.080489] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-21T19:09:19.080524] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-21T19:09:19.080563] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-21T19:09:19.080617] [INFO ] [MAIN ] Update Progress: 1006/2366 symbols completed. HF took 28.9s. Estimated remaining: 2h 54m 44s. Rate: 7.8 symbols/min [2025-10-21T19:09:19.251131] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:09:19.267489] [DEBUG] [LOCAL ] HGER: Loaded 15250 existing records from primary storage. [2025-10-21T19:09:19.267753] [INFO ] [MAIN ] HGER: Loaded 15250 existing records. [2025-10-21T19:09:19.356455] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-21T19:09:19.456939] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:09:19.457248] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-21T19:09:19.457321] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-21T19:09:19.457553] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-21T19:09:19.457612] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-21T19:09:19.669026] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-21T19:09:19.755352] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-21T19:09:19.875340] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:09:20.151034] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-21T19:09:20.951043] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-21T19:09:20.967126] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T19:09:20.968010] [INFO ] [REMOTE ] HFND: Full fetch complete (1759 records). [2025-10-21T19:09:20.968080] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-21T19:09:21.148637] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-21T19:09:21.148855] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:09:21.148945] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:09:21.149039] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-21T19:09:21.149140] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-21T19:09:21.149199] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-21T19:09:21.149251] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-21T19:09:21.149319] [INFO ] [MAIN ] Update Progress: 1007/2366 symbols completed. HFND took 26.9s. Estimated remaining: 2h 54m 29s. Rate: 7.8 symbols/min [2025-10-21T19:09:21.318600] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:09:21.329104] [DEBUG] [LOCAL ] HGLB: Loaded 9696 existing records from primary storage. [2025-10-21T19:09:21.329280] [INFO ] [MAIN ] HGLB: Loaded 9696 existing records. [2025-10-21T19:09:21.514499] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:09:21.514782] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-21T19:09:21.514840] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-21T19:09:21.514993] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-21T19:09:21.515049] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-21T19:09:21.756263] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-21T19:09:21.895862] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:09:22.551035] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-21T19:09:22.568090] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-21T19:09:22.648147] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T19:09:23.288113] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-21T19:09:23.351051] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-21T19:09:23.953952] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-21T19:09:24.151028] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-21T19:09:24.884512] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T19:09:24.951005] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-21T19:09:25.750994] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-21T19:09:25.788303] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-21T19:09:26.499172] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-21T19:09:26.551039] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-21T19:09:27.332223] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T19:09:27.351008] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-21T19:09:28.151017] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-21T19:09:28.161336] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T19:09:28.943822] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-21T19:09:28.950980] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-21T19:09:29.751004] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-21T19:09:29.804613] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-21T19:09:30.551010] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-21T19:09:30.730991] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-21T19:09:31.351033] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-21T19:09:32.151005] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-21T19:09:32.306265] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-21T19:09:32.414561] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-21T19:09:32.780596] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-21T19:09:32.951019] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-21T19:09:33.751032] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-21T19:09:34.551006] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-21T19:09:34.802373] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-21T19:09:34.821807] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T19:09:34.821997] [INFO ] [REMOTE ] HESM: Full fetch complete (69766 records). [2025-10-21T19:09:34.826715] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-21T19:09:34.998526] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-21T19:09:35.261391] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-21T19:09:35.261488] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-21T19:09:35.262471] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-21T19:09:35.262536] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-21T19:09:35.263913] [DEBUG] [LOCAL ] HESM: Trimmed 69766 records to 48621 (keeping 200 days of data) [2025-10-21T19:09:35.351383] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-21T19:09:35.552572] [DEBUG] [LOCAL ] HESM: Primary data saved (48621 records). [2025-10-21T19:09:35.552834] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-21T19:09:35.553377] [INFO ] [MAIN ] Update Progress: 1008/2366 symbols completed. HESM took 47.1s. Estimated remaining: 2h 54m 30s. Rate: 7.8 symbols/min [2025-10-21T19:09:35.722696] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:09:35.738525] [DEBUG] [LOCAL ] HGTY: Loaded 13382 existing records from primary storage. [2025-10-21T19:09:35.738811] [INFO ] [MAIN ] HGTY: Loaded 13382 existing records. [2025-10-21T19:09:35.956712] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:09:35.956913] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-21T19:09:35.956960] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-21T19:09:35.957171] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-21T19:09:35.957227] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-21T19:09:36.160021] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-21T19:09:36.311167] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:09:36.543680] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T19:09:36.951083] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-21T19:09:37.240312] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T19:09:37.242764] [INFO ] [REMOTE ] HFRO: Full fetch complete (27122 records). [2025-10-21T19:09:37.242837] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-21T19:09:37.610784] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-21T19:09:37.610860] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-21T19:09:37.611381] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-21T19:09:37.611420] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-21T19:09:37.612052] [DEBUG] [LOCAL ] HFRO: Trimmed 27122 records to 16466 (keeping 200 days of data) [2025-10-21T19:09:37.707239] [DEBUG] [LOCAL ] HFRO: Primary data saved (16466 records). [2025-10-21T19:09:37.707363] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-21T19:09:37.707438] [INFO ] [MAIN ] Update Progress: 1009/2366 symbols completed. HFRO took 42.1s. Estimated remaining: 2h 54m 15s. Rate: 7.8 symbols/min [2025-10-21T19:09:37.776064] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-21T19:09:37.885610] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:09:37.898333] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-21T19:09:37.903068] [INFO ] [REMOTE ] HGER: Full fetch complete (18867 records). [2025-10-21T19:09:37.903155] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-21T19:09:38.215801] [DEBUG] [LOCAL ] HGV: Loaded 46172 existing records from primary storage. [2025-10-21T19:09:38.226777] [INFO ] [MAIN ] HGV: Loaded 46172 existing records. [2025-10-21T19:09:38.400266] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-21T19:09:38.405758] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-21T19:09:38.411335] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-21T19:09:38.416535] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-21T19:09:38.480212] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:09:38.480541] [DEBUG] [LOCAL ] HGER: Trimmed 18867 records to 15479 (keeping 200 days of data) [2025-10-21T19:09:38.480777] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-21T19:09:38.480846] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-21T19:09:38.481352] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-21T19:09:38.481419] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-21T19:09:38.557950] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-21T19:09:38.674665] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T19:09:38.721245] [DEBUG] [LOCAL ] HGER: Primary data saved (15479 records). [2025-10-21T19:09:38.744592] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-21T19:09:38.780237] [INFO ] [MAIN ] Update Progress: 1010/2366 symbols completed. HGER took 19.7s. Estimated remaining: 2h 53m 58s. Rate: 7.8 symbols/min [2025-10-21T19:09:39.131132] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:09:39.138611] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:09:39.170412] [DEBUG] [LOCAL ] HHH: Loaded 33185 existing records from primary storage. [2025-10-21T19:09:39.170718] [INFO ] [MAIN ] HHH: Loaded 33185 existing records. [2025-10-21T19:09:39.345909] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:09:39.346266] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-21T19:09:39.346378] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-21T19:09:39.346795] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-21T19:09:39.346861] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-21T19:09:39.357913] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-21T19:09:39.456797] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-21T19:09:39.707834] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:09:40.133379] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T19:09:40.150970] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-21T19:09:40.937636] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-21T19:09:40.950974] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-21T19:09:41.751119] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T19:09:41.751178] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-21T19:09:42.551239] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-21T19:09:43.160304] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T19:09:43.178038] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-21T19:09:43.351099] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-21T19:09:44.151075] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-21T19:09:44.909690] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T19:09:44.951061] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-21T19:09:45.489743] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T19:09:45.685773] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-21T19:09:45.751036] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-21T19:09:46.536317] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-21T19:09:46.550989] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-21T19:09:47.351024] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-21T19:09:47.554220] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-21T19:09:48.151020] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-21T19:09:48.620268] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T19:09:48.898221] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-21T19:09:48.950991] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-21T19:09:49.735377] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-21T19:09:49.750979] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-21T19:09:50.507444] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-21T19:09:50.550989] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-21T19:09:51.351051] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-21T19:09:51.574866] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T19:09:51.577107] [INFO ] [REMOTE ] HGLB: Full fetch complete (14421 records). [2025-10-21T19:09:51.577177] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-21T19:09:51.948632] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-21T19:09:51.948773] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-21T19:09:51.949108] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-21T19:09:51.949148] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-21T19:09:51.949589] [DEBUG] [LOCAL ] HGLB: Trimmed 14421 records to 9704 (keeping 200 days of data) [2025-10-21T19:09:52.004349] [DEBUG] [LOCAL ] HGLB: Primary data saved (9704 records). [2025-10-21T19:09:52.004462] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-21T19:09:52.004536] [INFO ] [MAIN ] Update Progress: 1011/2366 symbols completed. HGLB took 30.9s. Estimated remaining: 2h 53m 58s. Rate: 7.8 symbols/min [2025-10-21T19:09:52.153154] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-21T19:09:52.172275] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:09:52.205995] [DEBUG] [LOCAL ] HI: Loaded 36061 existing records from primary storage. [2025-10-21T19:09:52.206271] [INFO ] [MAIN ] HI: Loaded 36061 existing records. [2025-10-21T19:09:52.379451] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:09:52.379690] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-21T19:09:52.379748] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-21T19:09:52.379996] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-21T19:09:52.380055] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-21T19:09:52.738037] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:09:52.956178] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-21T19:09:52.968179] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T19:09:53.447056] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T19:09:53.750988] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-21T19:09:53.994922] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T19:09:54.551088] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-21T19:09:54.920799] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T19:09:55.350996] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-21T19:09:55.481452] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T19:09:55.483958] [INFO ] [REMOTE ] HGTY: Full fetch complete (17549 records). [2025-10-21T19:09:55.484025] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-21T19:09:55.840840] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-21T19:09:55.840912] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-21T19:09:55.841259] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-21T19:09:55.841296] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-21T19:09:55.841836] [DEBUG] [LOCAL ] HGTY: Trimmed 17549 records to 13379 (keeping 200 days of data) [2025-10-21T19:09:55.915249] [DEBUG] [LOCAL ] HGTY: Primary data saved (13379 records). [2025-10-21T19:09:55.915372] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-21T19:09:55.915447] [INFO ] [MAIN ] Update Progress: 1012/2366 symbols completed. HGTY took 20.4s. Estimated remaining: 2h 53m 45s. Rate: 7.8 symbols/min [2025-10-21T19:09:56.084619] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:09:56.135213] [DEBUG] [LOCAL ] HIG: Loaded 51188 existing records from primary storage. [2025-10-21T19:09:56.135512] [INFO ] [MAIN ] HIG: Loaded 51188 existing records. [2025-10-21T19:09:56.156182] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-21T19:09:56.316528] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:09:56.316793] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-21T19:09:56.316840] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-21T19:09:56.317026] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-21T19:09:56.317064] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-21T19:09:56.692471] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:09:56.712270] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-21T19:09:56.951030] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-21T19:09:57.751021] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-21T19:09:57.829511] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T19:09:58.311294] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T19:09:58.551022] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-21T19:09:58.998973] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T19:09:59.351029] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-21T19:10:00.090811] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T19:10:00.151004] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-21T19:10:00.951009] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-21T19:10:01.209152] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T19:10:01.751090] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-21T19:10:01.970755] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T19:10:02.551045] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-21T19:10:02.643313] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T19:10:03.351045] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-21T19:10:03.750037] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-21T19:10:03.991757] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T19:10:04.151046] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-21T19:10:04.779484] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T19:10:04.951043] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-21T19:10:05.671840] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T19:10:05.750996] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-21T19:10:06.422031] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T19:10:06.551016] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-21T19:10:07.351067] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-21T19:10:07.497857] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-21T19:10:08.151121] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-21T19:10:08.230097] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T19:10:08.951050] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-21T19:10:09.009612] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T19:10:09.600697] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T19:10:09.751042] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-21T19:10:10.544085] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T19:10:10.553587] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-21T19:10:11.196193] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T19:10:11.351022] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-21T19:10:11.965884] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T19:10:12.151053] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-21T19:10:12.951056] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-21T19:10:12.983545] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T19:10:13.547475] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T19:10:13.552543] [INFO ] [REMOTE ] HHH: Full fetch complete (46097 records). [2025-10-21T19:10:13.552707] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-21T19:10:13.761264] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-21T19:10:13.941433] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-21T19:10:13.941513] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-21T19:10:13.942271] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-21T19:10:13.942334] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-21T19:10:13.943288] [DEBUG] [LOCAL ] HHH: Trimmed 46097 records to 33152 (keeping 200 days of data) [2025-10-21T19:10:14.139321] [DEBUG] [LOCAL ] HHH: Primary data saved (33152 records). [2025-10-21T19:10:14.139550] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-21T19:10:14.139634] [INFO ] [MAIN ] Update Progress: 1013/2366 symbols completed. HHH took 35.3s. Estimated remaining: 2h 53m 51s. Rate: 7.8 symbols/min [2025-10-21T19:10:14.311734] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:10:14.334012] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T19:10:14.369601] [DEBUG] [LOCAL ] HII: Loaded 33610 existing records from primary storage. [2025-10-21T19:10:14.369891] [INFO ] [MAIN ] HII: Loaded 33610 existing records. [2025-10-21T19:10:14.544798] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:10:14.545055] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-21T19:10:14.545100] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-21T19:10:14.545320] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-21T19:10:14.545375] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-21T19:10:14.556389] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-21T19:10:14.895483] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:10:15.351010] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-21T19:10:15.448980] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T19:10:15.455352] [INFO ] [REMOTE ] HGV: Full fetch complete (65929 records). [2025-10-21T19:10:15.455459] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-21T19:10:15.883265] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-21T19:10:15.883350] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-21T19:10:15.884213] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-21T19:10:15.884276] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-21T19:10:15.885834] [DEBUG] [LOCAL ] HGV: Trimmed 65929 records to 46110 (keeping 200 days of data) [2025-10-21T19:10:16.145008] [DEBUG] [LOCAL ] HGV: Primary data saved (46110 records). [2025-10-21T19:10:16.145130] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-21T19:10:16.145207] [INFO ] [MAIN ] Update Progress: 1014/2366 symbols completed. HGV took 38.4s. Estimated remaining: 2h 53m 36s. Rate: 7.8 symbols/min [2025-10-21T19:10:16.176632] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-21T19:10:16.320039] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:10:16.371124] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-21T19:10:16.371424] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-10-21T19:10:16.551379] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:10:16.551817] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-21T19:10:16.551894] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-21T19:10:16.552161] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-21T19:10:16.552376] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-21T19:10:16.704274] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-21T19:10:16.955581] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-21T19:10:16.961744] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:10:16.978722] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-21T19:10:16.985639] [INFO ] [REMOTE ] HI: Full fetch complete (51093 records). [2025-10-21T19:10:16.985782] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-21T19:10:17.392394] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-21T19:10:17.392527] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-21T19:10:17.393358] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-21T19:10:17.393519] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-21T19:10:17.394790] [DEBUG] [LOCAL ] HI: Trimmed 51093 records to 36113 (keeping 200 days of data) [2025-10-21T19:10:17.501479] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T19:10:17.642231] [DEBUG] [LOCAL ] HI: Primary data saved (36113 records). [2025-10-21T19:10:17.642381] [INFO ] [MAIN ] HI: Full history saved. [2025-10-21T19:10:17.642970] [INFO ] [MAIN ] Update Progress: 1015/2366 symbols completed. HI took 25.6s. Estimated remaining: 2h 53m 20s. Rate: 7.8 symbols/min [2025-10-21T19:10:17.751178] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-21T19:10:17.825235] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:10:17.849960] [DEBUG] [LOCAL ] HIO: Loaded 24124 existing records from primary storage. [2025-10-21T19:10:17.850256] [INFO ] [MAIN ] HIO: Loaded 24124 existing records. [2025-10-21T19:10:18.035426] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:10:18.035686] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-21T19:10:18.035743] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-21T19:10:18.035963] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-21T19:10:18.036019] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-21T19:10:18.421949] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:10:18.551055] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-21T19:10:18.806088] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-21T19:10:19.351114] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-21T19:10:19.703932] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-21T19:10:20.151039] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-21T19:10:20.872515] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T19:10:20.874115] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (3.12 seconds). [2025-10-21T19:10:20.950998] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-21T19:10:21.751077] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-21T19:10:21.828226] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T19:10:22.551029] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-21T19:10:22.664609] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T19:10:23.351029] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-21T19:10:24.152904] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-21T19:10:24.155665] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-21T19:10:24.267969] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-10-21T19:10:24.950997] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-21T19:10:25.288663] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T19:10:25.345854] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T19:10:25.751020] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-21T19:10:26.551028] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-21T19:10:27.351015] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-21T19:10:27.384163] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-21T19:10:27.442498] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T19:10:28.151014] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-21T19:10:28.271001] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T19:10:28.643672] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T19:10:28.951060] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-21T19:10:29.751029] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-21T19:10:30.422309] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-21T19:10:30.550997] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-21T19:10:30.589902] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-21T19:10:30.744536] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-21T19:10:31.351049] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-21T19:10:32.023250] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T19:10:32.151015] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-21T19:10:32.928877] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T19:10:32.951006] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-21T19:10:33.677021] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T19:10:33.751049] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-21T19:10:33.788662] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-21T19:10:33.796752] [INFO ] [REMOTE ] HIG: Full fetch complete (73667 records). [2025-10-21T19:10:33.796933] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-21T19:10:34.176252] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-21T19:10:34.176334] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-21T19:10:34.177239] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-21T19:10:34.177303] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-21T19:10:34.178690] [DEBUG] [LOCAL ] HIG: Trimmed 73667 records to 51173 (keeping 200 days of data) [2025-10-21T19:10:34.492461] [DEBUG] [LOCAL ] HIG: Primary data saved (51173 records). [2025-10-21T19:10:34.492591] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-21T19:10:34.493341] [INFO ] [MAIN ] Update Progress: 1016/2366 symbols completed. HIG took 38.6s. Estimated remaining: 2h 53m 25s. Rate: 7.8 symbols/min [2025-10-21T19:10:34.556125] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-21T19:10:34.662624] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:10:34.684309] [DEBUG] [LOCAL ] HIPO: Loaded 21623 existing records from primary storage. [2025-10-21T19:10:34.684546] [INFO ] [MAIN ] HIPO: Loaded 21623 existing records. [2025-10-21T19:10:34.867138] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:10:34.867345] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-21T19:10:34.867444] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-21T19:10:34.867723] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-21T19:10:34.867792] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-21T19:10:35.226061] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:10:35.351034] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-21T19:10:35.705339] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T19:10:36.151129] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-21T19:10:36.303150] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T19:10:36.595567] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-10-21T19:10:36.896053] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-21T19:10:36.951070] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-21T19:10:37.751028] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-21T19:10:38.551085] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-21T19:10:39.197077] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T19:10:39.315979] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-21T19:10:39.339463] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-21T19:10:39.350968] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-21T19:10:40.151069] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-21T19:10:40.560924] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T19:10:40.951019] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-21T19:10:41.164673] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-21T19:10:41.750997] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-21T19:10:42.168214] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-21T19:10:42.551083] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-21T19:10:43.351021] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-21T19:10:43.780275] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T19:10:43.785848] [INFO ] [REMOTE ] HIO: Full fetch complete (38025 records). [2025-10-21T19:10:43.785927] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-21T19:10:44.157356] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-21T19:10:44.159545] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-21T19:10:44.160559] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-21T19:10:44.161177] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-21T19:10:44.161241] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-21T19:10:44.162137] [DEBUG] [LOCAL ] HIO: Trimmed 38025 records to 24124 (keeping 200 days of data) [2025-10-21T19:10:44.296453] [DEBUG] [LOCAL ] HIO: Primary data saved (24124 records). [2025-10-21T19:10:44.296569] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-21T19:10:44.296793] [INFO ] [MAIN ] Update Progress: 1017/2366 symbols completed. HIO took 26.7s. Estimated remaining: 2h 53m 20s. Rate: 7.8 symbols/min [2025-10-21T19:10:44.463473] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:10:44.500680] [DEBUG] [LOCAL ] HIW: Loaded 44503 existing records from primary storage. [2025-10-21T19:10:44.500951] [INFO ] [MAIN ] HIW: Loaded 44503 existing records. [2025-10-21T19:10:44.684008] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:10:44.684287] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-21T19:10:44.684404] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-21T19:10:44.684689] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-21T19:10:44.684748] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-21T19:10:44.981459] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-21T19:10:45.026276] [INFO ] [REMOTE ] HII: Full fetch complete (52424 records). [2025-10-21T19:10:45.065893] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:10:45.042593] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-21T19:10:45.066480] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-21T19:10:45.322485] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (3.57 seconds). [2025-10-21T19:10:45.426183] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T19:10:45.521000] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-21T19:10:45.521068] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-21T19:10:45.521886] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-21T19:10:45.521950] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-21T19:10:45.522923] [DEBUG] [LOCAL ] HII: Trimmed 52424 records to 33494 (keeping 200 days of data) [2025-10-21T19:10:45.724181] [DEBUG] [LOCAL ] HII: Primary data saved (33494 records). [2025-10-21T19:10:45.724301] [INFO ] [MAIN ] HII: Full history saved. [2025-10-21T19:10:45.724382] [INFO ] [MAIN ] Update Progress: 1018/2366 symbols completed. HII took 31.6s. Estimated remaining: 2h 53m 4s. Rate: 7.8 symbols/min [2025-10-21T19:10:45.756125] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-21T19:10:45.900659] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:10:45.918588] [DEBUG] [LOCAL ] HIX: Loaded 20398 existing records from primary storage. [2025-10-21T19:10:45.918850] [INFO ] [MAIN ] HIX: Loaded 20398 existing records. [2025-10-21T19:10:46.096415] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:10:46.096730] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-21T19:10:46.096804] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-21T19:10:46.097009] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-21T19:10:46.097066] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-21T19:10:46.451886] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:10:46.563247] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-21T19:10:46.565430] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-21T19:10:46.973014] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-21T19:10:47.351058] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-21T19:10:48.151045] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-21T19:10:48.411490] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T19:10:48.924310] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-21T19:10:48.949052] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T19:10:48.953662] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-21T19:10:49.751050] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-21T19:10:50.034891] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-21T19:10:50.551051] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-21T19:10:50.853288] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T19:10:51.351035] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-21T19:10:52.151024] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-21T19:10:52.950997] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-21T19:10:53.053372] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T19:10:53.221498] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-21T19:10:53.522309] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.97 seconds). [2025-10-21T19:10:53.751027] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-21T19:10:54.515911] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T19:10:54.551077] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-21T19:10:54.809984] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-21T19:10:55.351029] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-21T19:10:56.113164] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T19:10:56.150980] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-21T19:10:56.436868] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-21T19:10:56.951032] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-21T19:10:57.751056] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-21T19:10:57.977630] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T19:10:58.061177] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T19:10:58.529079] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-21T19:10:58.550984] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-21T19:10:59.350980] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-21T19:10:59.590278] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T19:11:00.151023] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-21T19:11:00.950997] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-21T19:11:01.339871] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T19:11:01.751032] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-21T19:11:02.359129] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (3.01 seconds). [2025-10-21T19:11:02.369316] [INFO ] [REMOTE ] HIMS: Full fetch complete (77996 records). [2025-10-21T19:11:02.369475] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-21T19:11:02.553872] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-21T19:11:02.780761] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-21T19:11:02.780869] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-21T19:11:02.781881] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-21T19:11:02.781964] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-21T19:11:02.808835] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T19:11:02.807257] [DEBUG] [LOCAL ] HIMS: Trimmed 77996 records to 53817 (keeping 200 days of data) [2025-10-21T19:11:03.065312] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-21T19:11:03.165749] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-10-21T19:11:03.165910] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-21T19:11:03.166593] [INFO ] [MAIN ] Update Progress: 1019/2366 symbols completed. HIMS took 47.0s. Estimated remaining: 2h 53m 9s. Rate: 7.8 symbols/min [2025-10-21T19:11:03.334946] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:11:03.355942] [DEBUG] [LOCAL ] HKD: Loaded 18743 existing records from primary storage. [2025-10-21T19:11:03.355433] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-21T19:11:03.357022] [INFO ] [MAIN ] HKD: Loaded 18743 existing records. [2025-10-21T19:11:03.538630] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:11:03.538880] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-21T19:11:03.538951] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-21T19:11:03.539148] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-21T19:11:03.539204] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-21T19:11:03.673297] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-21T19:11:03.717047] [INFO ] [REMOTE ] HIPO: Full fetch complete (31045 records). [2025-10-21T19:11:03.741776] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-21T19:11:04.110244] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:11:04.156250] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-21T19:11:04.310722] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-21T19:11:04.310812] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-21T19:11:04.311488] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-21T19:11:04.311552] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-21T19:11:04.312354] [DEBUG] [LOCAL ] HIPO: Trimmed 31045 records to 21512 (keeping 200 days of data) [2025-10-21T19:11:04.434312] [DEBUG] [LOCAL ] HIPO: Primary data saved (21512 records). [2025-10-21T19:11:04.434434] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-21T19:11:04.434507] [INFO ] [MAIN ] Update Progress: 1020/2366 symbols completed. HIPO took 29.9s. Estimated remaining: 2h 52m 53s. Rate: 7.8 symbols/min [2025-10-21T19:11:04.602267] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:11:04.657005] [DEBUG] [LOCAL ] HL: Loaded 53676 existing records from primary storage. [2025-10-21T19:11:04.657310] [INFO ] [MAIN ] HL: Loaded 53676 existing records. [2025-10-21T19:11:04.832769] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:11:04.832986] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-21T19:11:04.833032] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-21T19:11:04.833211] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-21T19:11:04.833247] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-21T19:11:04.955331] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-21T19:11:05.210242] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:11:05.241775] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-21T19:11:05.373900] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T19:11:05.751051] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-21T19:11:06.057450] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-21T19:11:06.551094] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-21T19:11:07.242786] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T19:11:07.351050] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-21T19:11:07.831275] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T19:11:08.151057] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-21T19:11:08.421511] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T19:11:08.951091] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-21T19:11:09.751005] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-21T19:11:09.801084] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T19:11:10.151491] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T19:11:10.154691] [INFO ] [REMOTE ] HIX: Full fetch complete (29876 records). [2025-10-21T19:11:10.154761] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-21T19:11:10.516214] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-21T19:11:10.516283] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-21T19:11:10.516860] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-21T19:11:10.516924] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-21T19:11:10.517576] [DEBUG] [LOCAL ] HIX: Trimmed 29876 records to 20379 (keeping 200 days of data) [2025-10-21T19:11:10.566013] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-21T19:11:10.638182] [DEBUG] [LOCAL ] HIX: Primary data saved (20379 records). [2025-10-21T19:11:10.638411] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-21T19:11:10.638603] [INFO ] [MAIN ] Update Progress: 1021/2366 symbols completed. HIX took 24.9s. Estimated remaining: 2h 52m 43s. Rate: 7.8 symbols/min [2025-10-21T19:11:10.818203] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:11:10.832295] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T19:11:10.876964] [DEBUG] [LOCAL ] HLF: Loaded 48540 existing records from primary storage. [2025-10-21T19:11:10.877289] [INFO ] [MAIN ] HLF: Loaded 48540 existing records. [2025-10-21T19:11:11.049271] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:11:11.049443] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-21T19:11:11.049490] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-21T19:11:11.049841] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-21T19:11:11.049911] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-21T19:11:11.356331] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-21T19:11:11.395858] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:11:12.151024] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-21T19:11:12.544025] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-21T19:11:12.619971] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-21T19:11:12.951049] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-21T19:11:13.251871] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T19:11:13.751058] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-21T19:11:14.465550] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-21T19:11:14.509480] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T19:11:14.550985] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-21T19:11:15.351041] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-21T19:11:15.818637] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-21T19:11:16.151036] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-21T19:11:16.951016] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-21T19:11:17.297574] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-21T19:11:17.705706] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-21T19:11:17.712785] [INFO ] [REMOTE ] HIW: Full fetch complete (64853 records). [2025-10-21T19:11:17.712919] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-21T19:11:17.756346] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-21T19:11:18.107977] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-21T19:11:18.108078] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-21T19:11:18.109136] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-21T19:11:18.109228] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-21T19:11:18.110517] [DEBUG] [LOCAL ] HIW: Trimmed 64853 records to 44457 (keeping 200 days of data) [2025-10-21T19:11:18.218937] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-21T19:11:18.389974] [DEBUG] [LOCAL ] HIW: Primary data saved (44457 records). [2025-10-21T19:11:18.390097] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-21T19:11:18.390838] [INFO ] [MAIN ] Update Progress: 1022/2366 symbols completed. HIW took 34.1s. Estimated remaining: 2h 52m 35s. Rate: 7.8 symbols/min [2025-10-21T19:11:18.556177] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-21T19:11:18.558471] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:11:18.593952] [DEBUG] [LOCAL ] HLI: Loaded 30785 existing records from primary storage. [2025-10-21T19:11:18.594234] [INFO ] [MAIN ] HLI: Loaded 30785 existing records. [2025-10-21T19:11:18.767714] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:11:18.767975] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-21T19:11:18.768024] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-21T19:11:18.768209] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-21T19:11:18.768247] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-21T19:11:19.121442] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:11:19.351064] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-21T19:11:19.547106] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-21T19:11:19.791868] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-21T19:11:20.151012] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-21T19:11:20.608126] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-21T19:11:20.951023] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-21T19:11:21.168198] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T19:11:21.751032] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-21T19:11:22.449281] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T19:11:22.550985] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-21T19:11:23.351000] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-21T19:11:23.784203] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-21T19:11:24.160107] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-21T19:11:24.181044] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T19:11:24.711524] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-21T19:11:24.951016] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-21T19:11:25.475004] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T19:11:25.478739] [INFO ] [REMOTE ] HKD: Full fetch complete (27920 records). [2025-10-21T19:11:25.478822] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-21T19:11:25.760554] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-21T19:11:25.857722] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-21T19:11:25.857844] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-21T19:11:25.858430] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-21T19:11:25.858473] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-21T19:11:25.859255] [DEBUG] [LOCAL ] HKD: Trimmed 27920 records to 18717 (keeping 200 days of data) [2025-10-21T19:11:25.963588] [DEBUG] [LOCAL ] HKD: Primary data saved (18717 records). [2025-10-21T19:11:25.963744] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-21T19:11:25.963831] [INFO ] [MAIN ] Update Progress: 1023/2366 symbols completed. HKD took 22.8s. Estimated remaining: 2h 52m 27s. Rate: 7.8 symbols/min [2025-10-21T19:11:26.136895] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:11:26.166133] [DEBUG] [LOCAL ] HLIO: Loaded 28259 existing records from primary storage. [2025-10-21T19:11:26.166371] [INFO ] [MAIN ] HLIO: Loaded 28259 existing records. [2025-10-21T19:11:26.357465] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:11:26.357728] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-21T19:11:26.357794] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-21T19:11:26.358036] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-21T19:11:26.358095] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-21T19:11:26.561061] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-21T19:11:26.621578] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T19:11:26.767056] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:11:27.351056] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-21T19:11:27.914828] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-21T19:11:27.956522] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T19:11:28.151061] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-21T19:11:28.951068] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-21T19:11:29.090277] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T19:11:29.165343] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-21T19:11:29.751085] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-21T19:11:30.371720] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T19:11:30.551130] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-21T19:11:30.728858] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T19:11:31.351041] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-21T19:11:32.133797] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T19:11:32.150995] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-21T19:11:32.640707] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T19:11:32.951036] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-21T19:11:33.750993] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-21T19:11:33.856286] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T19:11:34.010116] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T19:11:34.551047] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-21T19:11:35.351024] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-21T19:11:35.561837] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T19:11:35.968469] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T19:11:36.113415] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-21T19:11:36.150982] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-21T19:11:36.951027] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-21T19:11:37.577223] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T19:11:37.751020] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-21T19:11:38.551016] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-21T19:11:39.046424] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-21T19:11:39.075745] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-21T19:11:39.351023] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-21T19:11:40.017227] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T19:11:40.092066] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T19:11:40.151029] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-21T19:11:40.951035] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-21T19:11:41.751000] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-21T19:11:42.017659] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T19:11:42.167759] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T19:11:42.551032] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-21T19:11:43.351020] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-21T19:11:43.405526] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T19:11:43.414252] [INFO ] [REMOTE ] HLF: Full fetch complete (70878 records). [2025-10-21T19:11:43.414406] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-21T19:11:43.804142] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-21T19:11:43.804231] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-21T19:11:43.805136] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-21T19:11:43.805203] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-21T19:11:43.806558] [DEBUG] [LOCAL ] HLF: Trimmed 70878 records to 48506 (keeping 200 days of data) [2025-10-21T19:11:44.074311] [DEBUG] [LOCAL ] HLF: Primary data saved (48506 records). [2025-10-21T19:11:44.074451] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-21T19:11:44.074531] [INFO ] [MAIN ] Update Progress: 1024/2366 symbols completed. HLF took 33.4s. Estimated remaining: 2h 52m 33s. Rate: 7.8 symbols/min [2025-10-21T19:11:44.156165] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-21T19:11:44.257130] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:11:44.289343] [DEBUG] [LOCAL ] HLLY: Loaded 33339 existing records from primary storage. [2025-10-21T19:11:44.289633] [INFO ] [MAIN ] HLLY: Loaded 33339 existing records. [2025-10-21T19:11:44.487207] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:11:44.487597] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-21T19:11:44.487702] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-21T19:11:44.488012] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-21T19:11:44.488081] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-21T19:11:44.843517] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T19:11:44.871039] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-21T19:11:44.871252] [INFO ] [REMOTE ] HLI: Full fetch complete (45374 records). [2025-10-21T19:11:44.915295] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-21T19:11:44.972399] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:11:44.968221] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-21T19:11:45.356475] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-21T19:11:45.356565] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-21T19:11:45.357399] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-21T19:11:45.357464] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-21T19:11:45.358573] [DEBUG] [LOCAL ] HLI: Trimmed 45374 records to 30693 (keeping 200 days of data) [2025-10-21T19:11:45.547476] [DEBUG] [LOCAL ] HLI: Primary data saved (30693 records). [2025-10-21T19:11:45.547626] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-21T19:11:45.548599] [INFO ] [MAIN ] Update Progress: 1025/2366 symbols completed. HLI took 27.2s. Estimated remaining: 2h 52m 17s. Rate: 7.8 symbols/min [2025-10-21T19:11:45.673164] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T19:11:45.756135] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-21T19:11:45.758243] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:11:45.809612] [DEBUG] [LOCAL ] HLN: Loaded 53136 existing records from primary storage. [2025-10-21T19:11:45.809967] [INFO ] [MAIN ] HLN: Loaded 53136 existing records. [2025-10-21T19:11:45.992297] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:11:45.992537] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-21T19:11:45.992591] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-21T19:11:45.992802] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-21T19:11:45.992859] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-21T19:11:46.361502] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:11:46.551077] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-21T19:11:46.915067] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-21T19:11:47.351006] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-21T19:11:47.387406] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-21T19:11:47.396400] [INFO ] [REMOTE ] HL: Full fetch complete (77825 records). [2025-10-21T19:11:47.396522] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-21T19:11:47.805968] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-21T19:11:47.806213] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-21T19:11:47.807347] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-21T19:11:47.807473] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-21T19:11:47.809327] [DEBUG] [LOCAL ] HL: Trimmed 77825 records to 53676 (keeping 200 days of data) [2025-10-21T19:11:47.926520] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T19:11:48.153759] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-21T19:11:48.159951] [DEBUG] [LOCAL ] HL: Primary data saved (53676 records). [2025-10-21T19:11:48.160868] [INFO ] [MAIN ] HL: Full history saved. [2025-10-21T19:11:48.160979] [INFO ] [MAIN ] Update Progress: 1026/2366 symbols completed. HL took 43.7s. Estimated remaining: 2h 52m 3s. Rate: 7.8 symbols/min [2025-10-21T19:11:48.335896] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:11:48.379923] [DEBUG] [LOCAL ] HLT: Loaded 50463 existing records from primary storage. [2025-10-21T19:11:48.380226] [INFO ] [MAIN ] HLT: Loaded 50463 existing records. [2025-10-21T19:11:48.563463] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:11:48.563726] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-21T19:11:48.563786] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-21T19:11:48.564052] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-21T19:11:48.564094] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-21T19:11:48.946931] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:11:48.957743] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-21T19:11:48.979898] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T19:11:49.060123] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-21T19:11:49.751039] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-21T19:11:50.551004] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-21T19:11:50.714581] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T19:11:50.960382] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T19:11:51.351026] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-21T19:11:51.911811] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-21T19:11:52.151050] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-21T19:11:52.951043] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-21T19:11:53.152518] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T19:11:53.362805] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-21T19:11:53.751044] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-21T19:11:54.551071] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-21T19:11:54.941635] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T19:11:55.351057] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-21T19:11:55.584182] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T19:11:55.744179] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T19:11:56.151073] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-21T19:11:56.607536] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T19:11:56.611948] [INFO ] [REMOTE ] HLIO: Full fetch complete (37099 records). [2025-10-21T19:11:56.612053] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-21T19:11:56.951725] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-21T19:11:56.984219] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-21T19:11:56.984301] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-21T19:11:56.985047] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-21T19:11:56.985110] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-21T19:11:56.985996] [DEBUG] [LOCAL ] HLIO: Trimmed 37099 records to 28169 (keeping 200 days of data) [2025-10-21T19:11:57.156538] [DEBUG] [LOCAL ] HLIO: Primary data saved (28169 records). [2025-10-21T19:11:57.156694] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-21T19:11:57.156789] [INFO ] [MAIN ] Update Progress: 1027/2366 symbols completed. HLIO took 31.2s. Estimated remaining: 2h 51m 57s. Rate: 7.8 symbols/min [2025-10-21T19:11:57.324133] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:11:57.365953] [DEBUG] [LOCAL ] HLX: Loaded 47458 existing records from primary storage. [2025-10-21T19:11:57.366312] [INFO ] [MAIN ] HLX: Loaded 47458 existing records. [2025-10-21T19:11:57.512540] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T19:11:57.576283] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:11:57.576868] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-21T19:11:57.576918] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-21T19:11:57.577097] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-21T19:11:57.577135] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-21T19:11:57.760870] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-21T19:11:57.927917] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:11:58.551047] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-21T19:11:59.118338] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-21T19:11:59.185195] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T19:11:59.351043] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-21T19:12:00.150993] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-21T19:12:00.190666] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T19:12:00.254571] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-21T19:12:00.950986] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-21T19:12:01.751074] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-21T19:12:01.825811] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T19:12:02.551050] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-21T19:12:02.848998] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-21T19:12:02.933139] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T19:12:03.351019] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-21T19:12:04.141571] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T19:12:04.150978] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-21T19:12:04.697520] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T19:12:04.951004] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-21T19:12:05.756130] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-21T19:12:05.771605] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T19:12:06.551015] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-21T19:12:06.707303] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T19:12:07.192116] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-21T19:12:07.350989] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-21T19:12:07.992675] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T19:12:08.151007] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-21T19:12:08.721746] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T19:12:08.951041] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-21T19:12:09.370685] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-21T19:12:09.751084] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-21T19:12:10.551016] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-21T19:12:10.860260] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-21T19:12:11.296948] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T19:12:11.351026] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-21T19:12:11.993600] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-21T19:12:11.998591] [INFO ] [REMOTE ] HLLY: Full fetch complete (45971 records). [2025-10-21T19:12:11.998700] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-21T19:12:12.168344] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-21T19:12:12.372416] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-21T19:12:12.372490] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-21T19:12:12.373205] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-21T19:12:12.373269] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-21T19:12:12.374183] [DEBUG] [LOCAL ] HLLY: Trimmed 45971 records to 33260 (keeping 200 days of data) [2025-10-21T19:12:12.559450] [DEBUG] [LOCAL ] HLLY: Primary data saved (33260 records). [2025-10-21T19:12:12.559635] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-21T19:12:12.559759] [INFO ] [MAIN ] Update Progress: 1028/2366 symbols completed. HLLY took 28.5s. Estimated remaining: 2h 51m 59s. Rate: 7.8 symbols/min [2025-10-21T19:12:12.730327] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:12:12.772687] [DEBUG] [LOCAL ] HMC: Loaded 46338 existing records from primary storage. [2025-10-21T19:12:12.773129] [INFO ] [MAIN ] HMC: Loaded 46338 existing records. [2025-10-21T19:12:12.901581] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T19:12:12.960893] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-21T19:12:12.990459] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:12:12.990689] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-21T19:12:12.990746] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-21T19:12:12.990950] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-21T19:12:12.991006] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-21T19:12:13.362388] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:12:13.743432] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T19:12:13.753748] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-21T19:12:14.551025] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-21T19:12:14.662756] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T19:12:15.351012] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-21T19:12:15.673596] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-21T19:12:16.151022] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-21T19:12:16.432106] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T19:12:16.950988] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-21T19:12:17.143694] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T19:12:17.751027] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-21T19:12:17.935217] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T19:12:18.378472] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T19:12:18.551009] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-21T19:12:19.065858] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T19:12:19.075588] [INFO ] [REMOTE ] HLN: Full fetch complete (77036 records). [2025-10-21T19:12:19.075804] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-21T19:12:19.360320] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-21T19:12:19.485030] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-21T19:12:19.485104] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-21T19:12:19.486051] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-21T19:12:19.486112] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-21T19:12:19.487794] [DEBUG] [LOCAL ] HLN: Trimmed 77036 records to 53131 (keeping 200 days of data) [2025-10-21T19:12:19.803328] [DEBUG] [LOCAL ] HLN: Primary data saved (53131 records). [2025-10-21T19:12:19.803457] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-21T19:12:19.804284] [INFO ] [MAIN ] Update Progress: 1029/2366 symbols completed. HLN took 34.3s. Estimated remaining: 2h 51m 51s. Rate: 7.8 symbols/min [2025-10-21T19:12:19.989070] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:12:20.017483] [DEBUG] [LOCAL ] HMN: Loaded 23459 existing records from primary storage. [2025-10-21T19:12:20.017846] [INFO ] [MAIN ] HMN: Loaded 23459 existing records. [2025-10-21T19:12:20.175207] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-21T19:12:20.206549] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:12:20.207002] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-21T19:12:20.207053] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-21T19:12:20.207425] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-21T19:12:20.207497] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-21T19:12:20.616603] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:12:20.625771] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-21T19:12:20.951001] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-21T19:12:21.133057] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-21T19:12:21.756189] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-21T19:12:21.775869] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-21T19:12:22.006035] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T19:12:22.551075] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-21T19:12:23.351005] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-21T19:12:23.543429] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T19:12:23.551916] [INFO ] [REMOTE ] HLT: Full fetch complete (73622 records). [2025-10-21T19:12:23.552050] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-21T19:12:23.919789] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-21T19:12:24.010735] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-21T19:12:24.010828] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-21T19:12:24.011863] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-21T19:12:24.011927] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-21T19:12:24.013283] [DEBUG] [LOCAL ] HLT: Trimmed 73622 records to 50463 (keeping 200 days of data) [2025-10-21T19:12:24.190424] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-21T19:12:24.324296] [DEBUG] [LOCAL ] HLT: Primary data saved (50463 records). [2025-10-21T19:12:24.324421] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-21T19:12:24.324497] [INFO ] [MAIN ] Update Progress: 1030/2366 symbols completed. HLT took 36.2s. Estimated remaining: 2h 51m 39s. Rate: 7.8 symbols/min [2025-10-21T19:12:24.488147] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-21T19:12:24.524936] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:12:24.575790] [DEBUG] [LOCAL ] HMY: Loaded 53166 existing records from primary storage. [2025-10-21T19:12:24.576105] [INFO ] [MAIN ] HMY: Loaded 53166 existing records. [2025-10-21T19:12:24.760583] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:12:24.760968] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-21T19:12:24.761019] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-21T19:12:24.761271] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-21T19:12:24.761327] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-21T19:12:24.956717] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-21T19:12:25.125990] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:12:25.751002] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-21T19:12:25.904045] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-21T19:12:26.550994] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-21T19:12:26.718234] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T19:12:26.771916] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-21T19:12:27.351029] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-21T19:12:28.151005] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-21T19:12:28.235149] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T19:12:28.242189] [INFO ] [REMOTE ] HLX: Full fetch complete (69029 records). [2025-10-21T19:12:28.242323] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-21T19:12:28.636374] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-21T19:12:28.636456] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-21T19:12:28.637369] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-21T19:12:28.637433] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-21T19:12:28.638771] [DEBUG] [LOCAL ] HLX: Trimmed 69029 records to 47394 (keeping 200 days of data) [2025-10-21T19:12:28.898807] [DEBUG] [LOCAL ] HLX: Primary data saved (47394 records). [2025-10-21T19:12:28.898934] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-21T19:12:28.899028] [INFO ] [MAIN ] Update Progress: 1031/2366 symbols completed. HLX took 31.7s. Estimated remaining: 2h 51m 27s. Rate: 7.8 symbols/min [2025-10-21T19:12:28.957744] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-21T19:12:29.084969] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:12:29.085107] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-21T19:12:29.085143] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-21T19:12:29.085248] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-21T19:12:29.085289] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-21T19:12:29.085329] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-21T19:12:29.085360] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-21T19:12:29.395093] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-21T19:12:29.522861] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:12:29.524347] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-21T19:12:29.751010] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-21T19:12:30.551061] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-21T19:12:30.632411] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T19:12:30.935535] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-21T19:12:31.351080] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-21T19:12:32.151112] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-10-21T19:12:32.350268] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T19:12:32.365214] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-10-21T19:12:32.365763] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:12:32.367233] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T19:12:32.367378] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-21T19:12:32.377639] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:12:32.378115] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-21T19:12:32.378183] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-21T19:12:32.378220] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-21T19:12:32.378259] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-21T19:12:32.378328] [INFO ] [MAIN ] Update Progress: 1032/2366 symbols completed. HNGE took 3.5s. Estimated remaining: 2h 51m 14s. Rate: 7.8 symbols/min [2025-10-21T19:12:32.565926] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:12:32.594697] [DEBUG] [LOCAL ] HNI: Loaded 29783 existing records from primary storage. [2025-10-21T19:12:32.594971] [INFO ] [MAIN ] HNI: Loaded 29783 existing records. [2025-10-21T19:12:32.774914] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:12:32.775223] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-21T19:12:32.775287] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-21T19:12:32.775607] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-21T19:12:32.775705] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-21T19:12:32.952153] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-21T19:12:33.063899] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T19:12:33.205083] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:12:33.751038] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-21T19:12:34.551042] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-21T19:12:34.793055] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T19:12:35.032308] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-21T19:12:35.351000] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-21T19:12:35.597023] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T19:12:36.151081] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-21T19:12:36.951012] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-21T19:12:37.140506] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T19:12:37.750991] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-21T19:12:38.038171] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T19:12:38.147337] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-21T19:12:38.549975] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-21T19:12:38.555771] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-21T19:12:39.351080] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-21T19:12:40.151110] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-21T19:12:40.328306] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T19:12:40.576315] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-21T19:12:40.951040] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-21T19:12:41.751005] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-21T19:12:42.131300] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T19:12:42.444243] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-21T19:12:42.509114] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T19:12:42.550984] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-21T19:12:43.351037] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-21T19:12:44.150998] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-21T19:12:44.276315] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T19:12:44.285355] [INFO ] [REMOTE ] HMC: Full fetch complete (68706 records). [2025-10-21T19:12:44.285511] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-21T19:12:44.687461] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-21T19:12:44.727823] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-21T19:12:44.728136] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-21T19:12:44.729219] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-21T19:12:44.729282] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-21T19:12:44.730424] [DEBUG] [LOCAL ] HMC: Trimmed 68706 records to 46311 (keeping 200 days of data) [2025-10-21T19:12:44.954873] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-21T19:12:44.991489] [DEBUG] [LOCAL ] HMC: Primary data saved (46311 records). [2025-10-21T19:12:44.991579] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-21T19:12:44.991671] [INFO ] [MAIN ] Update Progress: 1033/2366 symbols completed. HMC took 32.4s. Estimated remaining: 2h 51m 13s. Rate: 7.8 symbols/min [2025-10-21T19:12:45.162169] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:12:45.208912] [DEBUG] [LOCAL ] HOG: Loaded 50715 existing records from primary storage. [2025-10-21T19:12:45.209220] [INFO ] [MAIN ] HOG: Loaded 50715 existing records. [2025-10-21T19:12:45.384973] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:12:45.385196] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-21T19:12:45.385255] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-21T19:12:45.385471] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-21T19:12:45.385526] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-21T19:12:45.740384] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:12:45.750984] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-21T19:12:45.914422] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T19:12:45.972515] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T19:12:46.551038] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-21T19:12:47.351061] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-21T19:12:47.395739] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T19:12:47.420125] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T19:12:47.424848] [INFO ] [REMOTE ] HMN: Full fetch complete (31580 records). [2025-10-21T19:12:47.424940] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-21T19:12:47.791559] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-21T19:12:47.791637] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-21T19:12:47.792368] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-21T19:12:47.792415] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-21T19:12:47.793384] [DEBUG] [LOCAL ] HMN: Trimmed 31580 records to 23409 (keeping 200 days of data) [2025-10-21T19:12:47.933066] [DEBUG] [LOCAL ] HMN: Primary data saved (23409 records). [2025-10-21T19:12:47.933198] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-21T19:12:47.933276] [INFO ] [MAIN ] Update Progress: 1034/2366 symbols completed. HMN took 28.1s. Estimated remaining: 2h 50m 59s. Rate: 7.8 symbols/min [2025-10-21T19:12:48.100331] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:12:48.146801] [DEBUG] [LOCAL ] HOMB: Loaded 43754 existing records from primary storage. [2025-10-21T19:12:48.147105] [INFO ] [MAIN ] HOMB: Loaded 43754 existing records. [2025-10-21T19:12:48.152675] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-21T19:12:48.324358] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:12:48.324554] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-21T19:12:48.324599] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-21T19:12:48.324806] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-21T19:12:48.324859] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-21T19:12:48.671881] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:12:48.951025] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-21T19:12:49.440326] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T19:12:49.465424] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T19:12:49.751066] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-21T19:12:50.049708] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T19:12:50.551029] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-21T19:12:51.350997] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-21T19:12:51.452001] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T19:12:52.020635] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T19:12:52.151080] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-21T19:12:52.448447] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-21T19:12:52.951081] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-21T19:12:53.751099] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-21T19:12:53.885735] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T19:12:54.507675] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T19:12:54.551010] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-21T19:12:54.887304] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-21T19:12:55.351020] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-21T19:12:56.151028] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-21T19:12:56.268458] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T19:12:56.891190] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T19:12:56.951003] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-21T19:12:57.751037] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-21T19:12:58.146503] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T19:12:58.396749] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T19:12:58.551024] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-21T19:12:59.211448] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T19:12:59.351036] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-21T19:12:59.901530] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T19:12:59.906660] [INFO ] [REMOTE ] HNI: Full fetch complete (42102 records). [2025-10-21T19:12:59.906755] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-21T19:13:00.157240] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-21T19:13:00.283173] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-21T19:13:00.283249] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-21T19:13:00.283935] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-21T19:13:00.283996] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-21T19:13:00.284851] [DEBUG] [LOCAL ] HNI: Trimmed 42102 records to 29744 (keeping 200 days of data) [2025-10-21T19:13:00.458885] [DEBUG] [LOCAL ] HNI: Primary data saved (29744 records). [2025-10-21T19:13:00.459018] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-21T19:13:00.459095] [INFO ] [MAIN ] Update Progress: 1035/2366 symbols completed. HNI took 28.1s. Estimated remaining: 2h 50m 58s. Rate: 7.8 symbols/min [2025-10-21T19:13:00.628439] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:13:00.670060] [DEBUG] [LOCAL ] HOUS: Loaded 45656 existing records from primary storage. [2025-10-21T19:13:00.670384] [INFO ] [MAIN ] HOUS: Loaded 45656 existing records. [2025-10-21T19:13:00.847101] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:13:00.847288] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-21T19:13:00.847334] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-21T19:13:00.847507] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-21T19:13:00.847545] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-21T19:13:00.956337] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-21T19:13:01.206587] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:13:01.230100] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T19:13:01.751101] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-21T19:13:02.259196] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-21T19:13:02.551090] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-21T19:13:03.215570] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-21T19:13:03.279026] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T19:13:03.351025] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-21T19:13:04.151079] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-21T19:13:04.300549] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T19:13:04.951067] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-21T19:13:05.397576] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-21T19:13:05.405837] [INFO ] [REMOTE ] HMY: Full fetch complete (77104 records). [2025-10-21T19:13:05.405971] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-21T19:13:05.761107] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-21T19:13:05.804489] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-21T19:13:05.804716] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-21T19:13:05.805807] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-21T19:13:05.805912] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-21T19:13:05.807434] [DEBUG] [LOCAL ] HMY: Trimmed 77104 records to 53166 (keeping 200 days of data) [2025-10-21T19:13:05.965248] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T19:13:06.175486] [DEBUG] [LOCAL ] HMY: Primary data saved (53166 records). [2025-10-21T19:13:06.175616] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-21T19:13:06.175722] [INFO ] [MAIN ] Update Progress: 1036/2366 symbols completed. HMY took 41.9s. Estimated remaining: 2h 50m 47s. Rate: 7.8 symbols/min [2025-10-21T19:13:06.348378] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:13:06.364110] [DEBUG] [LOCAL ] HOV: Loaded 14023 existing records from primary storage. [2025-10-21T19:13:06.364327] [INFO ] [MAIN ] HOV: Loaded 14023 existing records. [2025-10-21T19:13:06.501847] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T19:13:06.573825] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-21T19:13:06.579215] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:13:06.580331] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-21T19:13:06.580426] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-21T19:13:06.580623] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-21T19:13:06.580700] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-21T19:13:06.930614] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:13:07.351000] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-21T19:13:07.433241] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T19:13:08.157347] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-21T19:13:08.161742] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T19:13:08.325582] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T19:13:08.950992] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-21T19:13:09.751052] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-21T19:13:09.835062] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T19:13:09.916752] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T19:13:10.551025] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-21T19:13:11.157925] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T19:13:11.350998] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-21T19:13:11.460150] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-21T19:13:12.151022] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-21T19:13:12.951058] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-21T19:13:13.049474] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T19:13:13.519425] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-21T19:13:13.760688] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-21T19:13:13.768669] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T19:13:14.551032] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-21T19:13:15.351009] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-21T19:13:15.409545] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-21T19:13:15.489667] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T19:13:16.151018] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-21T19:13:16.951078] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-21T19:13:17.001413] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T19:13:17.585462] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T19:13:17.593577] [INFO ] [REMOTE ] HOG: Full fetch complete (74299 records). [2025-10-21T19:13:17.593780] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-21T19:13:17.771890] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-21T19:13:18.009463] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-21T19:13:18.009595] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-21T19:13:18.010764] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-21T19:13:18.010858] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-21T19:13:18.027321] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-21T19:13:18.032974] [DEBUG] [LOCAL ] HOG: Trimmed 74299 records to 50674 (keeping 200 days of data) [2025-10-21T19:13:18.336933] [DEBUG] [LOCAL ] HOG: Primary data saved (50674 records). [2025-10-21T19:13:18.337069] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-21T19:13:18.337145] [INFO ] [MAIN ] Update Progress: 1037/2366 symbols completed. HOG took 33.3s. Estimated remaining: 2h 50m 45s. Rate: 7.8 symbols/min [2025-10-21T19:13:18.551082] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-21T19:13:19.351116] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-21T19:13:19.426996] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T19:13:20.152793] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T19:13:20.151601] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-21T19:13:20.160741] [INFO ] [REMOTE ] HOMB: Full fetch complete (64477 records). [2025-10-21T19:13:20.160832] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-21T19:13:20.492668] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-21T19:13:20.593476] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-21T19:13:20.593553] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-21T19:13:20.594486] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-21T19:13:20.594548] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-21T19:13:20.595845] [DEBUG] [LOCAL ] HOMB: Trimmed 64477 records to 43717 (keeping 200 days of data) [2025-10-21T19:13:20.849607] [DEBUG] [LOCAL ] HOMB: Primary data saved (43717 records). [2025-10-21T19:13:20.849756] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-21T19:13:20.850518] [INFO ] [MAIN ] Update Progress: 1038/2366 symbols completed. HOMB took 32.9s. Estimated remaining: 2h 50m 31s. Rate: 7.8 symbols/min [2025-10-21T19:13:20.950996] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-21T19:13:21.693042] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T19:13:21.750980] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-21T19:13:21.885346] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-21T19:13:22.551083] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-21T19:13:23.336537] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T19:13:23.350977] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-21T19:13:23.428580] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T19:13:24.151046] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-21T19:13:24.764090] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T19:13:24.951033] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-21T19:13:25.230200] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T19:13:25.232900] [INFO ] [REMOTE ] HOV: Full fetch complete (18951 records). [2025-10-21T19:13:25.232991] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-21T19:13:25.650633] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-21T19:13:25.650768] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-21T19:13:25.651367] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-21T19:13:25.651439] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-21T19:13:25.652138] [DEBUG] [LOCAL ] HOV: Trimmed 18951 records to 13930 (keeping 200 days of data) [2025-10-21T19:13:25.736044] [DEBUG] [LOCAL ] HOV: Primary data saved (13930 records). [2025-10-21T19:13:25.736180] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-21T19:13:25.736269] [INFO ] [MAIN ] Update Progress: 1039/2366 symbols completed. HOV took 19.6s. Estimated remaining: 2h 50m 20s. Rate: 7.8 symbols/min [2025-10-21T19:13:26.579484] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T19:13:26.590042] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-21T19:13:28.383465] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T19:13:28.392565] [INFO ] [REMOTE ] HOUS: Full fetch complete (64659 records). [2025-10-21T19:13:28.392776] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-21T19:13:28.808889] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-21T19:13:28.808976] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-21T19:13:28.809844] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-21T19:13:28.809907] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-21T19:13:28.812119] [DEBUG] [LOCAL ] HOUS: Trimmed 64659 records to 45708 (keeping 200 days of data) [2025-10-21T19:13:29.061194] [DEBUG] [LOCAL ] HOUS: Primary data saved (45708 records). [2025-10-21T19:13:29.061322] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-21T19:13:29.061402] [INFO ] [MAIN ] Update Progress: 1040/2366 symbols completed. HOUS took 28.6s. Estimated remaining: 2h 50m 6s. Rate: 7.8 symbols/min [2025-10-21T19:13:29.616498] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:13:29.735603] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:13:29.726446] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:13:29.820678] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:13:29.834484] [DEBUG] [LOCAL ] HPI: Loaded 10790 existing records from primary storage. [2025-10-21T19:13:29.834902] [INFO ] [MAIN ] HPI: Loaded 10790 existing records. [2025-10-21T19:13:29.904437] [DEBUG] [LOCAL ] HPF: Loaded 7516 existing records from primary storage. [2025-10-21T19:13:29.958268] [INFO ] [MAIN ] HPF: Loaded 7516 existing records. [2025-10-21T19:13:30.166320] [DEBUG] [LOCAL ] HP: Loaded 51484 existing records from primary storage. [2025-10-21T19:13:30.246374] [INFO ] [MAIN ] HP: Loaded 51484 existing records. [2025-10-21T19:13:30.264419] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-21T19:13:30.231735] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:13:30.303435] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-10-21T19:13:30.317388] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-21T19:13:30.312026] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:13:30.334275] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-21T19:13:30.370389] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-21T19:13:30.409666] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-21T19:13:30.450371] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-21T19:13:30.531504] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-21T19:13:30.576010] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-21T19:13:30.606390] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-21T19:13:30.934144] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:13:30.951910] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-21T19:13:30.961171] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-21T19:13:30.955824] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:13:31.021394] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-21T19:13:31.029152] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-21T19:13:31.026700] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-21T19:13:31.058850] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-21T19:13:31.122414] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-21T19:13:31.161623] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-21T19:13:31.750338] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:13:31.832344] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-21T19:13:32.084152] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:13:32.154355] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-21T19:13:32.182279] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:13:32.199638] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-21T19:13:32.269245] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:13:32.269559] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-21T19:13:32.632556] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-21T19:13:32.635669] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-21T19:13:32.726157] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-21T19:13:32.728628] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-21T19:13:33.352309] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-21T19:13:33.355535] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-21T19:13:33.366751] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-21T19:13:33.370126] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-21T19:13:33.633687] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-21T19:13:33.644987] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-21T19:13:33.758212] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T19:13:33.771733] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-21T19:13:33.965679] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-21T19:13:34.080760] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T19:13:34.551034] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-21T19:13:35.051285] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-21T19:13:35.351065] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-21T19:13:35.380358] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T19:13:35.522125] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T19:13:36.138153] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T19:13:36.150978] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-21T19:13:36.870991] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T19:13:36.951063] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-21T19:13:37.751083] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-21T19:13:38.458997] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-21T19:13:38.558040] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-21T19:13:38.564344] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T19:13:39.318939] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-21T19:13:39.351055] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-21T19:13:40.151040] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-21T19:13:40.951011] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-21T19:13:40.973265] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T19:13:41.116375] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T19:13:41.677063] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T19:13:41.751051] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-21T19:13:42.551069] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-21T19:13:43.345732] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-21T19:13:43.350973] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-21T19:13:43.453171] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T19:13:44.151103] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-21T19:13:44.951090] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-21T19:13:45.099103] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-21T19:13:45.492335] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-21T19:13:45.704924] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-21T19:13:45.750981] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-21T19:13:46.520436] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T19:13:46.550984] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-21T19:13:47.351013] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-21T19:13:48.150996] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-21T19:13:48.319997] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-21T19:13:48.321812] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T19:13:48.334764] [INFO ] [REMOTE ] HPI: Full fetch complete (13867 records). [2025-10-21T19:13:48.335198] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-21T19:13:48.710998] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-21T19:13:48.711075] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-21T19:13:48.711383] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-21T19:13:48.711420] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-21T19:13:48.711899] [DEBUG] [LOCAL ] HPI: Trimmed 13867 records to 10779 (keeping 200 days of data) [2025-10-21T19:13:48.778854] [DEBUG] [LOCAL ] HPI: Primary data saved (10779 records). [2025-10-21T19:13:48.778978] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-21T19:13:48.779055] [INFO ] [MAIN ] Update Progress: 1041/2366 symbols completed. HPI took 19.7s. Estimated remaining: 2h 50m 14s. Rate: 7.8 symbols/min [2025-10-21T19:13:48.930935] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-21T19:13:48.963315] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-21T19:13:48.967609] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:13:49.020058] [DEBUG] [LOCAL ] HPP: Loaded 51262 existing records from primary storage. [2025-10-21T19:13:49.020392] [INFO ] [MAIN ] HPP: Loaded 51262 existing records. [2025-10-21T19:13:49.197534] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:13:49.197757] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-21T19:13:49.197821] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-21T19:13:49.198038] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-21T19:13:49.198077] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-21T19:13:49.546150] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:13:49.749322] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T19:13:49.751152] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-21T19:13:49.751933] [INFO ] [REMOTE ] HPF: Full fetch complete (10564 records). [2025-10-21T19:13:49.752830] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-21T19:13:50.132613] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-21T19:13:50.132764] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-21T19:13:50.133163] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-21T19:13:50.133206] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-21T19:13:50.133735] [DEBUG] [LOCAL ] HPF: Trimmed 10564 records to 7532 (keeping 200 days of data) [2025-10-21T19:13:50.182266] [DEBUG] [LOCAL ] HPF: Primary data saved (7532 records). [2025-10-21T19:13:50.182449] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-21T19:13:50.182550] [INFO ] [MAIN ] Update Progress: 1042/2366 symbols completed. HPF took 21.1s. Estimated remaining: 2h 49m 58s. Rate: 7.8 symbols/min [2025-10-21T19:13:50.355058] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:13:50.415118] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-10-21T19:13:50.415638] [INFO ] [MAIN ] HPQ: Loaded 53669 existing records. [2025-10-21T19:13:50.562006] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-21T19:13:50.613679] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:13:50.614144] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-21T19:13:50.614232] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-21T19:13:50.614505] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-21T19:13:50.614563] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-21T19:13:51.017093] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:13:51.360445] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-21T19:13:51.365826] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T19:13:52.150995] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-21T19:13:52.352306] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T19:13:52.951017] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-21T19:13:53.468930] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-21T19:13:53.669307] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T19:13:53.751021] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-21T19:13:54.469562] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T19:13:54.551004] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-21T19:13:55.354890] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-21T19:13:55.360214] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T19:13:56.151001] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-21T19:13:56.236090] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T19:13:56.951041] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-21T19:13:57.235216] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T19:13:57.751047] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-21T19:13:58.175920] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-21T19:13:58.319135] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T19:13:58.326719] [INFO ] [REMOTE ] HP: Full fetch complete (74039 records). [2025-10-21T19:13:58.326866] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-21T19:13:58.556240] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-21T19:13:58.726076] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-21T19:13:58.726152] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-21T19:13:58.727098] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-21T19:13:58.727162] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-21T19:13:58.728529] [DEBUG] [LOCAL ] HP: Trimmed 74039 records to 51425 (keeping 200 days of data) [2025-10-21T19:13:59.033915] [DEBUG] [LOCAL ] HP: Primary data saved (51425 records). [2025-10-21T19:13:59.034035] [INFO ] [MAIN ] HP: Full history saved. [2025-10-21T19:13:59.034111] [INFO ] [MAIN ] Update Progress: 1043/2366 symbols completed. HP took 30.0s. Estimated remaining: 2h 49m 52s. Rate: 7.8 symbols/min [2025-10-21T19:13:59.220511] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:13:59.233316] [DEBUG] [LOCAL ] HPS: Loaded 10377 existing records from primary storage. [2025-10-21T19:13:59.233539] [INFO ] [MAIN ] HPS: Loaded 10377 existing records. [2025-10-21T19:13:59.356140] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-21T19:13:59.415270] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:13:59.415617] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-21T19:13:59.415716] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-21T19:13:59.416018] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-21T19:13:59.416086] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-21T19:13:59.670113] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-21T19:13:59.820506] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:14:00.151015] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-21T19:14:00.588222] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T19:14:00.685880] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T19:14:00.697589] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-21T19:14:00.951015] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-21T19:14:01.751089] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-21T19:14:02.551038] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-21T19:14:02.630492] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T19:14:03.351035] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-21T19:14:03.384015] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-21T19:14:03.834924] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-21T19:14:04.151042] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-21T19:14:04.951006] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-21T19:14:05.052370] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T19:14:05.751065] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-21T19:14:06.260563] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-21T19:14:06.368746] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T19:14:06.551020] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-21T19:14:07.347476] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T19:14:07.357704] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-21T19:14:08.151039] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-21T19:14:08.221106] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T19:14:08.951076] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-21T19:14:09.062233] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-21T19:14:09.455150] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-21T19:14:09.751048] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-21T19:14:10.551079] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-21T19:14:10.855974] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-21T19:14:11.038610] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T19:14:11.351025] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-21T19:14:12.151009] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-21T19:14:12.573438] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-21T19:14:12.927405] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-21T19:14:12.950980] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-21T19:14:13.401224] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-21T19:14:13.750999] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-21T19:14:13.770221] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T19:14:14.551085] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-21T19:14:15.285987] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-21T19:14:15.350988] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-21T19:14:15.927972] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-21T19:14:15.936374] [INFO ] [REMOTE ] HPE: Full fetch complete (77876 records). [2025-10-21T19:14:15.936533] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-21T19:14:16.160430] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-21T19:14:16.344487] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-21T19:14:16.344563] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-21T19:14:16.345527] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-21T19:14:16.345588] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-21T19:14:16.346937] [DEBUG] [LOCAL ] HPE: Trimmed 77876 records to 53697 (keeping 200 days of data) [2025-10-21T19:14:16.464363] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T19:14:16.692835] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-10-21T19:14:16.692962] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-21T19:14:16.693037] [INFO ] [MAIN ] Update Progress: 1044/2366 symbols completed. HPE took 47.6s. Estimated remaining: 2h 49m 57s. Rate: 7.8 symbols/min [2025-10-21T19:14:16.859298] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:14:16.885934] [DEBUG] [LOCAL ] HQH: Loaded 25838 existing records from primary storage. [2025-10-21T19:14:16.886226] [INFO ] [MAIN ] HQH: Loaded 25838 existing records. [2025-10-21T19:14:16.959380] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-21T19:14:17.063179] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:14:17.063390] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-21T19:14:17.063452] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-21T19:14:17.063716] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-21T19:14:17.063773] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-21T19:14:17.417227] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:14:17.617369] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T19:14:17.751046] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-21T19:14:18.551030] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-21T19:14:18.854733] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T19:14:18.999862] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T19:14:19.351070] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-21T19:14:20.019867] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T19:14:20.027757] [INFO ] [REMOTE ] HPP: Full fetch complete (73367 records). [2025-10-21T19:14:20.027939] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-21T19:14:20.156152] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-21T19:14:20.415925] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-21T19:14:20.415999] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-21T19:14:20.416914] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-21T19:14:20.416978] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-21T19:14:20.418395] [DEBUG] [LOCAL ] HPP: Trimmed 73367 records to 51238 (keeping 200 days of data) [2025-10-21T19:14:20.694274] [DEBUG] [LOCAL ] HPP: Primary data saved (51238 records). [2025-10-21T19:14:20.694403] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-21T19:14:20.695139] [INFO ] [MAIN ] Update Progress: 1045/2366 symbols completed. HPP took 31.9s. Estimated remaining: 2h 49m 45s. Rate: 7.8 symbols/min [2025-10-21T19:14:20.864145] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:14:20.887251] [DEBUG] [LOCAL ] HQL: Loaded 16958 existing records from primary storage. [2025-10-21T19:14:20.887525] [INFO ] [MAIN ] HQL: Loaded 16958 existing records. [2025-10-21T19:14:20.956151] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-21T19:14:21.073157] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:14:21.073417] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-21T19:14:21.073556] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-21T19:14:21.073827] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-21T19:14:21.073883] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-21T19:14:21.381619] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-21T19:14:21.502993] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:14:21.522888] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T19:14:21.751032] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-21T19:14:21.852172] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-21T19:14:22.550993] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-21T19:14:22.860049] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-21T19:14:23.031167] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-21T19:14:23.351037] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-21T19:14:24.150998] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-21T19:14:24.322890] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T19:14:24.951057] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-21T19:14:24.985960] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T19:14:24.988007] [INFO ] [REMOTE ] HPS: Full fetch complete (15110 records). [2025-10-21T19:14:24.988074] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-21T19:14:25.376295] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-21T19:14:25.376370] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-21T19:14:25.376718] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-21T19:14:25.376778] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-21T19:14:25.377241] [DEBUG] [LOCAL ] HPS: Trimmed 15110 records to 10360 (keeping 200 days of data) [2025-10-21T19:14:25.438474] [DEBUG] [LOCAL ] HPS: Primary data saved (10360 records). [2025-10-21T19:14:25.438589] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-21T19:14:25.438688] [INFO ] [MAIN ] Update Progress: 1046/2366 symbols completed. HPS took 26.4s. Estimated remaining: 2h 49m 33s. Rate: 7.8 symbols/min [2025-10-21T19:14:25.606295] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:14:25.655629] [DEBUG] [LOCAL ] HR: Loaded 52115 existing records from primary storage. [2025-10-21T19:14:25.655969] [INFO ] [MAIN ] HR: Loaded 52115 existing records. [2025-10-21T19:14:25.754409] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-21T19:14:25.845630] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:14:25.846002] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-21T19:14:25.846203] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-21T19:14:25.846474] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-21T19:14:25.846543] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-21T19:14:26.064202] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T19:14:26.112318] [INFO ] [REMOTE ] HPQ: Full fetch complete (77842 records). [2025-10-21T19:14:26.123213] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-21T19:14:26.568754] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-21T19:14:26.774586] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:14:26.941820] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T19:14:26.989037] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-21T19:14:26.989138] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-21T19:14:26.990205] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-21T19:14:26.990280] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-21T19:14:26.991852] [DEBUG] [LOCAL ] HPQ: Trimmed 77842 records to 53669 (keeping 200 days of data) [2025-10-21T19:14:27.322852] [DEBUG] [LOCAL ] HPQ: Primary data saved (53669 records). [2025-10-21T19:14:27.323018] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-21T19:14:27.323482] [INFO ] [MAIN ] Update Progress: 1047/2366 symbols completed. HPQ took 37.1s. Estimated remaining: 2h 49m 18s. Rate: 7.8 symbols/min [2025-10-21T19:14:27.356142] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-21T19:14:27.500621] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:14:27.547259] [DEBUG] [LOCAL ] HRB: Loaded 48355 existing records from primary storage. [2025-10-21T19:14:27.547570] [INFO ] [MAIN ] HRB: Loaded 48355 existing records. [2025-10-21T19:14:27.730925] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T19:14:27.772502] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:14:27.772740] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-21T19:14:27.772793] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-21T19:14:27.772977] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-21T19:14:27.773015] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-21T19:14:28.114006] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:14:28.150986] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-21T19:14:28.951040] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-21T19:14:29.131847] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T19:14:29.706095] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T19:14:29.751064] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-21T19:14:30.255460] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-21T19:14:30.551004] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-21T19:14:31.356214] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-21T19:14:31.374916] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T19:14:31.538861] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T19:14:32.151015] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-21T19:14:32.509454] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T19:14:32.951046] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-21T19:14:33.726197] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T19:14:33.751014] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-21T19:14:34.543031] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T19:14:34.552394] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-21T19:14:35.351010] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-21T19:14:35.462260] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-21T19:14:35.490157] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-21T19:14:36.151076] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-21T19:14:36.964018] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-21T19:14:36.970627] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T19:14:37.751012] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-21T19:14:37.827185] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T19:14:38.147485] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-21T19:14:38.483734] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-21T19:14:38.551009] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-21T19:14:39.351000] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-21T19:14:39.526275] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-21T19:14:40.151030] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-21T19:14:40.891433] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T19:14:40.950989] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-21T19:14:41.751008] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-21T19:14:41.856336] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-21T19:14:42.553030] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-21T19:14:42.558908] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T19:14:42.611818] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-21T19:14:43.351085] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-21T19:14:44.151009] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-21T19:14:44.294594] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T19:14:44.951067] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-21T19:14:45.105895] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T19:14:45.250121] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T19:14:45.751036] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-21T19:14:46.551031] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-21T19:14:46.666394] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T19:14:46.711206] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-21T19:14:47.351083] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-21T19:14:48.133293] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T19:14:48.150993] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-21T19:14:48.352427] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T19:14:48.951035] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-21T19:14:49.751052] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-21T19:14:49.887769] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T19:14:49.895000] [INFO ] [REMOTE ] HRB: Full fetch complete (69973 records). [2025-10-21T19:14:49.895130] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-21T19:14:50.059345] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T19:14:50.175496] [INFO ] [REMOTE ] HQL: Full fetch complete (25304 records). [2025-10-21T19:14:50.187028] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-21T19:14:50.485283] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-21T19:14:50.486165] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-21T19:14:50.488820] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-21T19:14:50.488906] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-21T19:14:50.560247] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-21T19:14:50.597998] [DEBUG] [LOCAL ] HRB: Trimmed 69973 records to 48267 (keeping 200 days of data) [2025-10-21T19:14:50.789420] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-21T19:14:50.790552] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-21T19:14:50.794379] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-21T19:14:50.795188] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-21T19:14:50.803965] [DEBUG] [LOCAL ] HQL: Trimmed 25304 records to 16952 (keeping 200 days of data) [2025-10-21T19:14:51.018703] [DEBUG] [LOCAL ] HQL: Primary data saved (16952 records). [2025-10-21T19:14:51.026696] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-21T19:14:51.026825] [INFO ] [MAIN ] Update Progress: 1048/2366 symbols completed. HQL took 30.3s. Estimated remaining: 2h 49m 30s. Rate: 7.8 symbols/min [2025-10-21T19:14:51.238154] [DEBUG] [LOCAL ] HRB: Primary data saved (48267 records). [2025-10-21T19:14:51.250325] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-21T19:14:51.269171] [INFO ] [MAIN ] Update Progress: 1049/2366 symbols completed. HRB took 23.9s. Estimated remaining: 2h 49m 13s. Rate: 7.8 symbols/min [2025-10-21T19:14:51.268751] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:14:51.454790] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:14:51.469466] [DEBUG] [LOCAL ] HRI: Loaded 32387 existing records from primary storage. [2025-10-21T19:14:51.469759] [INFO ] [MAIN ] HRI: Loaded 32387 existing records. [2025-10-21T19:14:51.680702] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:14:51.681220] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-21T19:14:51.681395] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-21T19:14:51.681727] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-21T19:14:51.681834] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-21T19:14:51.836800] [DEBUG] [LOCAL ] HRL: Loaded 53128 existing records from primary storage. [2025-10-21T19:14:51.844586] [INFO ] [MAIN ] HRL: Loaded 53128 existing records. [2025-10-21T19:14:51.857717] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-21T19:14:52.011982] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-21T19:14:52.020829] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T19:14:52.157367] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-21T19:14:52.239886] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:14:52.248003] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-21T19:14:52.251169] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-21T19:14:52.251539] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-21T19:14:52.251599] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-21T19:14:52.430999] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:14:52.678386] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:14:52.950979] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-21T19:14:53.520718] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-21T19:14:53.525231] [INFO ] [REMOTE ] HQH: Full fetch complete (37002 records). [2025-10-21T19:14:53.525304] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-21T19:14:53.755728] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-21T19:14:53.892446] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T19:14:53.939975] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-21T19:14:53.940157] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-21T19:14:53.940866] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-21T19:14:53.940974] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-21T19:14:53.942019] [DEBUG] [LOCAL ] HQH: Trimmed 37002 records to 25808 (keeping 200 days of data) [2025-10-21T19:14:54.094172] [DEBUG] [LOCAL ] HQH: Primary data saved (25808 records). [2025-10-21T19:14:54.094296] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-21T19:14:54.094390] [INFO ] [MAIN ] Update Progress: 1050/2366 symbols completed. HQH took 37.4s. Estimated remaining: 2h 48m 60s. Rate: 7.8 symbols/min [2025-10-21T19:14:54.264292] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:14:54.297990] [DEBUG] [LOCAL ] HRTG: Loaded 34587 existing records from primary storage. [2025-10-21T19:14:54.298243] [INFO ] [MAIN ] HRTG: Loaded 34587 existing records. [2025-10-21T19:14:54.479098] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:14:54.479302] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-21T19:14:54.479349] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-21T19:14:54.479529] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-21T19:14:54.479566] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-21T19:14:54.559268] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-21T19:14:54.846198] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:14:54.874112] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-21T19:14:54.997831] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T19:14:55.351048] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-21T19:14:56.151087] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-21T19:14:56.279365] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T19:14:56.951020] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-21T19:14:57.032173] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T19:14:57.213898] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T19:14:57.751006] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-21T19:14:58.474262] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-21T19:14:58.483093] [INFO ] [REMOTE ] HR: Full fetch complete (75069 records). [2025-10-21T19:14:58.483274] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-21T19:14:58.556216] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-21T19:14:58.908315] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-21T19:14:58.908426] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-21T19:14:58.909883] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-21T19:14:58.909954] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-21T19:14:58.911883] [DEBUG] [LOCAL ] HR: Trimmed 75069 records to 52114 (keeping 200 days of data) [2025-10-21T19:14:59.161270] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T19:14:59.285450] [DEBUG] [LOCAL ] HR: Primary data saved (52114 records). [2025-10-21T19:14:59.285701] [INFO ] [MAIN ] HR: Full history saved. [2025-10-21T19:14:59.285823] [INFO ] [MAIN ] Update Progress: 1051/2366 symbols completed. HR took 33.8s. Estimated remaining: 2h 48m 49s. Rate: 7.8 symbols/min [2025-10-21T19:14:59.356220] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-21T19:14:59.473325] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:14:59.524870] [DEBUG] [LOCAL ] HSBC: Loaded 50998 existing records from primary storage. [2025-10-21T19:14:59.525300] [INFO ] [MAIN ] HSBC: Loaded 50998 existing records. [2025-10-21T19:14:59.720521] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:14:59.721130] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-21T19:14:59.721200] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-21T19:14:59.721627] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-21T19:14:59.721738] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-21T19:15:00.105889] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:15:00.150978] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-21T19:15:00.407618] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T19:15:00.951016] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-21T19:15:01.012511] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T19:15:01.751060] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-21T19:15:01.963442] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T19:15:02.383627] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-21T19:15:02.551003] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-21T19:15:03.081682] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-21T19:15:03.350991] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-21T19:15:03.746103] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T19:15:04.151029] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-21T19:15:04.951011] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-21T19:15:05.050397] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T19:15:05.751176] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-21T19:15:06.102126] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-21T19:15:06.512740] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T19:15:06.551068] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-21T19:15:07.351011] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-21T19:15:07.535885] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T19:15:08.006052] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T19:15:08.151006] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-21T19:15:08.549401] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-21T19:15:08.951036] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-21T19:15:09.561948] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T19:15:09.751071] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-21T19:15:10.551020] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-21T19:15:11.066933] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-21T19:15:11.351003] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-21T19:15:11.430170] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T19:15:11.972629] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T19:15:12.151037] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-21T19:15:12.951072] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-21T19:15:13.505865] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-21T19:15:13.534852] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-21T19:15:13.750991] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-21T19:15:13.888366] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-21T19:15:14.551030] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-21T19:15:15.254758] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T19:15:15.351029] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-21T19:15:16.130320] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-21T19:15:16.150982] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-21T19:15:16.745465] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T19:15:16.951036] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-21T19:15:17.731257] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T19:15:17.751034] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-21T19:15:18.551013] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-21T19:15:18.904508] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-21T19:15:19.351107] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-21T19:15:19.761802] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-21T19:15:19.800474] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T19:15:19.806671] [INFO ] [REMOTE ] HRTG: Full fetch complete (44342 records). [2025-10-21T19:15:19.806850] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-21T19:15:20.156204] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-21T19:15:20.375798] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-21T19:15:20.375990] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-21T19:15:20.376821] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-21T19:15:20.376883] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-21T19:15:20.378057] [DEBUG] [LOCAL ] HRTG: Trimmed 44342 records to 34543 (keeping 200 days of data) [2025-10-21T19:15:20.582521] [DEBUG] [LOCAL ] HRTG: Primary data saved (34543 records). [2025-10-21T19:15:20.582671] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-21T19:15:20.583466] [INFO ] [MAIN ] Update Progress: 1052/2366 symbols completed. HRTG took 26.5s. Estimated remaining: 2h 48m 58s. Rate: 7.8 symbols/min [2025-10-21T19:15:20.760766] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:15:20.783320] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T19:15:20.803552] [DEBUG] [LOCAL ] HSHP: Loaded 14817 existing records from primary storage. [2025-10-21T19:15:20.803795] [INFO ] [MAIN ] HSHP: Loaded 14817 existing records. [2025-10-21T19:15:20.951534] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-21T19:15:20.988407] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:15:20.988739] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-21T19:15:20.988793] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-21T19:15:20.988966] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-21T19:15:20.989021] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-21T19:15:21.342873] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:15:21.751038] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-21T19:15:21.961587] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T19:15:21.969781] [INFO ] [REMOTE ] HRL: Full fetch complete (77024 records). [2025-10-21T19:15:21.969895] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-21T19:15:22.367106] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-21T19:15:22.367189] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-21T19:15:22.368194] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-21T19:15:22.368256] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-21T19:15:22.369683] [DEBUG] [LOCAL ] HRL: Trimmed 77024 records to 53126 (keeping 200 days of data) [2025-10-21T19:15:22.552702] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-21T19:15:22.694399] [DEBUG] [LOCAL ] HRL: Primary data saved (53126 records). [2025-10-21T19:15:22.694547] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-21T19:15:22.694676] [INFO ] [MAIN ] Update Progress: 1053/2366 symbols completed. HRL took 31.4s. Estimated remaining: 2h 48m 43s. Rate: 7.8 symbols/min [2025-10-21T19:15:22.863816] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:15:22.912862] [DEBUG] [LOCAL ] HSY: Loaded 50468 existing records from primary storage. [2025-10-21T19:15:22.913209] [INFO ] [MAIN ] HSY: Loaded 50468 existing records. [2025-10-21T19:15:23.096527] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:15:23.097137] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-21T19:15:23.113612] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-21T19:15:23.126581] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-21T19:15:23.126741] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-21T19:15:23.137344] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-21T19:15:23.258900] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-21T19:15:23.356243] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-21T19:15:23.524940] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:15:23.621787] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T19:15:24.151015] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-21T19:15:24.950996] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-21T19:15:25.213415] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T19:15:25.751013] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-21T19:15:25.953561] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-21T19:15:26.075866] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-21T19:15:26.551035] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-21T19:15:27.351010] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-21T19:15:27.531919] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T19:15:27.586284] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T19:15:28.151040] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-21T19:15:28.951024] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-21T19:15:29.173554] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T19:15:29.751028] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-21T19:15:30.050889] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T19:15:30.071218] [INFO ] [REMOTE ] HSBC: Full fetch complete (74158 records). [2025-10-21T19:15:30.072259] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-21T19:15:30.071887] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-21T19:15:30.458063] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-21T19:15:30.458140] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-21T19:15:30.459098] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-21T19:15:30.459163] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-21T19:15:30.460563] [DEBUG] [LOCAL ] HSBC: Trimmed 74158 records to 50992 (keeping 200 days of data) [2025-10-21T19:15:30.559795] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-21T19:15:30.765818] [DEBUG] [LOCAL ] HSBC: Primary data saved (50992 records). [2025-10-21T19:15:30.765926] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-21T19:15:30.766002] [INFO ] [MAIN ] Update Progress: 1054/2366 symbols completed. HSBC took 31.5s. Estimated remaining: 2h 48m 36s. Rate: 7.8 symbols/min [2025-10-21T19:15:30.935513] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:15:30.935631] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-21T19:15:30.935707] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-21T19:15:30.935842] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-21T19:15:30.935909] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-21T19:15:30.935964] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-21T19:15:30.936000] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-21T19:15:31.292622] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:15:31.350981] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-10-21T19:15:31.604077] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T19:15:31.954049] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T19:15:31.954581] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-10-21T19:15:31.954714] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:15:31.954773] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-21T19:15:31.954833] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:15:31.954910] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-21T19:15:31.954987] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-21T19:15:31.955025] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-21T19:15:31.955064] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-21T19:15:31.955118] [INFO ] [MAIN ] Update Progress: 1055/2366 symbols completed. HTB took 1.2s. Estimated remaining: 2h 48m 20s. Rate: 7.8 symbols/min [2025-10-21T19:15:32.098727] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T19:15:32.160458] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-21T19:15:32.164430] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:15:32.181896] [DEBUG] [LOCAL ] HTD: Loaded 14305 existing records from primary storage. [2025-10-21T19:15:32.182153] [INFO ] [MAIN ] HTD: Loaded 14305 existing records. [2025-10-21T19:15:32.366678] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:15:32.366899] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-21T19:15:32.366947] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-21T19:15:32.367109] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-21T19:15:32.367148] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-21T19:15:32.738949] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:15:32.951071] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-21T19:15:33.095030] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-21T19:15:33.751013] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-21T19:15:33.761920] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-21T19:15:34.551042] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-21T19:15:34.722902] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T19:15:35.324769] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T19:15:35.350999] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-21T19:15:36.151045] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-21T19:15:36.449396] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T19:15:36.950987] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-21T19:15:37.445942] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T19:15:37.751036] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-21T19:15:38.551079] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-21T19:15:38.611968] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T19:15:38.759850] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T19:15:39.351026] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-21T19:15:39.455416] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-21T19:15:40.151101] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-21T19:15:40.727305] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T19:15:40.732256] [INFO ] [REMOTE ] HRI: Full fetch complete (46667 records). [2025-10-21T19:15:40.732394] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-21T19:15:40.956167] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-21T19:15:41.115679] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-21T19:15:41.115785] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-21T19:15:41.116633] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-21T19:15:41.116734] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-21T19:15:41.117945] [DEBUG] [LOCAL ] HRI: Trimmed 46667 records to 32283 (keeping 200 days of data) [2025-10-21T19:15:41.318554] [DEBUG] [LOCAL ] HRI: Primary data saved (32283 records). [2025-10-21T19:15:41.318707] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-21T19:15:41.318794] [INFO ] [MAIN ] Update Progress: 1056/2366 symbols completed. HRI took 50.3s. Estimated remaining: 2h 48m 15s. Rate: 7.8 symbols/min [2025-10-21T19:15:41.490589] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:15:41.490791] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-21T19:15:41.490839] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-21T19:15:41.490967] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-21T19:15:41.491015] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-21T19:15:41.491062] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-21T19:15:41.491099] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-21T19:15:41.766339] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-21T19:15:41.845850] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:15:42.040908] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T19:15:42.087536] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T19:15:42.297325] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-21T19:15:42.551059] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-21T19:15:43.351012] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-21T19:15:43.469691] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-21T19:15:43.622541] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-21T19:15:44.151042] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-21T19:15:44.471988] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-21T19:15:44.951084] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-21T19:15:45.751033] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-21T19:15:46.065264] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-21T19:15:46.551000] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-21T19:15:46.758193] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T19:15:46.833528] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-21T19:15:47.351010] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-21T19:15:47.680228] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-21T19:15:48.151014] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-21T19:15:48.950996] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-21T19:15:49.137361] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T19:15:49.139915] [INFO ] [REMOTE ] HSHP: Full fetch complete (23151 records). [2025-10-21T19:15:49.139997] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-21T19:15:49.509679] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-21T19:15:49.509762] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-21T19:15:49.510277] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-21T19:15:49.510323] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-21T19:15:49.511102] [DEBUG] [LOCAL ] HSHP: Trimmed 23151 records to 14708 (keeping 200 days of data) [2025-10-21T19:15:49.599070] [DEBUG] [LOCAL ] HSHP: Primary data saved (14708 records). [2025-10-21T19:15:49.599200] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-21T19:15:49.599274] [INFO ] [MAIN ] Update Progress: 1057/2366 symbols completed. HSHP took 29.0s. Estimated remaining: 2h 48m 8s. Rate: 7.8 symbols/min [2025-10-21T19:15:49.773172] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:15:49.769714] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-21T19:15:49.818639] [DEBUG] [LOCAL ] HTGC: Loaded 47761 existing records from primary storage. [2025-10-21T19:15:49.818963] [INFO ] [MAIN ] HTGC: Loaded 47761 existing records. [2025-10-21T19:15:49.994943] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:15:49.995132] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-21T19:15:49.995178] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-21T19:15:49.995355] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-21T19:15:49.995393] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-21T19:15:50.157147] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-21T19:15:50.351835] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:15:50.550993] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-21T19:15:50.883810] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-21T19:15:50.913046] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-21T19:15:51.351019] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-21T19:15:52.151024] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-21T19:15:52.950996] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-21T19:15:52.999889] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T19:15:53.056886] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-21T19:15:53.187686] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-21T19:15:53.751029] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-21T19:15:54.551072] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-21T19:15:55.096789] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T19:15:55.351072] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-21T19:15:55.919332] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T19:15:55.972923] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-21T19:15:56.151043] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-21T19:15:56.951036] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-21T19:15:57.751028] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-21T19:15:57.793898] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T19:15:58.071720] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-21T19:15:58.075296] [INFO ] [REMOTE ] HTD: Full fetch complete (19670 records). [2025-10-21T19:15:58.075382] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-21T19:15:58.160615] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-21T19:15:58.525754] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-21T19:15:58.525851] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-21T19:15:58.526393] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-21T19:15:58.526435] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-21T19:15:58.527177] [DEBUG] [LOCAL ] HTD: Trimmed 19670 records to 14308 (keeping 200 days of data) [2025-10-21T19:15:58.564728] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-21T19:15:58.618302] [DEBUG] [LOCAL ] HTD: Primary data saved (14308 records). [2025-10-21T19:15:58.618438] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-21T19:15:58.618516] [INFO ] [MAIN ] Update Progress: 1058/2366 symbols completed. HTD took 26.7s. Estimated remaining: 2h 48m 1s. Rate: 7.8 symbols/min [2025-10-21T19:15:58.784470] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:15:58.815330] [DEBUG] [LOCAL ] HTH: Loaded 32664 existing records from primary storage. [2025-10-21T19:15:58.815604] [INFO ] [MAIN ] HTH: Loaded 32664 existing records. [2025-10-21T19:15:58.998445] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:15:58.999079] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-21T19:15:59.000091] [INFO ] [REMOTE ] HTFC: Full fetch complete (826 records). [2025-10-21T19:15:59.000216] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-21T19:15:59.000334] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-21T19:15:59.000380] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-21T19:15:59.006171] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-21T19:15:59.038794] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-21T19:15:59.364483] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-21T19:15:59.388432] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-21T19:15:59.447034] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:15:59.478244] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:15:59.481119] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-21T19:15:59.487003] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-21T19:15:59.497379] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-21T19:15:59.502636] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-21T19:15:59.521300] [INFO ] [MAIN ] Update Progress: 1059/2366 symbols completed. HTFC took 18.2s. Estimated remaining: 2h 47m 45s. Rate: 7.8 symbols/min [2025-10-21T19:15:59.605831] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:15:59.731443] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:15:59.768744] [DEBUG] [LOCAL ] HUBB: Loaded 36261 existing records from primary storage. [2025-10-21T19:15:59.769001] [INFO ] [MAIN ] HUBB: Loaded 36261 existing records. [2025-10-21T19:15:59.944262] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:15:59.944482] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-21T19:15:59.944528] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-21T19:15:59.944762] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-21T19:15:59.944817] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-21T19:16:00.156135] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-21T19:16:00.306708] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:16:00.951004] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-21T19:16:01.597817] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-21T19:16:01.751089] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-21T19:16:02.407621] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-21T19:16:02.501117] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-21T19:16:02.550995] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-21T19:16:03.351034] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-21T19:16:03.582128] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-21T19:16:04.151005] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-21T19:16:04.360238] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T19:16:04.935057] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T19:16:04.950987] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-21T19:16:04.996331] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-21T19:16:05.004032] [INFO ] [REMOTE ] HSY: Full fetch complete (73654 records). [2025-10-21T19:16:05.004141] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-21T19:16:05.388979] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-21T19:16:05.389074] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-21T19:16:05.390014] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-21T19:16:05.390076] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-21T19:16:05.391445] [DEBUG] [LOCAL ] HSY: Trimmed 73654 records to 50427 (keeping 200 days of data) [2025-10-21T19:16:05.696581] [DEBUG] [LOCAL ] HSY: Primary data saved (50427 records). [2025-10-21T19:16:05.696748] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-21T19:16:05.696834] [INFO ] [MAIN ] Update Progress: 1060/2366 symbols completed. HSY took 43.0s. Estimated remaining: 2h 47m 36s. Rate: 7.8 symbols/min [2025-10-21T19:16:05.760602] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-21T19:16:05.869887] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:16:05.905365] [DEBUG] [LOCAL ] HUBS: Loaded 40086 existing records from primary storage. [2025-10-21T19:16:05.905633] [INFO ] [MAIN ] HUBS: Loaded 40086 existing records. [2025-10-21T19:16:06.081469] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:16:06.081702] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-21T19:16:06.081766] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-21T19:16:06.082128] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-21T19:16:06.082184] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-21T19:16:06.407591] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-21T19:16:06.467464] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:16:06.550983] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-21T19:16:07.263044] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T19:16:07.351019] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-21T19:16:08.018040] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T19:16:08.151041] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-21T19:16:08.793047] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T19:16:08.951060] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-21T19:16:09.592125] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T19:16:09.751054] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-21T19:16:10.206134] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-21T19:16:10.551023] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-21T19:16:11.351006] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-21T19:16:11.528131] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T19:16:11.848017] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-21T19:16:12.151068] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-21T19:16:12.797384] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T19:16:12.951027] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-21T19:16:13.530994] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-21T19:16:13.751032] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-21T19:16:14.319090] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T19:16:14.551036] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-21T19:16:15.024447] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-21T19:16:15.351035] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-21T19:16:16.071693] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T19:16:16.151018] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-21T19:16:16.951040] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-21T19:16:17.183882] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T19:16:17.621004] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-21T19:16:17.751060] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-21T19:16:18.430067] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T19:16:18.551057] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-21T19:16:19.351087] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-21T19:16:19.450688] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T19:16:20.083631] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T19:16:20.151056] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-21T19:16:20.807754] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-21T19:16:20.951045] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-21T19:16:21.757162] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-21T19:16:21.764772] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T19:16:22.551006] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-21T19:16:22.605283] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T19:16:23.133949] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T19:16:23.351062] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-21T19:16:24.016825] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T19:16:24.151089] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-21T19:16:24.753334] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T19:16:24.951036] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-21T19:16:25.742894] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T19:16:25.751097] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-21T19:16:26.351785] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T19:16:26.357011] [INFO ] [REMOTE ] HUBB: Full fetch complete (54238 records). [2025-10-21T19:16:26.357101] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-21T19:16:26.558128] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-21T19:16:26.763835] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-21T19:16:26.763921] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-21T19:16:26.764721] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-21T19:16:26.764785] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-21T19:16:26.765940] [DEBUG] [LOCAL ] HUBB: Trimmed 54238 records to 36142 (keeping 200 days of data) [2025-10-21T19:16:27.001293] [DEBUG] [LOCAL ] HUBB: Primary data saved (36142 records). [2025-10-21T19:16:27.001562] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-21T19:16:27.001704] [INFO ] [MAIN ] Update Progress: 1061/2366 symbols completed. HUBB took 27.5s. Estimated remaining: 2h 47m 45s. Rate: 7.8 symbols/min [2025-10-21T19:16:27.193118] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:16:27.210427] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T19:16:27.264500] [DEBUG] [LOCAL ] HUM: Loaded 49347 existing records from primary storage. [2025-10-21T19:16:27.264881] [INFO ] [MAIN ] HUM: Loaded 49347 existing records. [2025-10-21T19:16:27.360162] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-21T19:16:27.443171] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:16:27.443385] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-21T19:16:27.443465] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-21T19:16:27.443759] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-21T19:16:27.443836] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-21T19:16:27.794132] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:16:28.150992] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-21T19:16:28.239335] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T19:16:28.951062] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-21T19:16:29.256592] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T19:16:29.264522] [INFO ] [REMOTE ] HTGC: Full fetch complete (68865 records). [2025-10-21T19:16:29.264629] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-21T19:16:29.461605] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-21T19:16:29.677569] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-21T19:16:29.677677] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-21T19:16:29.678631] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-21T19:16:29.678724] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-21T19:16:29.680144] [DEBUG] [LOCAL ] HTGC: Trimmed 68865 records to 47716 (keeping 200 days of data) [2025-10-21T19:16:29.766509] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-21T19:16:29.968803] [DEBUG] [LOCAL ] HTGC: Primary data saved (47716 records). [2025-10-21T19:16:29.968949] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-21T19:16:29.969864] [INFO ] [MAIN ] Update Progress: 1062/2366 symbols completed. HTGC took 40.4s. Estimated remaining: 2h 47m 31s. Rate: 7.8 symbols/min [2025-10-21T19:16:30.192246] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:16:30.256959] [DEBUG] [LOCAL ] HUN: Loaded 53219 existing records from primary storage. [2025-10-21T19:16:30.257617] [INFO ] [MAIN ] HUN: Loaded 53219 existing records. [2025-10-21T19:16:30.476527] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:16:30.476907] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-21T19:16:30.477027] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-21T19:16:30.477501] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-21T19:16:30.477577] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-21T19:16:30.581842] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-21T19:16:30.642883] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T19:16:31.028830] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:16:31.075545] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T19:16:31.082992] [INFO ] [REMOTE ] HTH: Full fetch complete (46818 records). [2025-10-21T19:16:31.083209] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-21T19:16:31.356198] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-21T19:16:31.571350] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-21T19:16:31.571438] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-21T19:16:31.572273] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-21T19:16:31.572342] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-21T19:16:31.573483] [DEBUG] [LOCAL ] HTH: Trimmed 46818 records to 32547 (keeping 200 days of data) [2025-10-21T19:16:31.808798] [DEBUG] [LOCAL ] HTH: Primary data saved (32547 records). [2025-10-21T19:16:31.808957] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-21T19:16:31.809048] [INFO ] [MAIN ] Update Progress: 1063/2366 symbols completed. HTH took 33.2s. Estimated remaining: 2h 47m 16s. Rate: 7.8 symbols/min [2025-10-21T19:16:31.978484] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:16:32.016282] [DEBUG] [LOCAL ] HUYA: Loaded 43607 existing records from primary storage. [2025-10-21T19:16:32.016587] [INFO ] [MAIN ] HUYA: Loaded 43607 existing records. [2025-10-21T19:16:32.159229] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-21T19:16:32.202122] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:16:32.203297] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-21T19:16:32.203406] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-21T19:16:32.203816] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-21T19:16:32.204088] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-21T19:16:32.459672] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T19:16:32.604415] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:16:32.951013] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-21T19:16:33.073188] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T19:16:33.751083] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-21T19:16:34.006851] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-21T19:16:34.551006] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-21T19:16:34.848062] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T19:16:34.855191] [INFO ] [REMOTE ] HUBS: Full fetch complete (57089 records). [2025-10-21T19:16:34.855328] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-21T19:16:35.234749] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-21T19:16:35.234829] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-21T19:16:35.235614] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-21T19:16:35.235683] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-21T19:16:35.236815] [DEBUG] [LOCAL ] HUBS: Trimmed 57089 records to 40052 (keeping 200 days of data) [2025-10-21T19:16:35.351068] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-21T19:16:35.491297] [DEBUG] [LOCAL ] HUBS: Primary data saved (40052 records). [2025-10-21T19:16:35.504178] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-21T19:16:35.507712] [INFO ] [MAIN ] Update Progress: 1064/2366 symbols completed. HUBS took 29.8s. Estimated remaining: 2h 47m 4s. Rate: 7.8 symbols/min [2025-10-21T19:16:35.554940] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T19:16:35.695172] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:16:35.713385] [DEBUG] [LOCAL ] HVT: Loaded 14991 existing records from primary storage. [2025-10-21T19:16:35.713676] [INFO ] [MAIN ] HVT: Loaded 14991 existing records. [2025-10-21T19:16:35.899334] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:16:35.899676] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-21T19:16:35.899737] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-21T19:16:35.899926] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-21T19:16:35.899983] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-21T19:16:36.151159] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-21T19:16:36.280983] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:16:36.298029] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-21T19:16:36.950995] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-21T19:16:37.137153] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T19:16:37.751078] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-21T19:16:38.087734] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T19:16:38.507773] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T19:16:38.551000] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-21T19:16:39.351010] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-21T19:16:39.731891] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T19:16:40.151021] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-21T19:16:40.234443] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T19:16:40.255877] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T19:16:40.951025] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-21T19:16:41.751013] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-21T19:16:41.871590] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T19:16:41.979440] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T19:16:42.551009] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-21T19:16:43.351024] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-21T19:16:43.587744] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-21T19:16:44.122132] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-21T19:16:44.150987] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-21T19:16:44.289885] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T19:16:44.951089] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-21T19:16:45.223996] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T19:16:45.751121] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-21T19:16:46.442839] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T19:16:46.550995] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-21T19:16:47.351011] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-21T19:16:47.604765] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T19:16:48.004238] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T19:16:48.151044] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-21T19:16:48.891665] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T19:16:48.950984] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-21T19:16:49.433921] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T19:16:49.751072] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-21T19:16:50.551029] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-21T19:16:50.959324] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-21T19:16:51.293696] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T19:16:51.350983] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-21T19:16:51.871671] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T19:16:52.151074] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-21T19:16:52.951080] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-21T19:16:53.192951] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T19:16:53.751026] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-21T19:16:53.859848] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T19:16:54.100527] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-21T19:16:54.551082] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-21T19:16:55.350997] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-21T19:16:55.442549] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T19:16:56.150979] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-21T19:16:56.224383] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-21T19:16:56.951058] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-21T19:16:57.004538] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T19:16:57.011791] [INFO ] [REMOTE ] HUYA: Full fetch complete (63949 records). [2025-10-21T19:16:57.011906] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-21T19:16:57.193134] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T19:16:57.433391] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-21T19:16:57.433483] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-21T19:16:57.434435] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-21T19:16:57.434500] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-21T19:16:57.435973] [DEBUG] [LOCAL ] HUYA: Trimmed 63949 records to 43629 (keeping 200 days of data) [2025-10-21T19:16:57.695393] [DEBUG] [LOCAL ] HUYA: Primary data saved (43629 records). [2025-10-21T19:16:57.695537] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-21T19:16:57.695619] [INFO ] [MAIN ] Update Progress: 1065/2366 symbols completed. HUYA took 25.9s. Estimated remaining: 2h 47m 14s. Rate: 7.8 symbols/min [2025-10-21T19:16:57.761566] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-21T19:16:57.875144] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:16:57.929349] [DEBUG] [LOCAL ] HWM: Loaded 52717 existing records from primary storage. [2025-10-21T19:16:57.929672] [INFO ] [MAIN ] HWM: Loaded 52717 existing records. [2025-10-21T19:16:58.116908] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:16:58.117101] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-21T19:16:58.117148] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-21T19:16:58.117350] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-21T19:16:58.117406] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-21T19:16:58.495457] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:16:58.550997] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-21T19:16:58.719025] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-21T19:16:58.763321] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T19:16:59.351073] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-21T19:17:00.151046] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-21T19:17:00.277203] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-21T19:17:00.526757] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-21T19:17:00.534491] [INFO ] [REMOTE ] HUM: Full fetch complete (71171 records). [2025-10-21T19:17:00.534608] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-21T19:17:00.926475] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-21T19:17:00.926578] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-21T19:17:00.927492] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-21T19:17:00.927556] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-21T19:17:00.928984] [DEBUG] [LOCAL ] HUM: Trimmed 71171 records to 49322 (keeping 200 days of data) [2025-10-21T19:17:00.983516] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-21T19:17:01.240213] [DEBUG] [LOCAL ] HUM: Primary data saved (49322 records). [2025-10-21T19:17:01.240393] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-21T19:17:01.241321] [INFO ] [MAIN ] Update Progress: 1066/2366 symbols completed. HUM took 34.2s. Estimated remaining: 2h 47m 1s. Rate: 7.8 symbols/min [2025-10-21T19:17:01.412091] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:17:01.457446] [DEBUG] [LOCAL ] HXL: Loaded 45814 existing records from primary storage. [2025-10-21T19:17:01.457761] [INFO ] [MAIN ] HXL: Loaded 45814 existing records. [2025-10-21T19:17:01.642604] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:17:01.642827] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-21T19:17:01.642873] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-21T19:17:01.643099] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-21T19:17:01.643156] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-21T19:17:01.753610] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-21T19:17:02.005674] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-21T19:17:02.040551] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:17:02.079299] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T19:17:02.551025] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-21T19:17:03.351063] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-21T19:17:03.445750] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-21T19:17:03.709663] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T19:17:03.718266] [INFO ] [REMOTE ] HUN: Full fetch complete (76986 records). [2025-10-21T19:17:03.718445] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-21T19:17:04.123041] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-21T19:17:04.123150] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-21T19:17:04.124126] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-21T19:17:04.124189] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-21T19:17:04.125552] [DEBUG] [LOCAL ] HUN: Trimmed 76986 records to 53211 (keeping 200 days of data) [2025-10-21T19:17:04.181617] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-21T19:17:04.468291] [DEBUG] [LOCAL ] HUN: Primary data saved (53211 records). [2025-10-21T19:17:04.468428] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-21T19:17:04.469164] [INFO ] [MAIN ] Update Progress: 1067/2366 symbols completed. HUN took 34.5s. Estimated remaining: 2h 46m 48s. Rate: 7.8 symbols/min [2025-10-21T19:17:04.675505] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:17:04.687908] [DEBUG] [LOCAL ] HY: Loaded 10046 existing records from primary storage. [2025-10-21T19:17:04.688200] [INFO ] [MAIN ] HY: Loaded 10046 existing records. [2025-10-21T19:17:04.877129] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:17:04.877501] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-21T19:17:04.877736] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-21T19:17:04.878047] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-21T19:17:04.878114] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-21T19:17:04.957281] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-21T19:17:05.109981] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T19:17:05.218764] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T19:17:05.229445] [INFO ] [REMOTE ] HVT: Full fetch complete (23043 records). [2025-10-21T19:17:05.239778] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-21T19:17:05.399765] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:17:05.689192] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-21T19:17:05.689266] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-21T19:17:05.689765] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-21T19:17:05.689824] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-21T19:17:05.690398] [DEBUG] [LOCAL ] HVT: Trimmed 23043 records to 14899 (keeping 200 days of data) [2025-10-21T19:17:05.756734] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-21T19:17:05.785314] [DEBUG] [LOCAL ] HVT: Primary data saved (14899 records). [2025-10-21T19:17:05.785417] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-21T19:17:05.785502] [INFO ] [MAIN ] Update Progress: 1068/2366 symbols completed. HVT took 30.3s. Estimated remaining: 2h 46m 32s. Rate: 7.8 symbols/min [2025-10-21T19:17:05.959979] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:17:05.960221] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-21T19:17:05.960271] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-21T19:17:05.960379] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-21T19:17:05.960428] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-21T19:17:05.960468] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-21T19:17:05.960500] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-21T19:17:06.318979] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:17:06.551053] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-21T19:17:06.697131] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-21T19:17:06.828032] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-21T19:17:07.351043] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-21T19:17:07.872942] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-21T19:17:08.151020] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-21T19:17:08.951004] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-21T19:17:09.052993] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T19:17:09.215288] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-21T19:17:09.751002] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-21T19:17:09.862152] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T19:17:10.551028] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-21T19:17:11.322451] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T19:17:11.351063] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-21T19:17:11.694264] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T19:17:12.151042] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-21T19:17:12.259059] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-21T19:17:12.471093] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-21T19:17:12.951023] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-21T19:17:13.751027] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-21T19:17:13.864585] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T19:17:14.551032] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-21T19:17:14.780285] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-21T19:17:15.350997] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-21T19:17:15.703204] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-21T19:17:15.705773] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-21T19:17:16.151073] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-21T19:17:16.951036] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-21T19:17:17.735616] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T19:17:17.751011] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-21T19:17:18.068824] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-21T19:17:18.493223] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-21T19:17:18.551030] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-21T19:17:19.348401] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-21T19:17:19.350975] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-21T19:17:20.151004] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-21T19:17:20.306902] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-21T19:17:20.951019] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-21T19:17:21.291794] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-21T19:17:21.751003] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-21T19:17:21.943333] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T19:17:22.102340] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-21T19:17:22.551040] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-21T19:17:23.351041] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-21T19:17:24.151083] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-21T19:17:24.162586] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T19:17:24.210989] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T19:17:24.580858] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-21T19:17:24.951125] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-21T19:17:25.751080] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-21T19:17:26.496332] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T19:17:26.551067] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-21T19:17:27.351054] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-21T19:17:27.911772] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-21T19:17:27.931943] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-21T19:17:27.934769] [INFO ] [REMOTE ] HY: Full fetch complete (14937 records). [2025-10-21T19:17:27.934857] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-21T19:17:28.158588] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-21T19:17:28.354923] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-21T19:17:28.355044] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-21T19:17:28.355603] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-21T19:17:28.356340] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-21T19:17:28.357522] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T19:17:28.368431] [DEBUG] [LOCAL ] HY: Trimmed 14937 records to 9945 (keeping 200 days of data) [2025-10-21T19:17:28.436518] [DEBUG] [LOCAL ] HY: Primary data saved (9945 records). [2025-10-21T19:17:28.436773] [INFO ] [MAIN ] HY: Full history saved. [2025-10-21T19:17:28.436898] [INFO ] [MAIN ] Update Progress: 1069/2366 symbols completed. HY took 24.0s. Estimated remaining: 2h 46m 43s. Rate: 7.8 symbols/min [2025-10-21T19:17:28.612163] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:17:28.612420] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-21T19:17:28.612458] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-21T19:17:28.612583] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-21T19:17:28.612625] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-21T19:17:28.612709] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-21T19:17:28.612752] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-21T19:17:28.956257] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-21T19:17:29.074629] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:17:29.322796] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-21T19:17:29.751003] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-21T19:17:30.091513] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-21T19:17:30.094036] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-21T19:17:30.551095] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-21T19:17:31.351031] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-21T19:17:31.578140] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-21T19:17:32.070834] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T19:17:32.150996] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-21T19:17:32.380445] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-21T19:17:32.951031] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-21T19:17:33.751031] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-21T19:17:34.185245] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-21T19:17:34.551028] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-21T19:17:35.351034] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-21T19:17:35.533150] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T19:17:35.766796] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-21T19:17:35.767589] [INFO ] [REMOTE ] HYAC: Full fetch complete (921 records). [2025-10-21T19:17:35.767678] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-21T19:17:35.942374] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-10-21T19:17:35.942568] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:17:35.942635] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:17:35.942730] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-21T19:17:35.942791] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-21T19:17:35.942827] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-21T19:17:35.942865] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-21T19:17:35.942917] [INFO ] [MAIN ] Update Progress: 1070/2366 symbols completed. HYAC took 30.2s. Estimated remaining: 2h 46m 35s. Rate: 7.8 symbols/min [2025-10-21T19:17:36.108835] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:17:36.119839] [DEBUG] [LOCAL ] HYI: Loaded 9771 existing records from primary storage. [2025-10-21T19:17:36.120038] [INFO ] [MAIN ] HYI: Loaded 9771 existing records. [2025-10-21T19:17:36.156105] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-21T19:17:36.302201] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:17:36.302443] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-21T19:17:36.302517] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-21T19:17:36.302831] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-21T19:17:36.302885] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-21T19:17:36.606223] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-21T19:17:36.634924] [INFO ] [REMOTE ] HXL: Full fetch complete (66625 records). [2025-10-21T19:17:36.665058] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-21T19:17:36.728552] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:17:36.956188] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-21T19:17:37.088792] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-21T19:17:37.088875] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-21T19:17:37.089867] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-21T19:17:37.089929] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-21T19:17:37.091246] [DEBUG] [LOCAL ] HXL: Trimmed 66625 records to 45797 (keeping 200 days of data) [2025-10-21T19:17:37.358592] [DEBUG] [LOCAL ] HXL: Primary data saved (45797 records). [2025-10-21T19:17:37.358739] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-21T19:17:37.358823] [INFO ] [MAIN ] Update Progress: 1071/2366 symbols completed. HXL took 36.1s. Estimated remaining: 2h 46m 19s. Rate: 7.8 symbols/min [2025-10-21T19:17:37.526396] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:17:37.558282] [DEBUG] [LOCAL ] HYT: Loaded 33697 existing records from primary storage. [2025-10-21T19:17:37.558549] [INFO ] [MAIN ] HYT: Loaded 33697 existing records. [2025-10-21T19:17:37.732734] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:17:37.733011] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-21T19:17:37.733120] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-21T19:17:37.740136] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-21T19:17:37.740362] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-21T19:17:37.740497] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-21T19:17:37.763381] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-21T19:17:38.097749] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-21T19:17:38.101170] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:17:38.253807] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-21T19:17:38.261521] [INFO ] [REMOTE ] HWM: Full fetch complete (76631 records). [2025-10-21T19:17:38.261632] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-21T19:17:38.556234] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-21T19:17:38.644529] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-21T19:17:38.644600] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-21T19:17:38.645578] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-21T19:17:38.645660] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-21T19:17:38.647072] [DEBUG] [LOCAL ] HWM: Trimmed 76631 records to 52705 (keeping 200 days of data) [2025-10-21T19:17:38.951569] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-21T19:17:38.974765] [DEBUG] [LOCAL ] HWM: Primary data saved (52705 records). [2025-10-21T19:17:38.974942] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-21T19:17:38.975031] [INFO ] [MAIN ] Update Progress: 1072/2366 symbols completed. HWM took 41.3s. Estimated remaining: 2h 46m 4s. Rate: 7.8 symbols/min [2025-10-21T19:17:39.143750] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:17:39.149353] [DEBUG] [LOCAL ] HYTR: Loaded 3098 existing records from primary storage. [2025-10-21T19:17:39.149526] [INFO ] [MAIN ] HYTR: Loaded 3098 existing records. [2025-10-21T19:17:39.325484] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:17:39.325804] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-21T19:17:39.325853] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-21T19:17:39.326053] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-21T19:17:39.326108] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-21T19:17:39.356326] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-21T19:17:39.678174] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:17:40.151074] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-21T19:17:40.754962] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-21T19:17:40.773575] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-21T19:17:40.951008] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-21T19:17:41.751079] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-21T19:17:42.073526] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-21T19:17:42.192184] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-21T19:17:42.551033] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-21T19:17:42.859036] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-21T19:17:43.351007] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-21T19:17:44.151016] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-21T19:17:44.787627] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-21T19:17:44.914996] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-21T19:17:44.951040] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-21T19:17:45.751081] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-21T19:17:45.769609] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-21T19:17:46.551034] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-21T19:17:47.335404] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T19:17:47.351411] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T19:17:47.351092] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-21T19:17:48.151015] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-21T19:17:48.857866] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T19:17:48.951036] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-21T19:17:49.035611] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-21T19:17:49.260616] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-21T19:17:49.751028] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-21T19:17:50.228486] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-21T19:17:50.551045] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-21T19:17:51.351038] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-21T19:17:51.858997] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T19:17:52.088192] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-21T19:17:52.151052] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-21T19:17:52.694125] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-21T19:17:52.951022] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-21T19:17:53.519512] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-21T19:17:53.751049] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-21T19:17:54.551035] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-21T19:17:54.565170] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-21T19:17:55.109126] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-21T19:17:55.351089] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-21T19:17:56.151039] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-21T19:17:56.163872] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-21T19:17:56.411429] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-21T19:17:56.951074] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-21T19:17:57.751034] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-21T19:17:58.330857] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-21T19:17:58.490063] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T19:17:58.551061] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-21T19:17:59.351063] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-21T19:17:59.699320] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-21T19:17:59.700045] [INFO ] [REMOTE ] HYBX: Full fetch complete (701 records). [2025-10-21T19:17:59.700112] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-21T19:17:59.884439] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-21T19:17:59.884799] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:17:59.884923] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:17:59.885167] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-21T19:17:59.885261] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-21T19:17:59.885438] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-21T19:17:59.885518] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-21T19:17:59.885580] [INFO ] [MAIN ] Update Progress: 1073/2366 symbols completed. HYBX took 31.4s. Estimated remaining: 2h 46m 13s. Rate: 7.8 symbols/min [2025-10-21T19:18:00.081103] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-21T19:18:00.082848] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:18:00.118722] [DEBUG] [LOCAL ] HZO: Loaded 28914 existing records from primary storage. [2025-10-21T19:18:00.118968] [INFO ] [MAIN ] HZO: Loaded 28914 existing records. [2025-10-21T19:18:00.156305] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-21T19:18:00.305090] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:18:00.305298] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-21T19:18:00.305348] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-21T19:18:00.305556] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-21T19:18:00.305613] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-21T19:18:00.708170] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:18:00.951043] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-21T19:18:01.613869] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-21T19:18:01.616821] [INFO ] [REMOTE ] HYI: Full fetch complete (13985 records). [2025-10-21T19:18:01.616990] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-21T19:18:01.756327] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-21T19:18:02.035013] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-21T19:18:02.035143] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-21T19:18:02.035732] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-21T19:18:02.035802] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-21T19:18:02.036741] [DEBUG] [LOCAL ] HYI: Trimmed 13985 records to 9697 (keeping 200 days of data) [2025-10-21T19:18:02.103413] [DEBUG] [LOCAL ] HYI: Primary data saved (9697 records). [2025-10-21T19:18:02.103616] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-21T19:18:02.103754] [INFO ] [MAIN ] Update Progress: 1074/2366 symbols completed. HYI took 26.2s. Estimated remaining: 2h 45m 58s. Rate: 7.8 symbols/min [2025-10-21T19:18:02.279482] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:18:02.288601] [DEBUG] [LOCAL ] IAE: Loaded 6325 existing records from primary storage. [2025-10-21T19:18:02.288845] [INFO ] [MAIN ] IAE: Loaded 6325 existing records. [2025-10-21T19:18:02.472200] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:18:02.472493] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-21T19:18:02.472542] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-21T19:18:02.472822] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-21T19:18:02.472882] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-21T19:18:02.556522] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-21T19:18:02.878617] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:18:02.895144] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-21T19:18:02.923233] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-21T19:18:03.118082] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T19:18:03.351043] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-21T19:18:04.151059] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-21T19:18:04.734516] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-21T19:18:04.783696] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T19:18:04.789408] [INFO ] [REMOTE ] HYT: Full fetch complete (47888 records). [2025-10-21T19:18:04.789560] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-21T19:18:04.956922] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-21T19:18:05.194256] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-21T19:18:05.194342] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-21T19:18:05.195111] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-21T19:18:05.195173] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-21T19:18:05.196304] [DEBUG] [LOCAL ] HYT: Trimmed 47888 records to 33741 (keeping 200 days of data) [2025-10-21T19:18:05.393864] [DEBUG] [LOCAL ] HYT: Primary data saved (33741 records). [2025-10-21T19:18:05.394010] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-21T19:18:05.394089] [INFO ] [MAIN ] Update Progress: 1075/2366 symbols completed. HYT took 28.0s. Estimated remaining: 2h 45m 45s. Rate: 7.8 symbols/min [2025-10-21T19:18:05.567170] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-21T19:18:05.570923] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:18:05.626429] [DEBUG] [LOCAL ] IAG: Loaded 53491 existing records from primary storage. [2025-10-21T19:18:05.626836] [INFO ] [MAIN ] IAG: Loaded 53491 existing records. [2025-10-21T19:18:05.766342] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-21T19:18:05.814742] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:18:05.815045] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-21T19:18:05.815113] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-21T19:18:05.815423] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-21T19:18:05.815485] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-21T19:18:06.198240] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:18:06.551406] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-21T19:18:06.933849] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-21T19:18:06.950552] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T19:18:07.351051] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-21T19:18:08.151046] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-21T19:18:08.730773] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T19:18:08.951043] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-21T19:18:09.671272] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-21T19:18:09.751069] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-21T19:18:09.913876] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T19:18:10.373207] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-21T19:18:10.551049] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-21T19:18:11.023332] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-21T19:18:11.351094] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-21T19:18:12.151057] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-21T19:18:12.682140] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-21T19:18:12.807127] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T19:18:12.951035] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-21T19:18:13.628964] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-21T19:18:13.751045] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-21T19:18:14.413757] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-21T19:18:14.414866] [INFO ] [REMOTE ] HYTR: Full fetch complete (4678 records). [2025-10-21T19:18:14.414932] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-21T19:18:14.556172] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-21T19:18:14.783772] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-21T19:18:14.783864] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-21T19:18:14.784018] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-21T19:18:14.784076] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-21T19:18:14.784433] [DEBUG] [LOCAL ] HYTR: Trimmed 4678 records to 3074 (keeping 200 days of data) [2025-10-21T19:18:14.802734] [DEBUG] [LOCAL ] HYTR: Primary data saved (3074 records). [2025-10-21T19:18:14.802796] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-21T19:18:14.802862] [INFO ] [MAIN ] Update Progress: 1076/2366 symbols completed. HYTR took 35.8s. Estimated remaining: 2h 45m 40s. Rate: 7.8 symbols/min [2025-10-21T19:18:14.969790] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:18:15.021340] [DEBUG] [LOCAL ] IBM: Loaded 53629 existing records from primary storage. [2025-10-21T19:18:15.021629] [INFO ] [MAIN ] IBM: Loaded 53629 existing records. [2025-10-21T19:18:15.199982] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:18:15.200198] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-21T19:18:15.200268] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-21T19:18:15.200499] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-21T19:18:15.200556] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-21T19:18:15.308067] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-21T19:18:15.358800] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-21T19:18:15.571164] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:18:16.064090] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-21T19:18:16.151021] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-21T19:18:16.951038] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-21T19:18:17.751038] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-21T19:18:18.039131] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-21T19:18:18.190872] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-21T19:18:18.551037] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-21T19:18:18.746153] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T19:18:19.155815] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-21T19:18:19.351011] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-21T19:18:20.150998] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-21T19:18:20.951045] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-21T19:18:21.195028] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-21T19:18:21.743951] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-21T19:18:21.750968] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-21T19:18:21.988218] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T19:18:22.552273] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-21T19:18:22.554931] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T19:18:22.556998] [INFO ] [REMOTE ] IAE: Full fetch complete (9022 records). [2025-10-21T19:18:22.557076] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-21T19:18:22.920485] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-21T19:18:22.920559] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-21T19:18:22.920804] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-21T19:18:22.920865] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-21T19:18:22.921267] [DEBUG] [LOCAL ] IAE: Trimmed 9022 records to 6338 (keeping 200 days of data) [2025-10-21T19:18:22.976307] [DEBUG] [LOCAL ] IAE: Primary data saved (6338 records). [2025-10-21T19:18:22.976480] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-21T19:18:22.976594] [INFO ] [MAIN ] Update Progress: 1077/2366 symbols completed. IAE took 20.9s. Estimated remaining: 2h 45m 33s. Rate: 7.8 symbols/min [2025-10-21T19:18:23.351029] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-21T19:18:24.151098] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-21T19:18:24.527138] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-21T19:18:24.894681] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-21T19:18:24.951074] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-21T19:18:25.751073] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-21T19:18:25.854363] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T19:18:26.034119] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-21T19:18:26.551028] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-21T19:18:27.351009] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-21T19:18:27.806522] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-21T19:18:27.911820] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-21T19:18:28.151033] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-21T19:18:28.950995] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-21T19:18:29.160053] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T19:18:29.420905] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T19:18:29.751021] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-21T19:18:30.551017] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-21T19:18:30.654353] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T19:18:31.351095] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-21T19:18:31.532723] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T19:18:31.852409] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T19:18:32.151002] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-21T19:18:32.951022] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-21T19:18:33.056453] [DEBUG] [REMOTE ] HZO: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-21T19:18:33.056777] [WARN ] [REMOTE ] HZO: No data returned for month 2025-10 [2025-10-21T19:18:33.056867] [FATAL] [REMOTE ] HZO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:18:33.056984] [FATAL] [MAIN ] HZO: Failed to fetch primary data. [2025-10-21T19:18:33.057051] [WARN ] [MAIN ] HZO: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:18:33.057119] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-21T19:18:33.057182] [DEBUG] [LOCAL ] HZO: No primary data file found to delete. [2025-10-21T19:18:33.057218] [INFO ] [LOCAL ] HZO: Starting deletion of derivative data. [2025-10-21T19:18:33.057371] [DEBUG] [LOCAL ] HZO: Deleted derivative data file. [2025-10-21T19:18:33.057453] [INFO ] [MAIN ] Update Progress: 1078/2366 symbols completed. HZO took 33.2s. Estimated remaining: 2h 45m 28s. Rate: 7.8 symbols/min [2025-10-21T19:18:33.398691] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-21T19:18:33.751006] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-21T19:18:34.151257] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-21T19:18:34.551083] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-21T19:18:35.979845] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-21T19:18:35.991603] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-21T19:18:36.400207] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T19:18:36.412257] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-21T19:18:38.379574] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-21T19:18:38.391072] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-21T19:18:38.451069] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-21T19:18:38.462322] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-21T19:18:40.062323] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T19:18:40.070840] [INFO ] [REMOTE ] IAG: Full fetch complete (77503 records). [2025-10-21T19:18:40.070992] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-21T19:18:40.467017] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-21T19:18:40.467095] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-21T19:18:40.468082] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-21T19:18:40.468146] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-21T19:18:40.469484] [DEBUG] [LOCAL ] IAG: Trimmed 77503 records to 53492 (keeping 200 days of data) [2025-10-21T19:18:40.772432] [DEBUG] [LOCAL ] IAG: Primary data saved (53492 records). [2025-10-21T19:18:40.772674] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-21T19:18:40.773465] [INFO ] [MAIN ] Update Progress: 1079/2366 symbols completed. IAG took 35.4s. Estimated remaining: 2h 45m 20s. Rate: 7.8 symbols/min [2025-10-21T19:18:40.853120] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-21T19:18:40.864543] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-21T19:18:41.800223] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T19:18:41.809260] [INFO ] [REMOTE ] IBM: Full fetch complete (77739 records). [2025-10-21T19:18:41.809415] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-21T19:18:42.195209] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-21T19:18:42.195291] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-21T19:18:42.196270] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-21T19:18:42.196336] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-21T19:18:42.197958] [DEBUG] [LOCAL ] IBM: Trimmed 77739 records to 53628 (keeping 200 days of data) [2025-10-21T19:18:42.526026] [DEBUG] [LOCAL ] IBM: Primary data saved (53628 records). [2025-10-21T19:18:42.526158] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-21T19:18:42.526233] [INFO ] [MAIN ] Update Progress: 1080/2366 symbols completed. IBM took 27.7s. Estimated remaining: 2h 45m 5s. Rate: 7.8 symbols/min [2025-10-21T19:18:43.148791] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:18:43.225137] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:18:43.222962] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:18:43.278206] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:18:43.358038] [DEBUG] [LOCAL ] IBTA: Loaded 36338 existing records from primary storage. [2025-10-21T19:18:43.360445] [INFO ] [MAIN ] IBTA: Loaded 36338 existing records. [2025-10-21T19:18:43.359217] [DEBUG] [LOCAL ] IBP: Loaded 28823 existing records from primary storage. [2025-10-21T19:18:43.412304] [INFO ] [MAIN ] IBP: Loaded 28823 existing records. [2025-10-21T19:18:43.424631] [DEBUG] [LOCAL ] IBN: Loaded 52844 existing records from primary storage. [2025-10-21T19:18:43.491147] [INFO ] [MAIN ] IBN: Loaded 52844 existing records. [2025-10-21T19:18:43.684357] [DEBUG] [LOCAL ] ICE: Loaded 53012 existing records from primary storage. [2025-10-21T19:18:43.742828] [INFO ] [MAIN ] ICE: Loaded 53012 existing records. [2025-10-21T19:18:43.978490] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:18:44.110612] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:18:44.110796] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-21T19:18:44.114414] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:18:44.120596] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-21T19:18:44.120849] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-21T19:18:44.121192] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-21T19:18:44.121260] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-21T19:18:44.155692] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-21T19:18:44.155918] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-21T19:18:44.196809] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:18:44.183962] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-21T19:18:44.197216] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-21T19:18:44.197119] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-21T19:18:44.197443] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-21T19:18:44.197595] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-21T19:18:44.208209] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-21T19:18:44.273903] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-21T19:18:44.447033] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-21T19:18:44.457528] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-21T19:18:45.523753] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:18:45.596873] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-21T19:18:45.723028] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:18:45.709581] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:18:45.763694] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-21T19:18:45.757545] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-21T19:18:45.797374] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:18:45.797971] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-21T19:18:46.898474] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T19:18:46.904135] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-21T19:18:46.982864] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T19:18:46.988876] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-21T19:18:47.411557] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T19:18:47.422618] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-21T19:18:47.639551] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T19:18:47.653398] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-21T19:18:47.789425] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T19:18:47.795590] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-21T19:18:48.118341] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T19:18:48.123440] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-21T19:18:48.774976] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T19:18:48.786345] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-21T19:18:48.900073] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T19:18:48.906751] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-21T19:18:49.394741] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T19:18:49.405141] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-21T19:18:49.712009] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T19:18:49.751001] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-21T19:18:50.156038] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T19:18:50.216717] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T19:18:50.551029] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-21T19:18:50.920270] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-21T19:18:51.335622] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-21T19:18:51.350987] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-21T19:18:51.773449] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-21T19:18:52.151022] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-21T19:18:52.787682] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-21T19:18:52.951010] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-21T19:18:53.751050] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-21T19:18:53.974971] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T19:18:54.189495] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-21T19:18:54.551021] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-21T19:18:55.350993] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-21T19:18:55.409257] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T19:18:56.151008] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-21T19:18:56.461103] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-21T19:18:56.495884] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T19:18:56.951041] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-21T19:18:57.756111] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-21T19:18:57.774993] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-21T19:18:58.553848] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-21T19:18:58.555506] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T19:18:59.047066] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T19:18:59.351005] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-21T19:19:00.151038] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-21T19:19:00.283398] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T19:19:00.710753] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T19:19:00.951035] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-21T19:19:01.751020] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-21T19:19:02.200514] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-21T19:19:02.235886] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T19:19:02.551075] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-21T19:19:03.351054] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-21T19:19:03.874937] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-21T19:19:04.151024] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-21T19:19:04.479152] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-21T19:19:04.906259] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T19:19:04.950982] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-21T19:19:05.751021] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-21T19:19:05.913708] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T19:19:06.124302] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T19:19:06.551068] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-21T19:19:07.351028] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-21T19:19:07.633564] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T19:19:08.151066] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-21T19:19:08.279277] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T19:19:08.614611] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-21T19:19:08.951039] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-21T19:19:09.751007] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-21T19:19:10.114782] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T19:19:10.123852] [INFO ] [REMOTE ] ICE: Full fetch complete (76996 records). [2025-10-21T19:19:10.124029] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-21T19:19:10.436308] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T19:19:10.503832] [INFO ] [REMOTE ] IBP: Full fetch complete (41129 records). [2025-10-21T19:19:10.531392] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-21T19:19:10.570203] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-21T19:19:10.872599] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-21T19:19:10.888550] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-21T19:19:10.890324] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-21T19:19:10.890433] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-21T19:19:10.960736] [DEBUG] [LOCAL ] ICE: Trimmed 76996 records to 53011 (keeping 200 days of data) [2025-10-21T19:19:11.326062] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-21T19:19:11.326790] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-21T19:19:11.333105] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-21T19:19:11.333685] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-21T19:19:11.343006] [DEBUG] [LOCAL ] IBP: Trimmed 41129 records to 28797 (keeping 200 days of data) [2025-10-21T19:19:11.509125] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-21T19:19:11.635804] [INFO ] [REMOTE ] IBN: Full fetch complete (76627 records). [2025-10-21T19:19:11.639670] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-21T19:19:11.970894] [DEBUG] [LOCAL ] ICE: Primary data saved (53011 records). [2025-10-21T19:19:11.987316] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-21T19:19:12.011507] [INFO ] [MAIN ] Update Progress: 1081/2366 symbols completed. ICE took 29.5s. Estimated remaining: 2h 45m 23s. Rate: 7.8 symbols/min [2025-10-21T19:19:12.052544] [DEBUG] [LOCAL ] IBP: Primary data saved (28797 records). [2025-10-21T19:19:12.090608] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-21T19:19:12.143795] [INFO ] [MAIN ] Update Progress: 1082/2366 symbols completed. IBP took 29.6s. Estimated remaining: 2h 45m 7s. Rate: 7.8 symbols/min [2025-10-21T19:19:12.285463] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T19:19:12.482878] [INFO ] [REMOTE ] IBTA: Full fetch complete (51200 records). [2025-10-21T19:19:12.524820] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-21T19:19:12.694909] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:19:12.742731] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-21T19:19:12.796037] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:19:12.811793] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-21T19:19:12.827516] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-21T19:19:12.828098] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-21T19:19:12.890566] [DEBUG] [LOCAL ] IBN: Trimmed 76627 records to 52838 (keeping 200 days of data) [2025-10-21T19:19:13.073760] [DEBUG] [LOCAL ] ICL: Loaded 38359 existing records from primary storage. [2025-10-21T19:19:13.132053] [INFO ] [MAIN ] ICL: Loaded 38359 existing records. [2025-10-21T19:19:13.396059] [DEBUG] [LOCAL ] IDA: Loaded 32795 existing records from primary storage. [2025-10-21T19:19:13.440489] [INFO ] [MAIN ] IDA: Loaded 32795 existing records. [2025-10-21T19:19:13.575760] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-21T19:19:13.584733] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-21T19:19:13.585682] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-21T19:19:13.633815] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-21T19:19:13.694563] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:19:13.714159] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-21T19:19:13.754456] [DEBUG] [LOCAL ] IBTA: Trimmed 51200 records to 36220 (keeping 200 days of data) [2025-10-21T19:19:13.754301] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-21T19:19:13.768536] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-21T19:19:13.786927] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-21T19:19:13.881923] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:19:13.958615] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-21T19:19:14.006863] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-21T19:19:14.012133] [DEBUG] [LOCAL ] IBN: Primary data saved (52838 records). [2025-10-21T19:19:14.034886] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-21T19:19:14.035082] [INFO ] [MAIN ] Update Progress: 1083/2366 symbols completed. IBN took 31.5s. Estimated remaining: 2h 44m 52s. Rate: 7.8 symbols/min [2025-10-21T19:19:14.075561] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-21T19:19:14.125469] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-21T19:19:14.367357] [DEBUG] [LOCAL ] IBTA: Primary data saved (36220 records). [2025-10-21T19:19:14.421067] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-21T19:19:14.521498] [INFO ] [MAIN ] Update Progress: 1084/2366 symbols completed. IBTA took 32.0s. Estimated remaining: 2h 44m 36s. Rate: 7.8 symbols/min [2025-10-21T19:19:14.704467] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:19:15.015848] [DEBUG] [LOCAL ] IDE: Loaded 9091 existing records from primary storage. [2025-10-21T19:19:15.101586] [INFO ] [MAIN ] IDE: Loaded 9091 existing records. [2025-10-21T19:19:15.128959] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:19:15.134129] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:19:15.148547] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-21T19:19:15.195617] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:19:15.221404] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-21T19:19:15.367249] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:19:15.367410] [DEBUG] [LOCAL ] IDT: Loaded 18522 existing records from primary storage. [2025-10-21T19:19:15.367829] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-21T19:19:15.368256] [INFO ] [MAIN ] IDT: Loaded 18522 existing records. [2025-10-21T19:19:15.368480] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-21T19:19:15.440411] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-21T19:19:15.452226] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-21T19:19:15.736912] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:19:15.765984] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-21T19:19:15.813723] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-21T19:19:15.870265] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-21T19:19:15.872873] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-21T19:19:16.067032] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:19:16.083365] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-21T19:19:16.365503] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:19:16.365942] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-21T19:19:16.626163] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T19:19:16.632736] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-21T19:19:16.737932] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T19:19:16.745699] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-21T19:19:16.934079] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-21T19:19:16.936806] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-21T19:19:16.964535] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-21T19:19:16.967272] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-21T19:19:17.511171] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T19:19:17.590385] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-21T19:19:17.681199] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-21T19:19:17.755489] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-21T19:19:17.760034] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-21T19:19:18.397004] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T19:19:18.551010] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-21T19:19:19.351035] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-21T19:19:19.739375] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-21T19:19:20.151030] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-21T19:19:20.947862] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T19:19:20.949077] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-21T19:19:20.951023] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-21T19:19:21.751047] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-21T19:19:21.945525] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T19:19:22.551199] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-21T19:19:22.551439] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-21T19:19:23.351018] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-21T19:19:23.998962] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-21T19:19:24.151012] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-21T19:19:24.903200] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T19:19:24.950998] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-21T19:19:25.566063] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T19:19:25.751033] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-21T19:19:26.457107] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T19:19:26.551013] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-21T19:19:27.091639] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T19:19:27.261077] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-21T19:19:27.351074] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-21T19:19:28.095564] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-21T19:19:28.151030] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-21T19:19:28.951086] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-21T19:19:29.751054] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-21T19:19:29.895064] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T19:19:30.376120] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T19:19:30.395030] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-21T19:19:30.551044] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-21T19:19:31.351055] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-21T19:19:32.018168] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T19:19:32.151002] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-21T19:19:32.386497] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T19:19:32.951020] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-21T19:19:33.751058] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-21T19:19:33.932518] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T19:19:34.083560] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T19:19:34.550995] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-21T19:19:34.748137] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-21T19:19:35.351032] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-21T19:19:36.006172] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T19:19:36.112782] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T19:19:36.151073] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-21T19:19:36.930117] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-21T19:19:36.950986] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-21T19:19:37.751007] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-21T19:19:37.823403] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T19:19:37.825492] [INFO ] [REMOTE ] IDE: Full fetch complete (12767 records). [2025-10-21T19:19:37.825569] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-21T19:19:38.202784] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-21T19:19:38.202863] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-21T19:19:38.203176] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-21T19:19:38.203217] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-21T19:19:38.203693] [DEBUG] [LOCAL ] IDE: Trimmed 12767 records to 9047 (keeping 200 days of data) [2025-10-21T19:19:38.262780] [DEBUG] [LOCAL ] IDE: Primary data saved (9047 records). [2025-10-21T19:19:38.262907] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-21T19:19:38.263025] [INFO ] [MAIN ] Update Progress: 1085/2366 symbols completed. IDE took 24.2s. Estimated remaining: 2h 44m 47s. Rate: 7.8 symbols/min [2025-10-21T19:19:38.458408] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:19:38.495768] [DEBUG] [LOCAL ] IEX: Loaded 38423 existing records from primary storage. [2025-10-21T19:19:38.496110] [INFO ] [MAIN ] IEX: Loaded 38423 existing records. [2025-10-21T19:19:38.559495] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-21T19:19:38.690871] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:19:38.691083] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-21T19:19:38.691130] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-21T19:19:38.691365] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-21T19:19:38.691404] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-21T19:19:39.057060] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:19:39.144351] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T19:19:39.150336] [INFO ] [REMOTE ] ICL: Full fetch complete (56021 records). [2025-10-21T19:19:39.150448] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-21T19:19:39.356893] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-21T19:19:39.539905] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-21T19:19:39.539982] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-21T19:19:39.540799] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-21T19:19:39.540861] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-21T19:19:39.542015] [DEBUG] [LOCAL ] ICL: Trimmed 56021 records to 38256 (keeping 200 days of data) [2025-10-21T19:19:39.747751] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T19:19:39.774728] [DEBUG] [LOCAL ] ICL: Primary data saved (38256 records). [2025-10-21T19:19:39.774848] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-21T19:19:39.774931] [INFO ] [MAIN ] Update Progress: 1086/2366 symbols completed. ICL took 27.8s. Estimated remaining: 2h 44m 32s. Rate: 7.8 symbols/min [2025-10-21T19:19:39.947585] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:19:39.994371] [DEBUG] [LOCAL ] IFF: Loaded 51225 existing records from primary storage. [2025-10-21T19:19:39.994698] [INFO ] [MAIN ] IFF: Loaded 51225 existing records. [2025-10-21T19:19:40.163111] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-21T19:19:40.167685] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:19:40.168591] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-21T19:19:40.168687] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-21T19:19:40.168912] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-21T19:19:40.168971] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-21T19:19:40.519535] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:19:40.638342] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T19:19:40.951021] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-21T19:19:41.689711] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T19:19:41.750989] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-21T19:19:42.430546] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T19:19:42.435778] [INFO ] [REMOTE ] IDA: Full fetch complete (45381 records). [2025-10-21T19:19:42.435913] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-21T19:19:42.556109] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-21T19:19:42.819420] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-21T19:19:42.819495] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-21T19:19:42.820316] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-21T19:19:42.820386] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-21T19:19:42.821350] [DEBUG] [LOCAL ] IDA: Trimmed 45381 records to 32767 (keeping 200 days of data) [2025-10-21T19:19:43.024051] [DEBUG] [LOCAL ] IDA: Primary data saved (32767 records). [2025-10-21T19:19:43.024255] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-21T19:19:43.024398] [INFO ] [MAIN ] Update Progress: 1087/2366 symbols completed. IDA took 30.8s. Estimated remaining: 2h 44m 19s. Rate: 7.8 symbols/min [2025-10-21T19:19:43.199207] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T19:19:43.216249] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:19:43.241687] [DEBUG] [LOCAL ] IFN: Loaded 18570 existing records from primary storage. [2025-10-21T19:19:43.241909] [INFO ] [MAIN ] IFN: Loaded 18570 existing records. [2025-10-21T19:19:43.356076] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-21T19:19:43.422681] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:19:43.422861] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-21T19:19:43.422907] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-21T19:19:43.423051] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-21T19:19:43.423089] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-21T19:19:43.586615] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T19:19:43.793859] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:19:44.151041] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-21T19:19:44.624258] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-21T19:19:44.951041] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-21T19:19:45.751020] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-21T19:19:45.814091] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T19:19:46.122880] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T19:19:46.551024] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-21T19:19:47.341921] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T19:19:47.350974] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-21T19:19:47.708533] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T19:19:48.151024] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-21T19:19:48.897773] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T19:19:48.950991] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-21T19:19:49.602284] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T19:19:49.751024] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-21T19:19:50.293223] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T19:19:50.551034] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-21T19:19:51.350991] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-21T19:19:51.508755] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T19:19:51.582639] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T19:19:52.151036] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-21T19:19:52.538799] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T19:19:52.951032] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-21T19:19:53.751007] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-21T19:19:53.973601] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T19:19:54.153508] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T19:19:54.157474] [INFO ] [REMOTE ] IDT: Full fetch complete (24004 records). [2025-10-21T19:19:54.157547] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-21T19:19:54.515536] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-21T19:19:54.515607] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-21T19:19:54.516097] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-21T19:19:54.516155] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-21T19:19:54.516767] [DEBUG] [LOCAL ] IDT: Trimmed 24004 records to 18558 (keeping 200 days of data) [2025-10-21T19:19:54.564243] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-21T19:19:54.628508] [DEBUG] [LOCAL ] IDT: Primary data saved (18558 records). [2025-10-21T19:19:54.628619] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-21T19:19:54.628724] [INFO ] [MAIN ] Update Progress: 1088/2366 symbols completed. IDT took 40.1s. Estimated remaining: 2h 44m 16s. Rate: 7.8 symbols/min [2025-10-21T19:19:54.803322] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:19:54.825168] [DEBUG] [LOCAL ] IFS: Loaded 22330 existing records from primary storage. [2025-10-21T19:19:54.825396] [INFO ] [MAIN ] IFS: Loaded 22330 existing records. [2025-10-21T19:19:55.004000] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:19:55.004419] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-21T19:19:55.004465] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-21T19:19:55.004686] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-21T19:19:55.004743] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-21T19:19:55.366388] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:19:55.360590] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-21T19:19:55.390299] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T19:19:55.713925] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-21T19:19:56.151066] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-21T19:19:56.950992] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-21T19:19:57.294915] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T19:19:57.371522] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T19:19:57.529178] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-21T19:19:57.751000] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-21T19:19:58.551043] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-21T19:19:58.822635] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-21T19:19:59.351020] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-21T19:20:00.094223] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T19:20:00.151013] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-21T19:20:00.211221] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-21T19:20:00.951069] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-21T19:20:01.751000] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-21T19:20:01.943224] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T19:20:02.153412] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-21T19:20:02.551071] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-21T19:20:02.848782] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T19:20:03.351051] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-21T19:20:03.375079] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-21T19:20:04.151047] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-21T19:20:04.423507] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T19:20:04.951199] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-21T19:20:05.373432] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T19:20:05.750999] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-21T19:20:06.551037] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-21T19:20:06.625873] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T19:20:06.817985] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-21T19:20:07.351047] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-21T19:20:08.075712] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-21T19:20:08.081361] [INFO ] [REMOTE ] IEX: Full fetch complete (53850 records). [2025-10-21T19:20:08.081501] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-21T19:20:08.151504] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-21T19:20:08.468879] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-21T19:20:08.469064] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-21T19:20:08.470036] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-21T19:20:08.470117] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-21T19:20:08.486829] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T19:20:08.486940] [DEBUG] [LOCAL ] IEX: Trimmed 53850 records to 38376 (keeping 200 days of data) [2025-10-21T19:20:08.726190] [DEBUG] [LOCAL ] IEX: Primary data saved (38376 records). [2025-10-21T19:20:08.726317] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-21T19:20:08.727236] [INFO ] [MAIN ] Update Progress: 1089/2366 symbols completed. IEX took 30.5s. Estimated remaining: 2h 44m 16s. Rate: 7.8 symbols/min [2025-10-21T19:20:08.901753] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:20:08.912987] [DEBUG] [LOCAL ] IGA: Loaded 10268 existing records from primary storage. [2025-10-21T19:20:08.913249] [INFO ] [MAIN ] IGA: Loaded 10268 existing records. [2025-10-21T19:20:08.956224] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-21T19:20:09.094981] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:20:09.095154] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-21T19:20:09.095221] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-21T19:20:09.095411] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-21T19:20:09.095468] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-21T19:20:09.453293] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:20:09.751035] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-21T19:20:09.991960] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T19:20:10.030070] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T19:20:10.216132] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-21T19:20:10.551035] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-21T19:20:11.172374] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-21T19:20:11.351063] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-21T19:20:12.070723] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-21T19:20:12.151031] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-21T19:20:12.951023] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-21T19:20:13.194951] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-21T19:20:13.751005] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-21T19:20:13.937354] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T19:20:13.940635] [INFO ] [REMOTE ] IFN: Full fetch complete (28367 records). [2025-10-21T19:20:13.940731] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-21T19:20:14.299540] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-21T19:20:14.299612] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-21T19:20:14.300170] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-21T19:20:14.300228] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-21T19:20:14.300899] [DEBUG] [LOCAL ] IFN: Trimmed 28367 records to 18608 (keeping 200 days of data) [2025-10-21T19:20:14.412810] [DEBUG] [LOCAL ] IFN: Primary data saved (18608 records). [2025-10-21T19:20:14.412938] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-21T19:20:14.413025] [INFO ] [MAIN ] Update Progress: 1090/2366 symbols completed. IFN took 31.4s. Estimated remaining: 2h 44m 6s. Rate: 7.8 symbols/min [2025-10-21T19:20:14.560953] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-21T19:20:14.586235] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:20:14.604308] [DEBUG] [LOCAL ] IGD: Loaded 19266 existing records from primary storage. [2025-10-21T19:20:14.604512] [INFO ] [MAIN ] IGD: Loaded 19266 existing records. [2025-10-21T19:20:14.781346] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:20:14.781619] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-21T19:20:14.781699] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-21T19:20:14.781912] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-21T19:20:14.781968] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-21T19:20:14.971031] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-21T19:20:15.155694] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:20:15.351023] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-21T19:20:16.149723] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-21T19:20:16.153696] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-21T19:20:16.698415] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T19:20:16.951001] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-21T19:20:17.195638] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T19:20:17.751035] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-21T19:20:18.550988] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-21T19:20:18.647824] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-21T19:20:18.715181] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-21T19:20:18.723539] [INFO ] [REMOTE ] IFF: Full fetch complete (73727 records). [2025-10-21T19:20:18.723690] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-21T19:20:19.120900] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-21T19:20:19.120976] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-21T19:20:19.122021] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-21T19:20:19.122084] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-21T19:20:19.123448] [DEBUG] [LOCAL ] IFF: Trimmed 73727 records to 51226 (keeping 200 days of data) [2025-10-21T19:20:19.363805] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-21T19:20:19.371551] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T19:20:19.489165] [DEBUG] [LOCAL ] IFF: Primary data saved (51226 records). [2025-10-21T19:20:19.489309] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-21T19:20:19.489399] [INFO ] [MAIN ] Update Progress: 1091/2366 symbols completed. IFF took 39.7s. Estimated remaining: 2h 43m 55s. Rate: 7.8 symbols/min [2025-10-21T19:20:19.684176] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:20:19.690503] [DEBUG] [LOCAL ] IGI: Loaded 4077 existing records from primary storage. [2025-10-21T19:20:19.690700] [INFO ] [MAIN ] IGI: Loaded 4077 existing records. [2025-10-21T19:20:19.874103] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:20:19.874331] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-21T19:20:19.874378] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-21T19:20:19.874543] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-21T19:20:19.874599] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-21T19:20:20.159420] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-21T19:20:20.283697] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:20:20.519353] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T19:20:20.524908] [INFO ] [REMOTE ] IFS: Full fetch complete (32273 records). [2025-10-21T19:20:20.525100] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-21T19:20:20.956181] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-21T19:20:20.946274] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T19:20:21.103217] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-21T19:20:21.103312] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-21T19:20:21.104052] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-21T19:20:21.104121] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-21T19:20:21.105260] [DEBUG] [LOCAL ] IFS: Trimmed 32273 records to 22267 (keeping 200 days of data) [2025-10-21T19:20:21.246784] [DEBUG] [LOCAL ] IFS: Primary data saved (22267 records). [2025-10-21T19:20:21.246925] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-21T19:20:21.247010] [INFO ] [MAIN ] Update Progress: 1092/2366 symbols completed. IFS took 26.6s. Estimated remaining: 2h 43m 40s. Rate: 7.8 symbols/min [2025-10-21T19:20:21.456303] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:20:21.457369] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-21T19:20:21.492215] [DEBUG] [LOCAL ] IGR: Loaded 30502 existing records from primary storage. [2025-10-21T19:20:21.492518] [INFO ] [MAIN ] IGR: Loaded 30502 existing records. [2025-10-21T19:20:21.670344] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:20:21.670571] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-21T19:20:21.670618] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-21T19:20:21.670866] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-21T19:20:21.670923] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-21T19:20:21.756255] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-21T19:20:22.025993] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:20:22.231316] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-21T19:20:22.551073] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-21T19:20:23.153681] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-21T19:20:23.351004] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-21T19:20:23.896256] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-21T19:20:24.151053] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-21T19:20:24.688420] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-21T19:20:24.951031] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-21T19:20:25.528121] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-21T19:20:25.751044] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-21T19:20:26.551097] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-21T19:20:26.986257] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T19:20:27.292813] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-21T19:20:27.351018] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-21T19:20:27.985945] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-21T19:20:28.151036] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-21T19:20:28.774235] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-21T19:20:28.951058] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-21T19:20:29.751018] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-21T19:20:30.015010] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T19:20:30.551043] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-21T19:20:31.007569] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T19:20:31.238157] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-21T19:20:31.351002] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-21T19:20:32.151009] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-21T19:20:32.307754] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T19:20:32.876299] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-21T19:20:32.950993] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-21T19:20:33.735767] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-21T19:20:33.751019] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-21T19:20:34.551012] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-21T19:20:34.964541] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T19:20:35.351031] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-21T19:20:35.551756] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-21T19:20:36.108074] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-21T19:20:36.109580] [INFO ] [REMOTE ] IGI: Full fetch complete (5507 records). [2025-10-21T19:20:36.109670] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-21T19:20:36.156155] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-21T19:20:36.479777] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-21T19:20:36.479866] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-21T19:20:36.480054] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-21T19:20:36.480104] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-21T19:20:36.480479] [DEBUG] [LOCAL ] IGI: Trimmed 5507 records to 4074 (keeping 200 days of data) [2025-10-21T19:20:36.504671] [DEBUG] [LOCAL ] IGI: Primary data saved (4074 records). [2025-10-21T19:20:36.504749] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-21T19:20:36.504819] [INFO ] [MAIN ] Update Progress: 1093/2366 symbols completed. IGI took 17.0s. Estimated remaining: 2h 43m 41s. Rate: 7.8 symbols/min [2025-10-21T19:20:36.675512] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:20:36.680366] [DEBUG] [LOCAL ] IH: Loaded 2768 existing records from primary storage. [2025-10-21T19:20:36.680531] [INFO ] [MAIN ] IH: Loaded 2768 existing records. [2025-10-21T19:20:36.855039] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:20:36.855219] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-21T19:20:36.855285] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-21T19:20:36.855419] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-21T19:20:36.855458] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-21T19:20:36.956538] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-21T19:20:37.238952] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:20:37.532508] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T19:20:37.751053] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-21T19:20:37.797670] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-21T19:20:38.551062] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-21T19:20:38.969109] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-21T19:20:39.123023] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T19:20:39.351017] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-21T19:20:40.151000] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-21T19:20:40.529499] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T19:20:40.951070] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-21T19:20:41.313127] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T19:20:41.551263] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-21T19:20:41.751015] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-21T19:20:42.470911] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-21T19:20:42.551039] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-21T19:20:43.351028] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-21T19:20:44.064611] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-21T19:20:44.089947] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T19:20:44.151007] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-21T19:20:44.951052] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-21T19:20:45.195966] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T19:20:45.198417] [INFO ] [REMOTE ] IGA: Full fetch complete (14360 records). [2025-10-21T19:20:45.198487] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-21T19:20:45.555861] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-21T19:20:45.565398] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-21T19:20:45.565503] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-21T19:20:45.567570] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-21T19:20:45.567670] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-21T19:20:45.568239] [DEBUG] [LOCAL ] IGA: Trimmed 14360 records to 10213 (keeping 200 days of data) [2025-10-21T19:20:45.629342] [DEBUG] [LOCAL ] IGA: Primary data saved (10213 records). [2025-10-21T19:20:45.629469] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-21T19:20:45.629548] [INFO ] [MAIN ] Update Progress: 1094/2366 symbols completed. IGA took 36.9s. Estimated remaining: 2h 43m 35s. Rate: 7.8 symbols/min [2025-10-21T19:20:45.756188] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-21T19:20:45.815173] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:20:45.824370] [DEBUG] [LOCAL ] IHD: Loaded 7362 existing records from primary storage. [2025-10-21T19:20:45.824546] [INFO ] [MAIN ] IHD: Loaded 7362 existing records. [2025-10-21T19:20:46.008860] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:20:46.009059] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-21T19:20:46.009114] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-21T19:20:46.009275] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-21T19:20:46.009313] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-21T19:20:46.254733] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-21T19:20:46.377029] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:20:46.551069] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-21T19:20:47.351012] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-21T19:20:47.615980] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-21T19:20:47.853624] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-21T19:20:48.151018] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-21T19:20:48.821426] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-21T19:20:48.951023] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-21T19:20:49.428547] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-21T19:20:49.751025] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-21T19:20:50.243882] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-21T19:20:50.551034] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-21T19:20:51.351039] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-21T19:20:51.531138] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-21T19:20:51.961719] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-21T19:20:51.962745] [INFO ] [REMOTE ] IH: Full fetch complete (5043 records). [2025-10-21T19:20:51.962816] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-21T19:20:52.156246] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-21T19:20:52.323165] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-21T19:20:52.323238] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-21T19:20:52.323383] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-21T19:20:52.323424] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-21T19:20:52.323798] [DEBUG] [LOCAL ] IH: Trimmed 5043 records to 2764 (keeping 200 days of data) [2025-10-21T19:20:52.339077] [DEBUG] [LOCAL ] IH: Primary data saved (2764 records). [2025-10-21T19:20:52.339148] [INFO ] [MAIN ] IH: Full history saved. [2025-10-21T19:20:52.339220] [INFO ] [MAIN ] Update Progress: 1095/2366 symbols completed. IH took 15.8s. Estimated remaining: 2h 43m 26s. Rate: 7.8 symbols/min [2025-10-21T19:20:52.506757] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:20:52.531234] [DEBUG] [LOCAL ] IHG: Loaded 24215 existing records from primary storage. [2025-10-21T19:20:52.531468] [INFO ] [MAIN ] IHG: Loaded 24215 existing records. [2025-10-21T19:20:52.706573] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:20:52.706803] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-21T19:20:52.706849] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-21T19:20:52.707009] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-21T19:20:52.707047] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-21T19:20:52.957602] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-21T19:20:53.062812] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:20:53.485532] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T19:20:53.751031] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-21T19:20:53.777125] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T19:20:53.780935] [INFO ] [REMOTE ] IGD: Full fetch complete (30118 records). [2025-10-21T19:20:53.781008] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-21T19:20:54.148693] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-21T19:20:54.148777] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-21T19:20:54.149445] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-21T19:20:54.149510] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-21T19:20:54.150281] [DEBUG] [LOCAL ] IGD: Trimmed 30118 records to 19195 (keeping 200 days of data) [2025-10-21T19:20:54.259122] [DEBUG] [LOCAL ] IGD: Primary data saved (19195 records). [2025-10-21T19:20:54.259248] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-21T19:20:54.259320] [INFO ] [MAIN ] Update Progress: 1096/2366 symbols completed. IGD took 39.8s. Estimated remaining: 2h 43m 12s. Rate: 7.8 symbols/min [2025-10-21T19:20:54.428415] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:20:54.463313] [DEBUG] [LOCAL ] IHS: Loaded 37267 existing records from primary storage. [2025-10-21T19:20:54.463578] [INFO ] [MAIN ] IHS: Loaded 37267 existing records. [2025-10-21T19:20:54.556139] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-21T19:20:54.648359] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:20:54.648561] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-21T19:20:54.648609] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-21T19:20:54.648821] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-21T19:20:54.648874] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-21T19:20:54.910628] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-21T19:20:55.029554] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:20:55.351041] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-21T19:20:55.948279] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T19:20:56.156170] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-21T19:20:56.161792] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-21T19:20:56.951071] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-21T19:20:57.288025] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-21T19:20:57.751045] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-21T19:20:58.177907] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T19:20:58.182738] [INFO ] [REMOTE ] IGR: Full fetch complete (44560 records). [2025-10-21T19:20:58.182829] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-21T19:20:58.496158] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-21T19:20:58.554378] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-21T19:20:58.594315] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-21T19:20:58.594395] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-21T19:20:58.595198] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-21T19:20:58.595261] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-21T19:20:58.596367] [DEBUG] [LOCAL ] IGR: Trimmed 44560 records to 30433 (keeping 200 days of data) [2025-10-21T19:20:58.772638] [DEBUG] [LOCAL ] IGR: Primary data saved (30433 records). [2025-10-21T19:20:58.772797] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-21T19:20:58.772874] [INFO ] [MAIN ] Update Progress: 1097/2366 symbols completed. IGR took 37.5s. Estimated remaining: 2h 43m 0s. Rate: 7.8 symbols/min [2025-10-21T19:20:58.949123] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:20:58.956915] [DEBUG] [LOCAL ] IIF: Loaded 5448 existing records from primary storage. [2025-10-21T19:20:58.957113] [INFO ] [MAIN ] IIF: Loaded 5448 existing records. [2025-10-21T19:20:59.142104] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:20:59.142311] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-21T19:20:59.142358] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-21T19:20:59.142493] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-21T19:20:59.142532] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-21T19:20:59.355601] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-21T19:20:59.448574] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-21T19:20:59.533055] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:21:00.150991] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-21T19:21:00.506526] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-21T19:21:00.757703] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-21T19:21:00.951040] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-21T19:21:01.686578] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-21T19:21:01.751019] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-21T19:21:02.551033] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-21T19:21:03.236535] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T19:21:03.274445] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-21T19:21:03.351075] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-21T19:21:04.151004] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-21T19:21:04.552924] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-21T19:21:04.951033] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-21T19:21:05.568589] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-21T19:21:05.666787] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T19:21:05.751066] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-21T19:21:06.551024] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-21T19:21:06.594812] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-21T19:21:07.106605] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-21T19:21:07.351018] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-21T19:21:08.006310] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-21T19:21:08.151029] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-21T19:21:08.951037] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-21T19:21:09.751033] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-21T19:21:10.118374] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-21T19:21:10.259686] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T19:21:10.551087] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-21T19:21:10.879405] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-21T19:21:11.184413] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-21T19:21:11.351013] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-21T19:21:12.023455] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-21T19:21:12.151078] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-21T19:21:12.880546] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-21T19:21:12.951026] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-21T19:21:13.527131] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-21T19:21:13.751066] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-21T19:21:14.551057] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-21T19:21:15.054635] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-21T19:21:15.115093] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-21T19:21:15.351021] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-21T19:21:16.003922] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-21T19:21:16.005370] [INFO ] [REMOTE ] IIF: Full fetch complete (8858 records). [2025-10-21T19:21:16.005459] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-21T19:21:16.156104] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-21T19:21:16.392494] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-21T19:21:16.392584] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-21T19:21:16.392829] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-21T19:21:16.392889] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-21T19:21:16.393281] [DEBUG] [LOCAL ] IIF: Trimmed 8858 records to 5353 (keeping 200 days of data) [2025-10-21T19:21:16.425151] [DEBUG] [LOCAL ] IIF: Primary data saved (5353 records). [2025-10-21T19:21:16.425260] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-21T19:21:16.425332] [INFO ] [MAIN ] Update Progress: 1098/2366 symbols completed. IIF took 17.7s. Estimated remaining: 2h 43m 4s. Rate: 7.8 symbols/min [2025-10-21T19:21:16.603446] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:21:16.621065] [DEBUG] [LOCAL ] IIIN: Loaded 16310 existing records from primary storage. [2025-10-21T19:21:16.621362] [INFO ] [MAIN ] IIIN: Loaded 16310 existing records. [2025-10-21T19:21:16.809450] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:21:16.809665] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-21T19:21:16.809726] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-21T19:21:16.809891] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-21T19:21:16.809948] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-21T19:21:16.956197] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-21T19:21:17.195577] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:21:17.437939] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T19:21:17.729380] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T19:21:17.751002] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-21T19:21:18.182079] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-21T19:21:18.551030] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-21T19:21:19.351010] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-21T19:21:19.464002] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-21T19:21:19.465980] [INFO ] [REMOTE ] IHD: Full fetch complete (11795 records). [2025-10-21T19:21:19.466046] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-21T19:21:19.827848] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-21T19:21:19.827930] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-21T19:21:19.828219] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-21T19:21:19.828257] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-21T19:21:19.828695] [DEBUG] [LOCAL ] IHD: Trimmed 11795 records to 7394 (keeping 200 days of data) [2025-10-21T19:21:19.870797] [DEBUG] [LOCAL ] IHD: Primary data saved (7394 records). [2025-10-21T19:21:19.870938] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-21T19:21:19.871025] [INFO ] [MAIN ] Update Progress: 1099/2366 symbols completed. IHD took 34.2s. Estimated remaining: 2h 42m 51s. Rate: 7.8 symbols/min [2025-10-21T19:21:20.043813] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:21:20.062299] [DEBUG] [LOCAL ] IIM: Loaded 15541 existing records from primary storage. [2025-10-21T19:21:20.062557] [INFO ] [MAIN ] IIM: Loaded 15541 existing records. [2025-10-21T19:21:20.160469] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-21T19:21:20.242881] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:21:20.243073] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-21T19:21:20.243129] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-21T19:21:20.243282] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-21T19:21:20.243318] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-21T19:21:20.597442] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T19:21:20.631750] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:21:20.951030] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-21T19:21:21.371318] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-21T19:21:21.751072] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-21T19:21:22.010831] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T19:21:22.550993] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-21T19:21:22.608830] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T19:21:23.351036] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-21T19:21:24.124105] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T19:21:24.150998] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-21T19:21:24.549400] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-21T19:21:24.951029] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-21T19:21:25.652056] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T19:21:25.751029] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-21T19:21:26.057871] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T19:21:26.551076] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-21T19:21:27.268424] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T19:21:27.351000] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-21T19:21:27.975973] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-21T19:21:27.980474] [INFO ] [REMOTE ] IHG: Full fetch complete (34255 records). [2025-10-21T19:21:27.980731] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-21T19:21:28.156309] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-21T19:21:28.387673] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-21T19:21:28.387759] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-21T19:21:28.388453] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-21T19:21:28.388509] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-21T19:21:28.389236] [DEBUG] [LOCAL ] IHG: Trimmed 34255 records to 24119 (keeping 200 days of data) [2025-10-21T19:21:28.543734] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T19:21:28.556073] [DEBUG] [LOCAL ] IHG: Primary data saved (24119 records). [2025-10-21T19:21:28.556216] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-21T19:21:28.556299] [INFO ] [MAIN ] Update Progress: 1100/2366 symbols completed. IHG took 36.2s. Estimated remaining: 2h 42m 45s. Rate: 7.8 symbols/min [2025-10-21T19:21:28.720764] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:21:28.748322] [DEBUG] [LOCAL ] IIPR: Loaded 29071 existing records from primary storage. [2025-10-21T19:21:28.748592] [INFO ] [MAIN ] IIPR: Loaded 29071 existing records. [2025-10-21T19:21:28.929913] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:21:28.930114] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-21T19:21:28.930160] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-21T19:21:28.930384] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-21T19:21:28.930440] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-21T19:21:28.963043] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-21T19:21:29.320133] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:21:29.338446] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-21T19:21:29.750996] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-21T19:21:29.828941] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-21T19:21:30.551016] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-21T19:21:30.655523] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-21T19:21:31.351089] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-21T19:21:31.559846] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-21T19:21:32.151018] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-21T19:21:32.354466] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-21T19:21:32.951029] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-21T19:21:33.615018] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-21T19:21:33.750992] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-21T19:21:33.843237] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-21T19:21:34.551004] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-21T19:21:34.898877] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-21T19:21:34.903589] [INFO ] [REMOTE ] IHS: Full fetch complete (51568 records). [2025-10-21T19:21:34.903718] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-21T19:21:35.277000] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-21T19:21:35.277075] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-21T19:21:35.277856] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-21T19:21:35.277916] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-21T19:21:35.278951] [DEBUG] [LOCAL ] IHS: Trimmed 51568 records to 37245 (keeping 200 days of data) [2025-10-21T19:21:35.356543] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-21T19:21:35.485782] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-21T19:21:35.510247] [DEBUG] [LOCAL ] IHS: Primary data saved (37245 records). [2025-10-21T19:21:35.510366] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-21T19:21:35.511010] [INFO ] [MAIN ] Update Progress: 1101/2366 symbols completed. IHS took 41.3s. Estimated remaining: 2h 42m 36s. Rate: 7.8 symbols/min [2025-10-21T19:21:35.680932] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:21:35.721272] [DEBUG] [LOCAL ] IMAX: Loaded 43484 existing records from primary storage. [2025-10-21T19:21:35.721546] [INFO ] [MAIN ] IMAX: Loaded 43484 existing records. [2025-10-21T19:21:35.900176] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:21:35.900391] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-21T19:21:35.900447] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-21T19:21:35.900621] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-21T19:21:35.900712] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-21T19:21:36.161418] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-21T19:21:36.161490] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-21T19:21:36.290362] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:21:36.951026] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-21T19:21:37.597040] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-21T19:21:37.684271] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-21T19:21:37.750988] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-21T19:21:38.551013] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-21T19:21:38.684578] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-21T19:21:39.350997] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-21T19:21:39.491608] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T19:21:40.048131] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-21T19:21:40.150996] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-21T19:21:40.951031] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-21T19:21:41.124675] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-21T19:21:41.751049] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-21T19:21:42.501348] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T19:21:42.550985] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-21T19:21:43.147864] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T19:21:43.351000] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-21T19:21:43.758035] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T19:21:43.959882] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-21T19:21:43.962763] [INFO ] [REMOTE ] IIM: Full fetch complete (24933 records). [2025-10-21T19:21:43.962832] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-21T19:21:44.156229] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-21T19:21:44.334149] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-21T19:21:44.334276] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-21T19:21:44.334825] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-21T19:21:44.334886] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-21T19:21:44.335450] [DEBUG] [LOCAL ] IIM: Trimmed 24933 records to 15540 (keeping 200 days of data) [2025-10-21T19:21:44.427029] [DEBUG] [LOCAL ] IIM: Primary data saved (15540 records). [2025-10-21T19:21:44.427152] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-21T19:21:44.427226] [INFO ] [MAIN ] Update Progress: 1102/2366 symbols completed. IIM took 24.6s. Estimated remaining: 2h 42m 30s. Rate: 7.8 symbols/min [2025-10-21T19:21:44.594053] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:21:44.638876] [DEBUG] [LOCAL ] INFA: Loaded 48813 existing records from primary storage. [2025-10-21T19:21:44.639157] [INFO ] [MAIN ] INFA: Loaded 48813 existing records. [2025-10-21T19:21:44.827434] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:21:44.827682] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-21T19:21:44.827766] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-21T19:21:44.828076] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-21T19:21:44.828135] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-21T19:21:44.956112] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-21T19:21:45.202406] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:21:45.402070] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T19:21:45.751021] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-21T19:21:46.181600] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-21T19:21:46.551053] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-21T19:21:47.342066] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T19:21:47.351399] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-21T19:21:48.016870] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T19:21:48.151032] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-21T19:21:48.693334] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T19:21:48.951053] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-21T19:21:49.117057] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T19:21:49.751069] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-21T19:21:50.551063] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-21T19:21:50.587006] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T19:21:50.768046] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-21T19:21:51.351029] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-21T19:21:52.002676] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T19:21:52.151013] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-21T19:21:52.939685] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T19:21:52.950972] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-21T19:21:53.607737] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T19:21:53.751037] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-21T19:21:54.545245] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T19:21:54.555252] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-21T19:21:55.351005] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-21T19:21:55.486793] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T19:21:55.907282] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T19:21:55.912037] [INFO ] [REMOTE ] IIPR: Full fetch complete (43757 records). [2025-10-21T19:21:55.912126] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-21T19:21:56.157972] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-21T19:21:56.288231] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-21T19:21:56.288529] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-21T19:21:56.289314] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-21T19:21:56.289374] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-21T19:21:56.290325] [DEBUG] [LOCAL ] IIPR: Trimmed 43757 records to 28934 (keeping 200 days of data) [2025-10-21T19:21:56.462942] [DEBUG] [LOCAL ] IIPR: Primary data saved (28934 records). [2025-10-21T19:21:56.463060] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-21T19:21:56.463133] [INFO ] [MAIN ] Update Progress: 1103/2366 symbols completed. IIPR took 27.9s. Estimated remaining: 2h 42m 27s. Rate: 7.8 symbols/min [2025-10-21T19:21:56.633157] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:21:56.657368] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T19:21:56.711816] [DEBUG] [LOCAL ] INFY: Loaded 53597 existing records from primary storage. [2025-10-21T19:21:56.712125] [INFO ] [MAIN ] INFY: Loaded 53597 existing records. [2025-10-21T19:21:56.886157] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:21:56.886376] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-21T19:21:56.886425] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-21T19:21:56.886793] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-21T19:21:56.886850] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-21T19:21:56.959743] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-21T19:21:57.240009] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:21:57.751070] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-21T19:21:57.993691] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T19:21:58.000015] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-21T19:21:58.551015] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-21T19:21:59.225740] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T19:21:59.351034] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-21T19:22:00.070455] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T19:22:00.135682] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-21T19:22:00.150993] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-21T19:22:00.951038] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-21T19:22:01.477706] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T19:22:01.480793] [INFO ] [REMOTE ] IIIN: Full fetch complete (24897 records). [2025-10-21T19:22:01.480904] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-21T19:22:01.756235] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-21T19:22:01.862698] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-21T19:22:01.862785] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-21T19:22:01.863302] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-21T19:22:01.863341] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-21T19:22:01.864002] [DEBUG] [LOCAL ] IIIN: Trimmed 24897 records to 16300 (keeping 200 days of data) [2025-10-21T19:22:01.965392] [DEBUG] [LOCAL ] IIIN: Primary data saved (16300 records). [2025-10-21T19:22:01.965568] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-21T19:22:01.965703] [INFO ] [MAIN ] Update Progress: 1104/2366 symbols completed. IIIN took 45.5s. Estimated remaining: 2h 42m 17s. Rate: 7.8 symbols/min [2025-10-21T19:22:02.167365] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:22:02.214366] [DEBUG] [LOCAL ] ING: Loaded 50721 existing records from primary storage. [2025-10-21T19:22:02.214702] [INFO ] [MAIN ] ING: Loaded 50721 existing records. [2025-10-21T19:22:02.389369] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:22:02.389563] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-21T19:22:02.389609] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-21T19:22:02.389912] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-21T19:22:02.389967] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-21T19:22:02.563242] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-21T19:22:02.755484] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:22:02.937567] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-21T19:22:03.351082] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-21T19:22:03.594150] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T19:22:04.151003] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-21T19:22:04.491019] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T19:22:04.956151] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-21T19:22:04.969821] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-21T19:22:05.744439] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T19:22:05.754443] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-21T19:22:06.551008] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-21T19:22:06.663329] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T19:22:07.360840] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-21T19:22:07.370792] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T19:22:08.156249] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-21T19:22:08.181140] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T19:22:08.951006] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-21T19:22:09.041369] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T19:22:09.750990] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-21T19:22:10.019864] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T19:22:10.472369] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T19:22:10.551065] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-21T19:22:11.023516] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T19:22:11.030321] [INFO ] [REMOTE ] INFA: Full fetch complete (70813 records). [2025-10-21T19:22:11.030440] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-21T19:22:11.353441] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-21T19:22:11.448979] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-21T19:22:11.449061] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-21T19:22:11.450091] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-21T19:22:11.450179] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-21T19:22:11.451570] [DEBUG] [LOCAL ] INFA: Trimmed 70813 records to 48721 (keeping 200 days of data) [2025-10-21T19:22:11.740422] [DEBUG] [LOCAL ] INFA: Primary data saved (48721 records). [2025-10-21T19:22:11.740586] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-21T19:22:11.741046] [INFO ] [MAIN ] Update Progress: 1105/2366 symbols completed. INFA took 27.3s. Estimated remaining: 2h 42m 12s. Rate: 7.8 symbols/min [2025-10-21T19:22:11.914276] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:22:11.943509] [DEBUG] [LOCAL ] INGM: Loaded 28268 existing records from primary storage. [2025-10-21T19:22:11.943796] [INFO ] [MAIN ] INGM: Loaded 28268 existing records. [2025-10-21T19:22:12.121313] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:22:12.121517] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-21T19:22:12.121564] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-21T19:22:12.121828] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-21T19:22:12.121885] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-21T19:22:12.153360] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-21T19:22:12.486840] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:22:12.531541] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T19:22:12.951069] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-21T19:22:13.001891] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T19:22:13.008854] [INFO ] [REMOTE ] IMAX: Full fetch complete (60981 records). [2025-10-21T19:22:13.008957] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-21T19:22:13.387557] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-21T19:22:13.387663] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-21T19:22:13.388572] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-21T19:22:13.388634] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-21T19:22:13.389982] [DEBUG] [LOCAL ] IMAX: Trimmed 60981 records to 43469 (keeping 200 days of data) [2025-10-21T19:22:13.642761] [DEBUG] [LOCAL ] IMAX: Primary data saved (43469 records). [2025-10-21T19:22:13.642903] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-21T19:22:13.643478] [INFO ] [MAIN ] Update Progress: 1106/2366 symbols completed. IMAX took 38.1s. Estimated remaining: 2h 41m 57s. Rate: 7.8 symbols/min [2025-10-21T19:22:13.754832] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-21T19:22:13.836835] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:22:13.877977] [DEBUG] [LOCAL ] INGR: Loaded 33774 existing records from primary storage. [2025-10-21T19:22:13.878244] [INFO ] [MAIN ] INGR: Loaded 33774 existing records. [2025-10-21T19:22:14.006997] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T19:22:14.112307] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:22:14.131209] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-21T19:22:14.131358] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-21T19:22:14.133155] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-21T19:22:14.133091] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-21T19:22:14.133275] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-21T19:22:14.548209] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:22:14.550983] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-21T19:22:15.350990] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-21T19:22:15.662421] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T19:22:15.711295] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-21T19:22:16.151032] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-21T19:22:16.848374] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-21T19:22:16.951025] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-21T19:22:17.751057] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-21T19:22:18.089436] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T19:22:18.421175] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-21T19:22:18.551054] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-21T19:22:19.210488] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T19:22:19.351037] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-21T19:22:19.521278] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-21T19:22:20.151097] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-21T19:22:20.951070] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-21T19:22:21.038177] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T19:22:21.538036] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T19:22:21.751020] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-21T19:22:22.193413] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T19:22:22.551036] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-21T19:22:23.351048] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-21T19:22:23.473605] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T19:22:24.005040] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-21T19:22:24.151019] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-21T19:22:24.445405] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T19:22:24.951026] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-21T19:22:25.574170] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T19:22:25.751034] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-21T19:22:26.266820] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-21T19:22:26.551072] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-21T19:22:27.037098] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T19:22:27.351011] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-21T19:22:27.759992] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T19:22:28.151137] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-21T19:22:28.951097] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-21T19:22:29.238880] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-21T19:22:29.541416] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T19:22:29.751197] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-21T19:22:30.551054] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-21T19:22:30.605078] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T19:22:30.852811] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-21T19:22:31.351022] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-21T19:22:31.940670] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-21T19:22:32.151097] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-21T19:22:32.951079] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-21T19:22:33.028120] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T19:22:33.677012] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-21T19:22:33.751024] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-21T19:22:34.551080] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-21T19:22:34.877137] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T19:22:35.246917] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-21T19:22:35.252832] [INFO ] [REMOTE ] INGR: Full fetch complete (50727 records). [2025-10-21T19:22:35.252926] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-21T19:22:35.355139] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-21T19:22:35.643449] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-21T19:22:35.643552] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-21T19:22:35.644451] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-21T19:22:35.644516] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-21T19:22:35.645627] [DEBUG] [LOCAL ] INGR: Trimmed 50727 records to 33761 (keeping 200 days of data) [2025-10-21T19:22:35.858459] [DEBUG] [LOCAL ] INGR: Primary data saved (33761 records). [2025-10-21T19:22:35.858598] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-21T19:22:35.858702] [INFO ] [MAIN ] Update Progress: 1107/2366 symbols completed. INGR took 22.2s. Estimated remaining: 2h 42m 6s. Rate: 7.8 symbols/min [2025-10-21T19:22:36.036543] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:22:36.074034] [DEBUG] [LOCAL ] INN: Loaded 41658 existing records from primary storage. [2025-10-21T19:22:36.074313] [INFO ] [MAIN ] INN: Loaded 41658 existing records. [2025-10-21T19:22:36.154265] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-21T19:22:36.271536] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:22:36.271953] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-21T19:22:36.272039] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-21T19:22:36.272365] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-21T19:22:36.272460] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-21T19:22:36.415535] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T19:22:36.680580] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:22:36.951031] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-21T19:22:37.286748] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-21T19:22:37.382819] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T19:22:37.387556] [INFO ] [REMOTE ] INGM: Full fetch complete (41779 records). [2025-10-21T19:22:37.387710] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-21T19:22:37.756204] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-21T19:22:37.809231] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-21T19:22:37.809337] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-21T19:22:37.810110] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-21T19:22:37.810176] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-21T19:22:37.811532] [DEBUG] [LOCAL ] INGM: Trimmed 41779 records to 28216 (keeping 200 days of data) [2025-10-21T19:22:37.983430] [DEBUG] [LOCAL ] INGM: Primary data saved (28216 records). [2025-10-21T19:22:37.983552] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-21T19:22:37.983629] [INFO ] [MAIN ] Update Progress: 1108/2366 symbols completed. INGM took 26.2s. Estimated remaining: 2h 41m 52s. Rate: 7.8 symbols/min [2025-10-21T19:22:38.155565] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:22:38.155822] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-21T19:22:38.155869] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-21T19:22:38.155982] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-21T19:22:38.156025] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-21T19:22:38.156067] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-21T19:22:38.156101] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-21T19:22:38.440176] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T19:22:38.554725] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:22:38.554863] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-21T19:22:39.351077] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-21T19:22:39.978200] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T19:22:40.151032] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-21T19:22:40.951046] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-10-21T19:22:41.218158] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T19:22:41.283042] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-21T19:22:41.311251] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-21T19:22:41.535047] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (3.78 seconds). [2025-10-21T19:22:41.542821] [INFO ] [REMOTE ] ING: Full fetch complete (73445 records). [2025-10-21T19:22:41.542984] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-21T19:22:41.543825] [FATAL] [VALIDATOR ] ING: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T19:22:41.543919] [FATAL] [MAIN ] ING: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:22:41.543986] [WARN ] [MAIN ] ING: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:22:41.544032] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-21T19:22:41.544128] [DEBUG] [LOCAL ] ING: No primary data file found to delete. [2025-10-21T19:22:41.544176] [INFO ] [LOCAL ] ING: Starting deletion of derivative data. [2025-10-21T19:22:41.544350] [DEBUG] [LOCAL ] ING: Deleted derivative data file. [2025-10-21T19:22:41.545074] [INFO ] [MAIN ] Update Progress: 1109/2366 symbols completed. ING took 39.6s. Estimated remaining: 2h 41m 40s. Rate: 7.8 symbols/min [2025-10-21T19:22:41.718730] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:22:41.759289] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-21T19:22:41.762147] [DEBUG] [LOCAL ] INSP: Loaded 38552 existing records from primary storage. [2025-10-21T19:22:41.762472] [INFO ] [MAIN ] INSP: Loaded 38552 existing records. [2025-10-21T19:22:41.958275] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:22:41.958484] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-21T19:22:41.958533] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-21T19:22:41.959013] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-21T19:22:41.959103] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-21T19:22:42.353228] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:22:42.551045] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-21T19:22:43.351048] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-10-21T19:22:43.830198] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-21T19:22:43.838561] [INFO ] [REMOTE ] INFY: Full fetch complete (77746 records). [2025-10-21T19:22:43.838711] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-21T19:22:44.153598] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-21T19:22:44.248231] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-21T19:22:44.248346] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-21T19:22:44.249551] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-21T19:22:44.249705] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-21T19:22:44.260638] [DEBUG] [LOCAL ] INFY: Trimmed 77746 records to 53596 (keeping 200 days of data) [2025-10-21T19:22:44.278738] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T19:22:44.602559] [DEBUG] [LOCAL ] INFY: Primary data saved (53596 records). [2025-10-21T19:22:44.602728] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-21T19:22:44.602836] [INFO ] [MAIN ] Update Progress: 1110/2366 symbols completed. INFY took 48.1s. Estimated remaining: 2h 41m 27s. Rate: 7.8 symbols/min [2025-10-21T19:22:44.730505] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T19:22:44.798485] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:22:44.834519] [DEBUG] [LOCAL ] INSW: Loaded 39541 existing records from primary storage. [2025-10-21T19:22:44.834809] [INFO ] [MAIN ] INSW: Loaded 39541 existing records. [2025-10-21T19:22:44.956192] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-10-21T19:22:45.012622] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:22:45.012855] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-21T19:22:45.012910] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-21T19:22:45.013125] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-21T19:22:45.013180] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-21T19:22:45.367695] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:22:45.740144] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T19:22:45.750969] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-21T19:22:46.339127] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T19:22:46.551024] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-21T19:22:47.241863] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T19:22:47.351013] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-21T19:22:48.042909] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T19:22:48.151035] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-21T19:22:48.694268] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T19:22:48.951001] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-10-21T19:22:49.712269] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T19:22:49.750983] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-21T19:22:50.089906] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T19:22:50.551042] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-10-21T19:22:51.223453] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T19:22:51.351047] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-21T19:22:51.930881] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-21T19:22:52.151027] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-21T19:22:52.951037] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-21T19:22:53.751093] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-10-21T19:23:05.288618] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (13.94 seconds). [2025-10-21T19:23:05.295851] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-21T19:23:06.709055] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T19:23:06.716346] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-21T19:23:07.320361] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (14.37 seconds). [2025-10-21T19:23:07.329757] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-21T19:23:07.405975] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (13.65 seconds). [2025-10-21T19:23:07.411378] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-10-21T19:23:07.699715] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (15.55 seconds). [2025-10-21T19:23:07.708580] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-21T19:23:08.306199] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-21T19:23:08.313377] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-10-21T19:23:08.806554] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T19:23:08.815188] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-21T19:23:09.137540] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T19:23:09.145681] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-21T19:23:09.589839] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T19:23:09.595902] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-10-21T19:23:10.278532] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (3.56 seconds). [2025-10-21T19:23:10.287294] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-21T19:23:10.425831] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T19:23:10.451002] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-21T19:23:10.452496] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-21T19:23:10.460295] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-10. [2025-10-21T19:23:10.539975] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T19:23:10.545833] [INFO ] [REMOTE ] INN: Full fetch complete (57663 records). [2025-10-21T19:23:10.545987] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-21T19:23:10.930297] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-21T19:23:10.930421] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-21T19:23:10.931446] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-21T19:23:10.931511] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-21T19:23:10.932747] [DEBUG] [LOCAL ] INN: Trimmed 57663 records to 41558 (keeping 200 days of data) [2025-10-21T19:23:11.168718] [DEBUG] [LOCAL ] INN: Primary data saved (41558 records). [2025-10-21T19:23:11.168926] [INFO ] [MAIN ] INN: Full history saved. [2025-10-21T19:23:11.169516] [INFO ] [MAIN ] Update Progress: 1111/2366 symbols completed. INN took 35.3s. Estimated remaining: 2h 41m 40s. Rate: 7.8 symbols/min [2025-10-21T19:23:11.336187] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:23:11.385812] [DEBUG] [LOCAL ] INVH: Loaded 53195 existing records from primary storage. [2025-10-21T19:23:11.386125] [INFO ] [MAIN ] INVH: Loaded 53195 existing records. [2025-10-21T19:23:11.571866] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:23:11.572117] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-21T19:23:11.572223] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-21T19:23:11.572554] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-21T19:23:11.572612] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-21T19:23:11.963859] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-21T19:23:11.984271] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:23:11.990741] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-21T19:23:11.990425] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T19:23:12.001939] [INFO ] [REMOTE ] INR: Full fetch complete (37055 records). [2025-10-21T19:23:12.002675] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-10-21T19:23:12.003301] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-21T19:23:12.201500] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-21T19:23:12.202040] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:23:12.202124] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:23:12.202211] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-21T19:23:12.202454] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-21T19:23:12.202547] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-21T19:23:12.202663] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-21T19:23:12.202758] [INFO ] [MAIN ] Update Progress: 1112/2366 symbols completed. INR took 34.2s. Estimated remaining: 2h 41m 25s. Rate: 7.8 symbols/min [2025-10-21T19:23:12.332322] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-21T19:23:12.363555] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-21T19:23:12.413489] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:23:12.442302] [DEBUG] [LOCAL ] INVX: Loaded 29241 existing records from primary storage. [2025-10-21T19:23:12.442543] [INFO ] [MAIN ] INVX: Loaded 29241 existing records. [2025-10-21T19:23:12.614579] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:23:12.614772] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-21T19:23:12.614822] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-21T19:23:12.615002] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-21T19:23:12.615059] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-21T19:23:12.957407] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:23:12.957622] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-21T19:23:13.765407] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T19:23:13.776110] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-21T19:23:13.820295] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T19:23:13.829372] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-21T19:23:13.876847] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T19:23:13.886817] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-21T19:23:14.261460] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T19:23:14.268232] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-21T19:23:15.070372] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T19:23:15.080364] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-21T19:23:15.380297] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T19:23:15.389005] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-21T19:23:15.479951] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-21T19:23:15.486583] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-21T19:23:15.516559] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T19:23:15.527778] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-21T19:23:16.408292] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-21T19:23:16.414266] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-21T19:23:16.527732] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-21T19:23:16.540584] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-21T19:23:16.824065] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T19:23:16.830913] [INFO ] [REMOTE ] INSP: Full fetch complete (53868 records). [2025-10-21T19:23:16.831056] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-21T19:23:17.178064] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T19:23:17.223536] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-21T19:23:17.257703] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-21T19:23:17.257849] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-21T19:23:17.258629] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-21T19:23:17.258713] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-21T19:23:17.259859] [DEBUG] [LOCAL ] INSP: Trimmed 53868 records to 38568 (keeping 200 days of data) [2025-10-21T19:23:17.486272] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T19:23:17.496920] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-21T19:23:17.523631] [DEBUG] [LOCAL ] INSP: Primary data saved (38568 records). [2025-10-21T19:23:17.523797] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-21T19:23:17.523886] [INFO ] [MAIN ] Update Progress: 1113/2366 symbols completed. INSP took 36.0s. Estimated remaining: 2h 41m 14s. Rate: 7.8 symbols/min [2025-10-21T19:23:17.693480] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:23:17.743512] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-21T19:23:17.743870] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-21T19:23:17.925190] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:23:17.925365] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-21T19:23:17.925410] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-21T19:23:17.925586] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-21T19:23:17.925623] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-21T19:23:18.304989] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:23:18.306200] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-21T19:23:18.339436] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T19:23:18.351343] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-21T19:23:18.741704] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T19:23:18.750204] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-21T19:23:18.780158] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T19:23:19.351015] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-21T19:23:19.702157] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T19:23:20.151984] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T19:23:20.151165] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-21T19:23:20.293379] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-21T19:23:20.541267] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-21T19:23:20.951053] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-21T19:23:21.570194] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T19:23:21.751024] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-21T19:23:22.208440] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T19:23:22.214194] [INFO ] [REMOTE ] INSW: Full fetch complete (59581 records). [2025-10-21T19:23:22.214301] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-21T19:23:22.575013] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-21T19:23:22.595180] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-21T19:23:22.595256] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-21T19:23:22.596184] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-21T19:23:22.596262] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-21T19:23:22.597731] [DEBUG] [LOCAL ] INSW: Trimmed 59581 records to 39351 (keeping 200 days of data) [2025-10-21T19:23:22.833391] [DEBUG] [LOCAL ] INSW: Primary data saved (39351 records). [2025-10-21T19:23:22.833533] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-21T19:23:22.833611] [INFO ] [MAIN ] Update Progress: 1114/2366 symbols completed. INSW took 38.2s. Estimated remaining: 2h 41m 4s. Rate: 7.8 symbols/min [2025-10-21T19:23:23.000706] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:23:23.049099] [DEBUG] [LOCAL ] IOT: Loaded 53478 existing records from primary storage. [2025-10-21T19:23:23.049440] [INFO ] [MAIN ] IOT: Loaded 53478 existing records. [2025-10-21T19:23:23.229975] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:23:23.230216] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-21T19:23:23.230280] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-21T19:23:23.230539] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-21T19:23:23.230618] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-21T19:23:23.351845] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-21T19:23:23.604935] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:23:23.637533] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-21T19:23:24.081087] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T19:23:24.151037] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-21T19:23:24.951085] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-21T19:23:25.391420] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-21T19:23:25.751017] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-21T19:23:25.924275] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T19:23:26.442803] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T19:23:26.550988] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-21T19:23:26.935738] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-21T19:23:27.351019] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-21T19:23:28.151016] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-21T19:23:28.275435] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-21T19:23:28.335208] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-21T19:23:28.951028] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-21T19:23:29.751056] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-21T19:23:29.934200] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T19:23:30.551032] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-21T19:23:31.351012] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-21T19:23:31.540515] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T19:23:31.617671] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-21T19:23:31.921261] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T19:23:31.930162] [INFO ] [REMOTE ] INVH: Full fetch complete (76970 records). [2025-10-21T19:23:31.930314] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-21T19:23:32.156577] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-21T19:23:32.390765] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-21T19:23:32.390867] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-21T19:23:32.391973] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-21T19:23:32.392045] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-21T19:23:32.393611] [DEBUG] [LOCAL ] INVH: Trimmed 76970 records to 53194 (keeping 200 days of data) [2025-10-21T19:23:32.651427] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T19:23:32.672177] [INFO ] [REMOTE ] INVX: Full fetch complete (42847 records). [2025-10-21T19:23:32.676532] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-21T19:23:32.880573] [DEBUG] [LOCAL ] INVH: Primary data saved (53194 records). [2025-10-21T19:23:32.905832] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-21T19:23:32.906424] [INFO ] [MAIN ] Update Progress: 1115/2366 symbols completed. INVH took 21.7s. Estimated remaining: 2h 40m 59s. Rate: 7.8 symbols/min [2025-10-21T19:23:32.955435] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-21T19:23:33.326299] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:23:33.365900] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-21T19:23:33.366077] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-21T19:23:33.367132] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-21T19:23:33.367334] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-21T19:23:33.368870] [DEBUG] [LOCAL ] INVX: Trimmed 42847 records to 29141 (keeping 200 days of data) [2025-10-21T19:23:33.580945] [DEBUG] [LOCAL ] IP: Loaded 53306 existing records from primary storage. [2025-10-21T19:23:33.584573] [DEBUG] [LOCAL ] INVX: Primary data saved (29141 records). [2025-10-21T19:23:33.585423] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-21T19:23:33.585695] [INFO ] [MAIN ] Update Progress: 1116/2366 symbols completed. INVX took 21.4s. Estimated remaining: 2h 40m 43s. Rate: 7.8 symbols/min [2025-10-21T19:23:33.591100] [INFO ] [MAIN ] IP: Loaded 53306 existing records. [2025-10-21T19:23:33.970118] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:23:33.981864] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:23:33.982164] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-21T19:23:33.982226] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-21T19:23:33.982537] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-21T19:23:33.982594] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-21T19:23:34.391768] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:23:34.392251] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-21T19:23:34.393485] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-10-21T19:23:34.394476] [INFO ] [MAIN ] IPG: Loaded 53330 existing records. [2025-10-21T19:23:34.577216] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:23:34.577719] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-21T19:23:34.577881] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-21T19:23:34.578465] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-21T19:23:34.578527] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-21T19:23:34.956263] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-21T19:23:35.034746] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:23:35.036314] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-21T19:23:35.038511] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.88 seconds). [2025-10-21T19:23:35.351020] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-21T19:23:36.151796] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-21T19:23:36.154602] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T19:23:36.839840] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T19:23:36.951003] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-21T19:23:37.174228] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T19:23:37.751121] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-21T19:23:38.551010] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-21T19:23:38.688997] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T19:23:38.835468] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-10-21T19:23:39.351004] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-21T19:23:39.665971] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T19:23:39.860730] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-21T19:23:40.151047] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-21T19:23:40.951011] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-21T19:23:41.176498] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T19:23:41.751035] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-21T19:23:42.551003] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-21T19:23:42.639519] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-10-21T19:23:42.896219] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T19:23:43.351038] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-21T19:23:43.495491] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T19:23:44.151064] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-21T19:23:44.579395] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-21T19:23:44.951076] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-21T19:23:45.062320] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-21T19:23:45.751044] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-21T19:23:45.818678] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T19:23:46.526499] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T19:23:46.550990] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-21T19:23:47.351016] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-21T19:23:47.516831] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-21T19:23:48.151154] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-21T19:23:48.519267] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-21T19:23:48.951036] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-21T19:23:49.751047] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-21T19:23:49.884085] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T19:23:50.081809] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-21T19:23:50.556150] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-21T19:23:50.568165] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-21T19:23:50.577057] [INFO ] [REMOTE ] IOT: Full fetch complete (77554 records). [2025-10-21T19:23:50.577207] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-21T19:23:51.018563] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-21T19:23:51.018748] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-21T19:23:51.019939] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-21T19:23:51.020113] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-21T19:23:51.021725] [DEBUG] [LOCAL ] IOT: Trimmed 77554 records to 53478 (keeping 200 days of data) [2025-10-21T19:23:51.141570] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T19:23:51.354514] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-21T19:23:51.367316] [DEBUG] [LOCAL ] IOT: Primary data saved (53478 records). [2025-10-21T19:23:51.367391] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-21T19:23:51.367461] [INFO ] [MAIN ] Update Progress: 1117/2366 symbols completed. IOT took 28.5s. Estimated remaining: 2h 40m 47s. Rate: 7.8 symbols/min [2025-10-21T19:23:52.151073] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-21T19:23:53.189380] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T19:23:53.201495] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-21T19:23:53.346801] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-21T19:23:53.594214] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T19:23:53.751044] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-21T19:23:54.551008] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-21T19:23:54.974453] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T19:23:55.351092] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-21T19:23:55.437718] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T19:23:56.151068] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-21T19:23:57.136533] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-21T19:23:57.148036] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-21T19:23:57.288566] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T19:23:57.371756] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-21T19:23:57.751063] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-21T19:23:58.551039] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-21T19:23:59.544589] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T19:23:59.553583] [INFO ] [REMOTE ] IPG: Full fetch complete (77435 records). [2025-10-21T19:23:59.553769] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-21T19:23:59.989415] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-21T19:23:59.989793] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-21T19:23:59.991027] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.84 seconds). [2025-10-21T19:23:59.992067] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-21T19:23:59.999992] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-21T19:24:00.001089] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-21T19:24:00.001341] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-21T19:24:00.002258] [DEBUG] [LOCAL ] IPG: Trimmed 77435 records to 53330 (keeping 200 days of data) [2025-10-21T19:24:00.661706] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-21T19:24:00.662208] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-21T19:24:00.668787] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-21T19:24:00.667610] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-21T19:24:00.668940] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-21T19:24:00.679424] [INFO ] [REMOTE ] IP: Full fetch complete (77415 records). [2025-10-21T19:24:00.680271] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-21T19:24:00.768985] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-10-21T19:24:01.193457] [DEBUG] [LOCAL ] IPG: Primary data saved (53330 records). [2025-10-21T19:24:01.210698] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-21T19:24:01.238771] [INFO ] [MAIN ] Update Progress: 1118/2366 symbols completed. IPG took 27.7s. Estimated remaining: 2h 40m 42s. Rate: 7.8 symbols/min [2025-10-21T19:24:01.361198] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-21T19:24:01.387780] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-21T19:24:01.389360] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-21T19:24:01.389747] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-21T19:24:01.402412] [DEBUG] [LOCAL ] IP: Trimmed 77415 records to 53304 (keeping 200 days of data) [2025-10-21T19:24:01.635675] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-10-21T19:24:01.685032] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-21T19:24:01.685854] [INFO ] [MAIN ] Update Progress: 1119/2366 symbols completed. IONQ took 44.2s. Estimated remaining: 2h 40m 26s. Rate: 7.8 symbols/min [2025-10-21T19:24:01.829982] [DEBUG] [LOCAL ] IP: Primary data saved (53304 records). [2025-10-21T19:24:01.830120] [INFO ] [MAIN ] IP: Full history saved. [2025-10-21T19:24:01.830200] [INFO ] [MAIN ] Update Progress: 1120/2366 symbols completed. IP took 28.9s. Estimated remaining: 2h 40m 10s. Rate: 7.8 symbols/min [2025-10-21T19:24:02.517856] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:24:02.598569] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:24:02.601057] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:24:02.622153] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:24:02.641032] [DEBUG] [LOCAL ] IQI: Loaded 17832 existing records from primary storage. [2025-10-21T19:24:02.647310] [INFO ] [MAIN ] IQI: Loaded 17832 existing records. [2025-10-21T19:24:02.743418] [DEBUG] [LOCAL ] IPI: Loaded 21513 existing records from primary storage. [2025-10-21T19:24:02.773077] [INFO ] [MAIN ] IPI: Loaded 21513 existing records. [2025-10-21T19:24:02.965554] [DEBUG] [LOCAL ] IR: Loaded 52765 existing records from primary storage. [2025-10-21T19:24:02.985474] [INFO ] [MAIN ] IR: Loaded 52765 existing records. [2025-10-21T19:24:03.025435] [DEBUG] [LOCAL ] IQV: Loaded 50022 existing records from primary storage. [2025-10-21T19:24:02.988932] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:24:03.092772] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-21T19:24:03.092958] [INFO ] [MAIN ] IQV: Loaded 50022 existing records. [2025-10-21T19:24:03.096446] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-21T19:24:03.194844] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-21T19:24:03.197774] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:24:03.232435] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-21T19:24:03.232341] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-21T19:24:03.281371] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-21T19:24:03.405572] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-21T19:24:03.426355] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-21T19:24:03.518751] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:24:03.559956] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-21T19:24:03.575758] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-21T19:24:03.602319] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-21T19:24:03.636402] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-21T19:24:03.865105] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:24:04.018309] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-21T19:24:04.113069] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-21T19:24:04.202691] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-21T19:24:04.250991] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-21T19:24:04.624729] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:24:04.730011] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-21T19:24:04.880566] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:24:04.905599] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-21T19:24:04.943914] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:24:04.970818] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-21T19:24:05.120597] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:24:05.120942] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-21T19:24:05.917292] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-21T19:24:05.921330] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-21T19:24:06.124560] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T19:24:06.128422] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-21T19:24:06.440342] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T19:24:06.451845] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-21T19:24:06.590103] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T19:24:06.600071] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-21T19:24:07.020076] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T19:24:07.025053] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-21T19:24:07.157823] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T19:24:07.161961] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-21T19:24:07.985891] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-21T19:24:07.989981] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-21T19:24:08.118149] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T19:24:08.157952] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-21T19:24:08.163310] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-21T19:24:08.188072] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-21T19:24:08.950989] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-21T19:24:09.124300] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-21T19:24:09.742750] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T19:24:09.753159] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-21T19:24:10.551111] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-21T19:24:10.694197] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T19:24:10.787615] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T19:24:11.351008] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-21T19:24:11.436839] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-21T19:24:12.151041] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-21T19:24:12.271355] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-21T19:24:12.951037] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-21T19:24:13.726709] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T19:24:13.750977] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-21T19:24:13.945866] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T19:24:14.551098] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-21T19:24:15.351044] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-21T19:24:15.673237] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-21T19:24:15.962607] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-21T19:24:16.151021] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-21T19:24:16.436190] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T19:24:16.951114] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-21T19:24:17.751070] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-21T19:24:17.792978] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T19:24:17.879292] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-21T19:24:18.550999] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-21T19:24:18.731965] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T19:24:19.343977] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T19:24:19.346897] [INFO ] [REMOTE ] IQI: Full fetch complete (26406 records). [2025-10-21T19:24:19.346982] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-21T19:24:19.359349] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-21T19:24:19.756332] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-21T19:24:19.756410] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-21T19:24:19.756949] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-21T19:24:19.757011] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-21T19:24:19.757732] [DEBUG] [LOCAL ] IQI: Trimmed 26406 records to 17852 (keeping 200 days of data) [2025-10-21T19:24:19.864006] [DEBUG] [LOCAL ] IQI: Primary data saved (17852 records). [2025-10-21T19:24:19.864147] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-21T19:24:19.864229] [INFO ] [MAIN ] Update Progress: 1121/2366 symbols completed. IQI took 18.0s. Estimated remaining: 2h 40m 13s. Rate: 7.8 symbols/min [2025-10-21T19:24:20.037472] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:24:20.087409] [DEBUG] [LOCAL ] IRM: Loaded 49015 existing records from primary storage. [2025-10-21T19:24:20.087757] [INFO ] [MAIN ] IRM: Loaded 49015 existing records. [2025-10-21T19:24:20.156157] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-21T19:24:20.267111] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:24:20.267346] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-21T19:24:20.267393] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-21T19:24:20.267587] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-21T19:24:20.267675] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-21T19:24:20.617093] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:24:20.950997] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-21T19:24:21.187683] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-21T19:24:21.246770] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T19:24:21.751058] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-21T19:24:22.551114] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-21T19:24:22.594510] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T19:24:22.810234] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-21T19:24:23.351065] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-21T19:24:24.107054] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T19:24:24.150988] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-21T19:24:24.278446] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-21T19:24:24.951066] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-21T19:24:25.750995] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-21T19:24:25.859073] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T19:24:26.551022] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-21T19:24:26.647672] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T19:24:27.118947] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T19:24:27.123444] [INFO ] [REMOTE ] IPI: Full fetch complete (30264 records). [2025-10-21T19:24:27.123564] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-21T19:24:27.360214] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-21T19:24:27.520561] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-21T19:24:27.520737] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-21T19:24:27.521727] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-21T19:24:27.521793] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-21T19:24:27.522836] [DEBUG] [LOCAL ] IPI: Trimmed 30264 records to 21499 (keeping 200 days of data) [2025-10-21T19:24:27.657248] [DEBUG] [LOCAL ] IPI: Primary data saved (21499 records). [2025-10-21T19:24:27.657457] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-21T19:24:27.657566] [INFO ] [MAIN ] Update Progress: 1122/2366 symbols completed. IPI took 25.8s. Estimated remaining: 2h 40m 6s. Rate: 7.8 symbols/min [2025-10-21T19:24:27.845009] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:24:27.871150] [DEBUG] [LOCAL ] IRS: Loaded 23243 existing records from primary storage. [2025-10-21T19:24:27.871472] [INFO ] [MAIN ] IRS: Loaded 23243 existing records. [2025-10-21T19:24:28.074083] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:24:28.074534] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-21T19:24:28.074674] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-21T19:24:28.074929] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-21T19:24:28.074987] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-21T19:24:28.154355] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-21T19:24:28.475796] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:24:28.493999] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T19:24:28.951010] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-21T19:24:29.136208] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T19:24:29.751097] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-21T19:24:29.893551] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T19:24:30.551068] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-21T19:24:30.603365] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T19:24:31.070381] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T19:24:31.351093] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-21T19:24:32.151010] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-21T19:24:32.283457] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T19:24:32.401046] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T19:24:32.956103] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-21T19:24:32.972760] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T19:24:32.981595] [INFO ] [REMOTE ] IQV: Full fetch complete (72537 records). [2025-10-21T19:24:32.981761] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-21T19:24:33.382385] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-21T19:24:33.382491] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-21T19:24:33.383551] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-21T19:24:33.383618] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-21T19:24:33.385193] [DEBUG] [LOCAL ] IQV: Trimmed 72537 records to 50013 (keeping 200 days of data) [2025-10-21T19:24:33.683932] [DEBUG] [LOCAL ] IQV: Primary data saved (50013 records). [2025-10-21T19:24:33.684057] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-21T19:24:33.684134] [INFO ] [MAIN ] Update Progress: 1123/2366 symbols completed. IQV took 31.8s. Estimated remaining: 2h 39m 56s. Rate: 7.8 symbols/min [2025-10-21T19:24:33.760047] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-21T19:24:33.857209] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:24:33.904101] [DEBUG] [LOCAL ] IRT: Loaded 50527 existing records from primary storage. [2025-10-21T19:24:33.904385] [INFO ] [MAIN ] IRT: Loaded 50527 existing records. [2025-10-21T19:24:34.084345] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:24:34.084564] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-21T19:24:34.084672] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-21T19:24:34.084994] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-21T19:24:34.085034] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-21T19:24:34.443581] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:24:34.551000] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-21T19:24:34.598252] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T19:24:34.779430] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-21T19:24:35.351085] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-21T19:24:36.151021] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-21T19:24:36.332936] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T19:24:36.357533] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-21T19:24:36.951028] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-21T19:24:37.553944] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-21T19:24:37.617954] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-21T19:24:37.751061] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-21T19:24:38.551020] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-21T19:24:39.290309] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T19:24:39.350982] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-21T19:24:40.150998] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-21T19:24:40.361385] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T19:24:40.369701] [INFO ] [REMOTE ] IR: Full fetch complete (76485 records). [2025-10-21T19:24:40.369867] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-21T19:24:40.826488] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-21T19:24:40.826677] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-21T19:24:40.827922] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-21T19:24:40.828779] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-21T19:24:40.831231] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T19:24:40.847617] [DEBUG] [LOCAL ] IR: Trimmed 76485 records to 52756 (keeping 200 days of data) [2025-10-21T19:24:40.854571] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-21T19:24:40.953436] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-21T19:24:41.178317] [DEBUG] [LOCAL ] IR: Primary data saved (52756 records). [2025-10-21T19:24:41.178451] [INFO ] [MAIN ] IR: Full history saved. [2025-10-21T19:24:41.179253] [INFO ] [MAIN ] Update Progress: 1124/2366 symbols completed. IR took 39.3s. Estimated remaining: 2h 39m 48s. Rate: 7.8 symbols/min [2025-10-21T19:24:41.367131] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:24:41.385428] [DEBUG] [LOCAL ] ISD: Loaded 15782 existing records from primary storage. [2025-10-21T19:24:41.385686] [INFO ] [MAIN ] ISD: Loaded 15782 existing records. [2025-10-21T19:24:41.557212] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:24:41.557417] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-21T19:24:41.557482] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-21T19:24:41.557699] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-21T19:24:41.557769] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-21T19:24:41.756165] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-21T19:24:41.910529] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:24:42.551043] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-21T19:24:42.642266] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T19:24:43.350998] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-21T19:24:43.526053] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T19:24:43.625327] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-21T19:24:44.151046] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-21T19:24:44.731725] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T19:24:44.951055] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-21T19:24:45.195810] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-21T19:24:45.751046] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-21T19:24:46.342493] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T19:24:46.551015] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-21T19:24:46.669679] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T19:24:47.351008] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-21T19:24:48.151034] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-21T19:24:48.287134] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T19:24:48.345969] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T19:24:48.951086] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-21T19:24:49.751108] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-21T19:24:49.811991] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T19:24:49.812505] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T19:24:50.551169] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-21T19:24:51.351012] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-21T19:24:51.437389] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T19:24:52.156386] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-21T19:24:52.169096] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T19:24:52.428430] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-21T19:24:52.951054] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-21T19:24:53.221549] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T19:24:53.751027] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-21T19:24:54.537326] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T19:24:54.550979] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-21T19:24:54.743935] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-21T19:24:55.351058] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-21T19:24:56.151004] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-21T19:24:56.261314] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T19:24:56.318928] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T19:24:56.951073] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-21T19:24:57.750995] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-21T19:24:57.888516] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T19:24:57.897313] [INFO ] [REMOTE ] IRM: Full fetch complete (72190 records). [2025-10-21T19:24:57.897507] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-21T19:24:58.014938] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-21T19:24:58.317750] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-21T19:24:58.317915] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-21T19:24:58.319023] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-21T19:24:58.319107] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-21T19:24:58.320491] [DEBUG] [LOCAL ] IRM: Trimmed 72190 records to 48973 (keeping 200 days of data) [2025-10-21T19:24:58.551197] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-21T19:24:58.627058] [DEBUG] [LOCAL ] IRM: Primary data saved (48973 records). [2025-10-21T19:24:58.627189] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-21T19:24:58.627526] [INFO ] [MAIN ] Update Progress: 1125/2366 symbols completed. IRM took 38.8s. Estimated remaining: 2h 39m 51s. Rate: 7.8 symbols/min [2025-10-21T19:24:58.807274] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:24:58.846852] [DEBUG] [LOCAL ] IT: Loaded 42199 existing records from primary storage. [2025-10-21T19:24:58.847140] [INFO ] [MAIN ] IT: Loaded 42199 existing records. [2025-10-21T19:24:59.027480] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:24:59.027721] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-21T19:24:59.027780] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-21T19:24:59.028082] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-21T19:24:59.028132] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-21T19:24:59.359528] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-21T19:24:59.387971] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:24:59.478805] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-21T19:24:59.538258] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T19:25:00.151052] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-21T19:25:00.879234] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T19:25:00.951030] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-21T19:25:01.344380] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T19:25:01.751132] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-21T19:25:02.171780] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T19:25:02.551032] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-21T19:25:03.040869] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-21T19:25:03.046044] [INFO ] [REMOTE ] IRS: Full fetch complete (32696 records). [2025-10-21T19:25:03.046220] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-21T19:25:03.359859] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-21T19:25:03.570174] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-21T19:25:03.570307] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-21T19:25:03.571848] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-21T19:25:03.571939] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-21T19:25:03.573230] [DEBUG] [LOCAL ] IRS: Trimmed 32696 records to 23350 (keeping 200 days of data) [2025-10-21T19:25:03.745853] [DEBUG] [LOCAL ] IRS: Primary data saved (23350 records). [2025-10-21T19:25:03.746012] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-21T19:25:03.746102] [INFO ] [MAIN ] Update Progress: 1126/2366 symbols completed. IRS took 36.1s. Estimated remaining: 2h 39m 40s. Rate: 7.8 symbols/min [2025-10-21T19:25:03.988028] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:25:04.021573] [DEBUG] [LOCAL ] ITGR: Loaded 31097 existing records from primary storage. [2025-10-21T19:25:04.021883] [INFO ] [MAIN ] ITGR: Loaded 31097 existing records. [2025-10-21T19:25:04.152705] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-21T19:25:04.152341] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T19:25:04.251992] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:25:04.252202] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-21T19:25:04.252249] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-21T19:25:04.252428] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-21T19:25:04.252467] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-21T19:25:04.626193] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:25:04.950997] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-21T19:25:05.197723] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T19:25:05.198475] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-21T19:25:05.208964] [INFO ] [REMOTE ] ISD: Full fetch complete (24159 records). [2025-10-21T19:25:05.209610] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-21T19:25:05.210237] [INFO ] [REMOTE ] IRT: Full fetch complete (72895 records). [2025-10-21T19:25:05.216079] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-21T19:25:05.766169] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-21T19:25:05.992167] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-21T19:25:05.998736] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-21T19:25:06.039253] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-21T19:25:06.035363] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-21T19:25:06.039585] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-21T19:25:06.039510] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-21T19:25:06.040512] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-21T19:25:06.040868] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-21T19:25:06.042305] [DEBUG] [LOCAL ] ISD: Trimmed 24159 records to 15750 (keeping 200 days of data) [2025-10-21T19:25:06.043141] [DEBUG] [LOCAL ] IRT: Trimmed 72895 records to 50486 (keeping 200 days of data) [2025-10-21T19:25:06.245786] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-21T19:25:06.256514] [DEBUG] [LOCAL ] ISD: Primary data saved (15750 records). [2025-10-21T19:25:06.258184] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-21T19:25:06.258584] [INFO ] [MAIN ] Update Progress: 1127/2366 symbols completed. ISD took 25.1s. Estimated remaining: 2h 39m 27s. Rate: 7.8 symbols/min [2025-10-21T19:25:06.540304] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:25:06.568110] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-21T19:25:06.688582] [DEBUG] [LOCAL ] ITT: Loaded 32539 existing records from primary storage. [2025-10-21T19:25:06.692932] [INFO ] [MAIN ] ITT: Loaded 32539 existing records. [2025-10-21T19:25:06.736043] [DEBUG] [LOCAL ] IRT: Primary data saved (50486 records). [2025-10-21T19:25:06.749794] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-21T19:25:06.765275] [INFO ] [MAIN ] Update Progress: 1128/2366 symbols completed. IRT took 33.1s. Estimated remaining: 2h 39m 11s. Rate: 7.8 symbols/min [2025-10-21T19:25:07.059781] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:25:07.076330] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:25:07.076554] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-21T19:25:07.076920] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-21T19:25:07.077101] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-21T19:25:07.077141] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-21T19:25:07.422705] [DEBUG] [LOCAL ] ITUB: Loaded 53327 existing records from primary storage. [2025-10-21T19:25:07.472489] [INFO ] [MAIN ] ITUB: Loaded 53327 existing records. [2025-10-21T19:25:07.513999] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:25:07.567491] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-21T19:25:07.631823] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T19:25:07.734586] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:25:07.735376] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-21T19:25:07.735464] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-21T19:25:07.748371] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-21T19:25:07.748516] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-21T19:25:07.784103] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-21T19:25:08.154049] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:25:08.150993] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-21T19:25:08.912403] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T19:25:08.950985] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-21T19:25:09.631177] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T19:25:09.751000] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-21T19:25:10.551055] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-21T19:25:10.794268] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T19:25:11.139716] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-21T19:25:11.351000] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-21T19:25:12.035490] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-21T19:25:12.151009] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-21T19:25:12.956834] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-21T19:25:12.973608] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T19:25:13.611114] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T19:25:13.751018] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-21T19:25:14.488044] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T19:25:14.550985] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-21T19:25:15.084926] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T19:25:15.351026] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-21T19:25:16.092040] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T19:25:16.151014] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-21T19:25:16.806078] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T19:25:16.950998] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-21T19:25:17.529995] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-21T19:25:17.751046] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-21T19:25:18.551059] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-21T19:25:18.787348] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T19:25:19.307213] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T19:25:19.351019] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-21T19:25:20.138584] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T19:25:20.150982] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-21T19:25:20.951080] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-21T19:25:21.085255] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T19:25:21.376154] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T19:25:21.751106] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-21T19:25:21.891290] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-21T19:25:22.551040] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-21T19:25:23.235776] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T19:25:23.350984] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-21T19:25:24.148329] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-21T19:25:24.157575] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-21T19:25:24.951066] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-21T19:25:25.220715] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T19:25:25.526959] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-21T19:25:25.751010] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-21T19:25:26.287386] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T19:25:26.294548] [INFO ] [REMOTE ] IT: Full fetch complete (57793 records). [2025-10-21T19:25:26.294725] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-21T19:25:26.558100] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-21T19:25:26.679219] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-21T19:25:26.679297] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-21T19:25:26.680144] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-21T19:25:26.680205] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-21T19:25:26.681283] [DEBUG] [LOCAL ] IT: Trimmed 57793 records to 42230 (keeping 200 days of data) [2025-10-21T19:25:26.937044] [DEBUG] [LOCAL ] IT: Primary data saved (42230 records). [2025-10-21T19:25:26.937240] [INFO ] [MAIN ] IT: Full history saved. [2025-10-21T19:25:26.937850] [INFO ] [MAIN ] Update Progress: 1129/2366 symbols completed. IT took 28.3s. Estimated remaining: 2h 39m 17s. Rate: 7.8 symbols/min [2025-10-21T19:25:26.995226] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T19:25:27.127392] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:25:27.172335] [DEBUG] [LOCAL ] ITW: Loaded 45637 existing records from primary storage. [2025-10-21T19:25:27.172639] [INFO ] [MAIN ] ITW: Loaded 45637 existing records. [2025-10-21T19:25:27.345989] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:25:27.346170] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-21T19:25:27.346216] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-21T19:25:27.346409] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-21T19:25:27.346447] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-21T19:25:27.357491] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-21T19:25:27.751100] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:25:27.791285] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T19:25:28.151024] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-21T19:25:28.709155] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T19:25:28.951044] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-21T19:25:29.751073] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-21T19:25:29.959568] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T19:25:30.112727] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T19:25:30.117548] [INFO ] [REMOTE ] ITGR: Full fetch complete (43060 records). [2025-10-21T19:25:30.117688] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-21T19:25:30.485231] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-21T19:25:30.485309] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-21T19:25:30.486075] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-21T19:25:30.486136] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-21T19:25:30.487058] [DEBUG] [LOCAL ] ITGR: Trimmed 43060 records to 31006 (keeping 200 days of data) [2025-10-21T19:25:30.570976] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-21T19:25:30.674912] [DEBUG] [LOCAL ] ITGR: Primary data saved (31006 records). [2025-10-21T19:25:30.675051] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-21T19:25:30.675131] [INFO ] [MAIN ] Update Progress: 1130/2366 symbols completed. ITGR took 26.9s. Estimated remaining: 2h 39m 5s. Rate: 7.8 symbols/min [2025-10-21T19:25:30.842380] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:25:30.884335] [DEBUG] [LOCAL ] IVR: Loaded 47946 existing records from primary storage. [2025-10-21T19:25:30.884621] [INFO ] [MAIN ] IVR: Loaded 47946 existing records. [2025-10-21T19:25:31.094167] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:25:31.094390] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-21T19:25:31.094516] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-21T19:25:31.094796] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-21T19:25:31.094917] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-21T19:25:31.351637] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-21T19:25:31.495885] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T19:25:31.500638] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:25:32.150987] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-21T19:25:32.337538] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T19:25:32.390485] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T19:25:32.951074] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-21T19:25:33.756821] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-21T19:25:33.761526] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T19:25:33.985578] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T19:25:34.551026] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-21T19:25:34.958795] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T19:25:34.963926] [INFO ] [REMOTE ] ITT: Full fetch complete (47526 records). [2025-10-21T19:25:34.964026] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-21T19:25:35.353661] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-21T19:25:35.353731] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-21T19:25:35.353892] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-21T19:25:35.355389] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-21T19:25:35.355457] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-21T19:25:35.356432] [DEBUG] [LOCAL ] ITT: Trimmed 47526 records to 32438 (keeping 200 days of data) [2025-10-21T19:25:35.554031] [DEBUG] [LOCAL ] ITT: Primary data saved (32438 records). [2025-10-21T19:25:35.554155] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-21T19:25:35.554705] [INFO ] [MAIN ] Update Progress: 1131/2366 symbols completed. ITT took 29.3s. Estimated remaining: 2h 38m 54s. Rate: 7.8 symbols/min [2025-10-21T19:25:35.725758] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:25:35.759204] [DEBUG] [LOCAL ] IVT: Loaded 31523 existing records from primary storage. [2025-10-21T19:25:35.759489] [INFO ] [MAIN ] IVT: Loaded 31523 existing records. [2025-10-21T19:25:35.940166] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:25:35.940394] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-21T19:25:35.940463] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-21T19:25:35.940773] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-21T19:25:35.940832] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-21T19:25:36.155118] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-21T19:25:36.305480] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:25:36.336849] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T19:25:36.944258] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T19:25:36.952535] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-21T19:25:37.751034] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-21T19:25:37.984051] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T19:25:38.136136] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T19:25:38.551027] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-21T19:25:39.351026] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-21T19:25:39.485478] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T19:25:40.151092] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-21T19:25:40.208429] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T19:25:40.951055] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-21T19:25:41.161598] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-21T19:25:41.751090] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-21T19:25:41.961693] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T19:25:42.436292] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T19:25:42.551026] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-21T19:25:43.351060] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-21T19:25:43.503939] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T19:25:44.151014] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-21T19:25:44.204983] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T19:25:44.625498] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T19:25:44.951033] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-21T19:25:45.751036] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-21T19:25:45.929068] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T19:25:45.937231] [INFO ] [REMOTE ] ITUB: Full fetch complete (77316 records). [2025-10-21T19:25:45.937341] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-21T19:25:46.348250] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-21T19:25:46.348352] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-21T19:25:46.349378] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-21T19:25:46.349460] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-21T19:25:46.368252] [DEBUG] [LOCAL ] ITUB: Trimmed 77316 records to 53322 (keeping 200 days of data) [2025-10-21T19:25:46.378948] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T19:25:46.555463] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-21T19:25:46.743192] [DEBUG] [LOCAL ] ITUB: Primary data saved (53322 records). [2025-10-21T19:25:46.743929] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-21T19:25:46.744862] [INFO ] [MAIN ] Update Progress: 1132/2366 symbols completed. ITUB took 40.0s. Estimated remaining: 2h 38m 50s. Rate: 7.8 symbols/min [2025-10-21T19:25:46.744710] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T19:25:46.932303] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:25:46.983941] [DEBUG] [LOCAL ] IVZ: Loaded 53129 existing records from primary storage. [2025-10-21T19:25:46.984261] [INFO ] [MAIN ] IVZ: Loaded 53129 existing records. [2025-10-21T19:25:47.160425] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:25:47.160677] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-21T19:25:47.160737] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-21T19:25:47.160983] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-21T19:25:47.161020] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-21T19:25:47.356136] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-21T19:25:47.520210] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:25:48.151044] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-21T19:25:48.572949] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-21T19:25:48.607004] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T19:25:48.951061] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-21T19:25:49.666500] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T19:25:49.750983] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-21T19:25:50.489318] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T19:25:50.550991] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-21T19:25:51.351051] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-21T19:25:51.449079] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T19:25:52.151006] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-21T19:25:52.203987] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T19:25:52.657067] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T19:25:52.951012] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-21T19:25:53.659351] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-21T19:25:53.751051] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-21T19:25:54.551066] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-21T19:25:54.676031] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T19:25:55.329251] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T19:25:55.350991] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-21T19:25:55.381289] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-21T19:25:56.151012] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-21T19:25:56.951108] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-21T19:25:57.290051] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T19:25:57.473670] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-21T19:25:57.482055] [INFO ] [REMOTE ] ITW: Full fetch complete (66746 records). [2025-10-21T19:25:57.482253] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-21T19:25:57.756299] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-21T19:25:57.922464] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-21T19:25:57.922613] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-21T19:25:57.923629] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-21T19:25:57.923722] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-21T19:25:57.925195] [DEBUG] [LOCAL ] ITW: Trimmed 66746 records to 45596 (keeping 200 days of data) [2025-10-21T19:25:58.213524] [DEBUG] [LOCAL ] ITW: Primary data saved (45596 records). [2025-10-21T19:25:58.213686] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-21T19:25:58.214326] [INFO ] [MAIN ] Update Progress: 1133/2366 symbols completed. ITW took 31.3s. Estimated remaining: 2h 38m 47s. Rate: 7.8 symbols/min [2025-10-21T19:25:58.351683] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T19:25:58.432264] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:25:58.455582] [DEBUG] [LOCAL ] IX: Loaded 22282 existing records from primary storage. [2025-10-21T19:25:58.455877] [INFO ] [MAIN ] IX: Loaded 22282 existing records. [2025-10-21T19:25:58.556203] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-21T19:25:58.645075] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:25:58.645303] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-21T19:25:58.645353] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-21T19:25:58.645551] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-21T19:25:58.645609] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-21T19:25:59.038733] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:25:59.351002] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-21T19:25:59.723823] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-21T19:25:59.855930] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-21T19:26:00.151028] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-21T19:26:00.951040] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-21T19:26:01.526675] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-21T19:26:01.728403] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-21T19:26:01.750984] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-21T19:26:02.052186] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-21T19:26:02.551023] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-21T19:26:03.351008] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-21T19:26:03.644537] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T19:26:03.652472] [INFO ] [REMOTE ] IVR: Full fetch complete (69105 records). [2025-10-21T19:26:03.652598] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-21T19:26:04.015034] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T19:26:04.056994] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T19:26:04.146850] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-21T19:26:04.146932] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-21T19:26:04.147990] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-21T19:26:04.148063] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-21T19:26:04.149542] [DEBUG] [LOCAL ] IVR: Trimmed 69105 records to 47886 (keeping 200 days of data) [2025-10-21T19:26:04.200223] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-21T19:26:04.451794] [DEBUG] [LOCAL ] IVR: Primary data saved (47886 records). [2025-10-21T19:26:04.452204] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-21T19:26:04.452308] [INFO ] [MAIN ] Update Progress: 1134/2366 symbols completed. IVR took 33.8s. Estimated remaining: 2h 38m 37s. Rate: 7.8 symbols/min [2025-10-21T19:26:04.644039] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:26:04.686369] [DEBUG] [LOCAL ] J: Loaded 40502 existing records from primary storage. [2025-10-21T19:26:04.686674] [INFO ] [MAIN ] J: Loaded 40502 existing records. [2025-10-21T19:26:04.889506] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:26:04.889765] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-21T19:26:04.889822] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-21T19:26:04.890246] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-21T19:26:04.890304] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-21T19:26:04.956308] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-21T19:26:05.290889] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:26:05.652492] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T19:26:05.658386] [INFO ] [REMOTE ] IVT: Full fetch complete (45814 records). [2025-10-21T19:26:05.658469] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-21T19:26:05.756235] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-21T19:26:06.034377] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-21T19:26:06.034453] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-21T19:26:06.035272] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-21T19:26:06.035356] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-21T19:26:06.036293] [DEBUG] [LOCAL ] IVT: Trimmed 45814 records to 31476 (keeping 200 days of data) [2025-10-21T19:26:06.230710] [DEBUG] [LOCAL ] IVT: Primary data saved (31476 records). [2025-10-21T19:26:06.230899] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-21T19:26:06.231589] [INFO ] [MAIN ] Update Progress: 1135/2366 symbols completed. IVT took 30.7s. Estimated remaining: 2h 38m 23s. Rate: 7.8 symbols/min [2025-10-21T19:26:06.401904] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:26:06.443835] [DEBUG] [LOCAL ] JBGS: Loaded 41953 existing records from primary storage. [2025-10-21T19:26:06.444122] [INFO ] [MAIN ] JBGS: Loaded 41953 existing records. [2025-10-21T19:26:06.556308] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-21T19:26:06.626371] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:26:06.626616] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-21T19:26:06.626774] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-21T19:26:06.627014] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-21T19:26:06.627070] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-21T19:26:06.906024] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-21T19:26:07.052762] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:26:07.351017] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-21T19:26:07.440833] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-21T19:26:07.487672] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-21T19:26:08.151031] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-21T19:26:08.951042] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-21T19:26:09.236682] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-21T19:26:09.462927] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T19:26:09.751029] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-21T19:26:09.854631] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-21T19:26:10.551034] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-21T19:26:11.103696] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T19:26:11.350995] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-21T19:26:11.739183] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T19:26:12.151064] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-21T19:26:12.821327] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T19:26:12.951000] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-21T19:26:13.146611] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T19:26:13.751106] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-21T19:26:14.383479] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-21T19:26:14.551013] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-21T19:26:15.351047] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-21T19:26:15.405790] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T19:26:16.156157] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-21T19:26:16.172595] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T19:26:16.889570] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T19:26:16.950985] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-21T19:26:17.751050] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-21T19:26:17.906403] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T19:26:18.551069] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-21T19:26:18.620269] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T19:26:18.962359] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T19:26:19.351099] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-21T19:26:20.012753] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-21T19:26:20.020972] [INFO ] [REMOTE ] IVZ: Full fetch complete (77036 records). [2025-10-21T19:26:20.021096] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-21T19:26:20.164904] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-21T19:26:20.421878] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-21T19:26:20.422038] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-21T19:26:20.423167] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-21T19:26:20.423245] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-21T19:26:20.443818] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T19:26:20.450121] [DEBUG] [LOCAL ] IVZ: Trimmed 77036 records to 53133 (keeping 200 days of data) [2025-10-21T19:26:20.762523] [DEBUG] [LOCAL ] IVZ: Primary data saved (53133 records). [2025-10-21T19:26:20.762679] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-21T19:26:20.763582] [INFO ] [MAIN ] Update Progress: 1136/2366 symbols completed. IVZ took 34.0s. Estimated remaining: 2h 38m 23s. Rate: 7.8 symbols/min [2025-10-21T19:26:20.938514] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:26:20.951059] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-21T19:26:20.981762] [DEBUG] [LOCAL ] JBI: Loaded 42783 existing records from primary storage. [2025-10-21T19:26:20.982052] [INFO ] [MAIN ] JBI: Loaded 42783 existing records. [2025-10-21T19:26:21.165361] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:26:21.165550] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-21T19:26:21.165596] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-21T19:26:21.165811] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-21T19:26:21.165867] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-21T19:26:21.543606] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:26:21.712067] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T19:26:21.750978] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-21T19:26:22.016805] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-21T19:26:22.551031] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-21T19:26:23.351251] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T19:26:23.351390] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-21T19:26:23.993927] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T19:26:24.151027] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-21T19:26:24.676620] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T19:26:24.951041] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-21T19:26:25.589837] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T19:26:25.705867] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-21T19:26:25.750982] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-21T19:26:26.551070] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-21T19:26:26.845788] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-21T19:26:26.849395] [INFO ] [REMOTE ] IX: Full fetch complete (28589 records). [2025-10-21T19:26:26.849492] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-21T19:26:27.215992] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-21T19:26:27.216069] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-21T19:26:27.216636] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-21T19:26:27.216715] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-21T19:26:27.217429] [DEBUG] [LOCAL ] IX: Trimmed 28589 records to 22198 (keeping 200 days of data) [2025-10-21T19:26:27.344837] [DEBUG] [LOCAL ] IX: Primary data saved (22198 records). [2025-10-21T19:26:27.344962] [INFO ] [MAIN ] IX: Full history saved. [2025-10-21T19:26:27.345041] [INFO ] [MAIN ] Update Progress: 1137/2366 symbols completed. IX took 29.1s. Estimated remaining: 2h 38m 14s. Rate: 7.8 symbols/min [2025-10-21T19:26:27.356184] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-21T19:26:27.538295] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:26:27.583540] [DEBUG] [LOCAL ] JBL: Loaded 48383 existing records from primary storage. [2025-10-21T19:26:27.583853] [INFO ] [MAIN ] JBL: Loaded 48383 existing records. [2025-10-21T19:26:27.762145] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:26:27.762327] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-21T19:26:27.762375] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-21T19:26:27.762559] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-21T19:26:27.762595] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-21T19:26:28.151055] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-21T19:26:28.168710] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-21T19:26:28.183901] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:26:28.798210] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-21T19:26:28.951051] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-21T19:26:29.750994] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-21T19:26:29.782801] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T19:26:30.380771] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T19:26:30.551077] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-21T19:26:31.151701] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T19:26:31.351041] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-21T19:26:31.511955] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-21T19:26:32.151011] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-21T19:26:32.768601] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-21T19:26:32.774339] [INFO ] [REMOTE ] JBGS: Full fetch complete (59201 records). [2025-10-21T19:26:32.774459] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-21T19:26:32.960149] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-21T19:26:33.155815] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-21T19:26:33.155889] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-21T19:26:33.156741] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-21T19:26:33.156801] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-21T19:26:33.157887] [DEBUG] [LOCAL ] JBGS: Trimmed 59201 records to 41810 (keeping 200 days of data) [2025-10-21T19:26:33.405258] [DEBUG] [LOCAL ] JBGS: Primary data saved (41810 records). [2025-10-21T19:26:33.405458] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-21T19:26:33.406094] [INFO ] [MAIN ] Update Progress: 1138/2366 symbols completed. JBGS took 27.2s. Estimated remaining: 2h 38m 4s. Rate: 7.8 symbols/min [2025-10-21T19:26:33.576877] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:26:33.605435] [DEBUG] [LOCAL ] JBND: Loaded 27243 existing records from primary storage. [2025-10-21T19:26:33.605745] [INFO ] [MAIN ] JBND: Loaded 27243 existing records. [2025-10-21T19:26:33.751673] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-21T19:26:33.787024] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:26:33.787476] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-21T19:26:33.787583] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-21T19:26:33.787871] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-21T19:26:33.787942] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-21T19:26:33.963689] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T19:26:34.053584] [INFO ] [REMOTE ] J: Full fetch complete (59778 records). [2025-10-21T19:26:34.064946] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-21T19:26:34.286835] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:26:34.554500] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-21T19:26:34.554935] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-21T19:26:34.555822] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-21T19:26:34.556818] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-21T19:26:34.556992] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-21T19:26:34.558315] [DEBUG] [LOCAL ] J: Trimmed 59778 records to 40509 (keeping 200 days of data) [2025-10-21T19:26:34.814864] [DEBUG] [LOCAL ] J: Primary data saved (40509 records). [2025-10-21T19:26:34.815101] [INFO ] [MAIN ] J: Full history saved. [2025-10-21T19:26:34.815244] [INFO ] [MAIN ] Update Progress: 1139/2366 symbols completed. J took 30.4s. Estimated remaining: 2h 37m 50s. Rate: 7.8 symbols/min [2025-10-21T19:26:34.925747] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-21T19:26:35.027101] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:26:35.027371] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-21T19:26:35.027441] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-21T19:26:35.027678] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-21T19:26:35.027745] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-21T19:26:35.027916] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-21T19:26:35.028044] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-21T19:26:35.154741] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T19:26:35.356183] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-21T19:26:35.419998] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:26:35.611338] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T19:26:36.151041] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-10-21T19:26:36.369617] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T19:26:36.369960] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-10-21T19:26:36.370049] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:26:36.370098] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-21T19:26:36.370157] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:26:36.370228] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-21T19:26:36.370290] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-21T19:26:36.370324] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-21T19:26:36.370362] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-21T19:26:36.370450] [INFO ] [MAIN ] Update Progress: 1140/2366 symbols completed. JBS took 1.6s. Estimated remaining: 2h 37m 36s. Rate: 7.8 symbols/min [2025-10-21T19:26:36.539083] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:26:36.539225] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-21T19:26:36.539261] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-21T19:26:36.539365] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-21T19:26:36.539427] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-21T19:26:36.539494] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-21T19:26:36.539537] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-21T19:26:36.897054] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:26:36.939970] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T19:26:36.950988] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-10-21T19:26:37.750994] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-21T19:26:38.186499] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T19:26:38.255298] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-21T19:26:38.551005] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-21T19:26:39.351040] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-21T19:26:39.544580] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T19:26:40.151074] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-10-21T19:26:40.951050] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-21T19:26:41.031061] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T19:26:41.450624] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T19:26:41.751035] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-21T19:26:42.272317] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T19:26:42.551098] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-21T19:26:43.296545] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T19:26:43.350984] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-10-21T19:26:43.590132] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T19:26:44.151008] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-21T19:26:44.626418] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-21T19:26:44.951073] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-21T19:26:45.611047] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-21T19:26:45.750984] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-21T19:26:46.550986] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-10-21T19:26:46.722237] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T19:26:47.187635] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T19:26:47.351028] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-21T19:26:48.059628] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T19:26:48.150990] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-21T19:26:48.803149] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T19:26:48.950982] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-21T19:26:49.211851] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-21T19:26:49.751096] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-21T19:26:50.335031] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T19:26:50.551127] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-21T19:26:50.823522] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-21T19:26:51.351057] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-21T19:26:51.932756] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T19:26:52.151080] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-10-21T19:26:52.635522] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T19:26:52.951072] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-21T19:26:53.554811] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-21T19:26:53.751002] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-21T19:26:54.249045] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T19:26:54.551038] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-21T19:26:55.354144] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-10-21T19:26:55.358907] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T19:26:55.935217] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T19:26:55.941404] [INFO ] [REMOTE ] JBI: Full fetch complete (63662 records). [2025-10-21T19:26:55.941537] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-21T19:26:56.156142] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-21T19:26:56.333488] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-21T19:26:56.333594] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-21T19:26:56.334736] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-21T19:26:56.334800] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-21T19:26:56.336020] [DEBUG] [LOCAL ] JBI: Trimmed 63662 records to 42692 (keeping 200 days of data) [2025-10-21T19:26:56.577543] [DEBUG] [LOCAL ] JBI: Primary data saved (42692 records). [2025-10-21T19:26:56.577743] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-21T19:26:56.581045] [INFO ] [MAIN ] Update Progress: 1141/2366 symbols completed. JBI took 35.8s. Estimated remaining: 2h 37m 41s. Rate: 7.8 symbols/min [2025-10-21T19:26:56.706900] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T19:26:56.782849] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:26:56.792172] [DEBUG] [LOCAL ] JCE: Loaded 7308 existing records from primary storage. [2025-10-21T19:26:56.792372] [INFO ] [MAIN ] JCE: Loaded 7308 existing records. [2025-10-21T19:26:56.964555] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-10-21T19:26:56.969478] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:26:56.970334] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-21T19:26:56.970385] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-21T19:26:56.970558] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-21T19:26:56.970600] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-21T19:26:57.325291] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:26:57.751061] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-21T19:26:57.847452] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T19:26:58.371861] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-21T19:26:58.551030] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-10-21T19:26:59.009531] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T19:26:59.015867] [INFO ] [REMOTE ] JBND: Full fetch complete (35988 records). [2025-10-21T19:26:59.016003] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-21T19:26:59.356333] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-21T19:26:59.426551] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-21T19:26:59.426632] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-21T19:26:59.427378] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-21T19:26:59.427582] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-21T19:26:59.428571] [DEBUG] [LOCAL ] JBND: Trimmed 35988 records to 27324 (keeping 200 days of data) [2025-10-21T19:26:59.595024] [DEBUG] [LOCAL ] JBND: Primary data saved (27324 records). [2025-10-21T19:26:59.595173] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-21T19:26:59.595260] [INFO ] [MAIN ] Update Progress: 1142/2366 symbols completed. JBND took 26.2s. Estimated remaining: 2h 37m 29s. Rate: 7.8 symbols/min [2025-10-21T19:26:59.772672] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:26:59.824410] [DEBUG] [LOCAL ] JCI: Loaded 53523 existing records from primary storage. [2025-10-21T19:26:59.824750] [INFO ] [MAIN ] JCI: Loaded 53523 existing records. [2025-10-21T19:27:00.011222] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-21T19:27:00.036347] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:27:00.038885] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-21T19:27:00.039005] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-21T19:27:00.045915] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-21T19:27:00.061397] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-21T19:27:00.063263] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-21T19:27:00.160927] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-21T19:27:00.499260] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:27:00.951042] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-10-21T19:27:01.751043] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-21T19:27:02.324264] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-21T19:27:02.551054] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-21T19:27:02.748202] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-21T19:27:03.095144] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T19:27:03.351027] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-21T19:27:03.862190] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-21T19:27:04.151013] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-21T19:27:04.312995] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T19:27:04.951079] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-21T19:27:05.751008] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-10. [2025-10-21T19:27:05.895579] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T19:27:06.551068] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-21T19:27:06.730530] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T19:27:06.909881] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-21T19:27:06.970979] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T19:27:06.977585] [INFO ] [REMOTE ] JBTM: Full fetch complete (47194 records). [2025-10-21T19:27:06.977741] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-10-21T19:27:07.356948] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-21T19:27:07.360575] [DEBUG] [VALIDATOR ] JBTM: All expected trading days are present. [2025-10-21T19:27:07.360696] [DEBUG] [VALIDATOR ] JBTM: Primary data validation passed. [2025-10-21T19:27:07.361573] [INFO ] [MAIN ] JBTM: Fetched primary data is valid. [2025-10-21T19:27:07.361777] [DEBUG] [LOCAL ] JBTM: Saving primary data. [2025-10-21T19:27:07.362765] [DEBUG] [LOCAL ] JBTM: Trimmed 47194 records to 33651 (keeping 200 days of data) [2025-10-21T19:27:07.564467] [DEBUG] [LOCAL ] JBTM: Primary data saved (33651 records). [2025-10-21T19:27:07.564611] [INFO ] [MAIN ] JBTM: Full history saved. [2025-10-21T19:27:07.564714] [INFO ] [MAIN ] Update Progress: 1143/2366 symbols completed. JBTM took 31.2s. Estimated remaining: 2h 37m 21s. Rate: 7.8 symbols/min [2025-10-21T19:27:07.730694] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:27:07.772253] [DEBUG] [LOCAL ] JEF: Loaded 50184 existing records from primary storage. [2025-10-21T19:27:07.772541] [INFO ] [MAIN ] JEF: Loaded 50184 existing records. [2025-10-21T19:27:07.951893] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:27:07.952129] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-21T19:27:07.952181] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-21T19:27:07.952440] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-21T19:27:07.952496] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-21T19:27:08.157181] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-21T19:27:08.254330] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-21T19:27:08.317699] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:27:08.951022] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-21T19:27:09.513176] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-21T19:27:09.751006] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-21T19:27:10.128066] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T19:27:10.551067] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-21T19:27:10.661256] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-21T19:27:10.668996] [INFO ] [REMOTE ] JBL: Full fetch complete (70639 records). [2025-10-21T19:27:10.669159] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-21T19:27:11.051528] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-21T19:27:11.051685] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-21T19:27:11.052624] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-21T19:27:11.052775] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-21T19:27:11.058485] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-21T19:27:11.061162] [DEBUG] [LOCAL ] JBL: Trimmed 70639 records to 48345 (keeping 200 days of data) [2025-10-21T19:27:11.351017] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-21T19:27:11.355225] [DEBUG] [LOCAL ] JBL: Primary data saved (48345 records). [2025-10-21T19:27:11.355467] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-21T19:27:11.355947] [INFO ] [MAIN ] Update Progress: 1144/2366 symbols completed. JBL took 44.0s. Estimated remaining: 2h 37m 9s. Rate: 7.8 symbols/min [2025-10-21T19:27:11.526146] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:27:11.567209] [DEBUG] [LOCAL ] JELD: Loaded 46009 existing records from primary storage. [2025-10-21T19:27:11.567512] [INFO ] [MAIN ] JELD: Loaded 46009 existing records. [2025-10-21T19:27:11.759091] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:27:11.759302] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-21T19:27:11.759379] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-21T19:27:11.759807] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-21T19:27:11.759881] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-21T19:27:12.141597] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:27:12.150978] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-21T19:27:12.951062] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-21T19:27:13.421693] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-21T19:27:13.552750] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T19:27:13.751017] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-21T19:27:14.361623] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T19:27:14.534943] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-21T19:27:14.550983] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-21T19:27:15.158350] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T19:27:15.351001] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-21T19:27:16.151031] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-21T19:27:16.951002] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-21T19:27:17.268278] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T19:27:17.340580] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T19:27:17.751027] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-21T19:27:18.551023] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-21T19:27:18.707099] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T19:27:18.854857] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T19:27:19.351020] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-21T19:27:20.151003] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-21T19:27:20.364715] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T19:27:20.951014] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-21T19:27:21.109580] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T19:27:21.751052] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-21T19:27:21.894346] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T19:27:22.550995] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-21T19:27:22.895257] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T19:27:23.350983] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-21T19:27:23.541739] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T19:27:24.151059] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-21T19:27:24.216443] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T19:27:24.951035] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-21T19:27:25.217679] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T19:27:25.355147] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T19:27:25.751004] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-21T19:27:26.120033] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T19:27:26.551029] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-21T19:27:27.360191] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-21T19:27:27.367660] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T19:27:28.151021] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-21T19:27:28.398693] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T19:27:28.951058] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-21T19:27:28.987972] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-21T19:27:29.391428] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-21T19:27:29.400949] [INFO ] [REMOTE ] JCI: Full fetch complete (77648 records). [2025-10-21T19:27:29.401166] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-21T19:27:29.751812] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-21T19:27:29.980731] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-21T19:27:29.980849] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-21T19:27:29.982589] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-21T19:27:29.983307] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-21T19:27:29.986743] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T19:27:29.999474] [DEBUG] [LOCAL ] JCI: Trimmed 77648 records to 53519 (keeping 200 days of data) [2025-10-21T19:27:30.334283] [DEBUG] [LOCAL ] JCI: Primary data saved (53519 records). [2025-10-21T19:27:30.334423] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-21T19:27:30.334503] [INFO ] [MAIN ] Update Progress: 1145/2366 symbols completed. JCI took 30.7s. Estimated remaining: 2h 37m 13s. Rate: 7.8 symbols/min [2025-10-21T19:27:30.518036] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:27:30.547238] [DEBUG] [LOCAL ] JFR: Loaded 30952 existing records from primary storage. [2025-10-21T19:27:30.547500] [INFO ] [MAIN ] JFR: Loaded 30952 existing records. [2025-10-21T19:27:30.559105] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-21T19:27:30.667371] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T19:27:30.748372] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:27:30.748602] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-21T19:27:30.748690] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-21T19:27:30.748931] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-21T19:27:30.748988] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-21T19:27:31.121332] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:27:31.351065] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-21T19:27:32.151040] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-21T19:27:32.236169] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T19:27:32.823212] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T19:27:32.950987] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-21T19:27:33.046097] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T19:27:33.048536] [INFO ] [REMOTE ] JCE: Full fetch complete (9691 records). [2025-10-21T19:27:33.048618] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-21T19:27:33.407858] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-21T19:27:33.407954] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-21T19:27:33.408221] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-21T19:27:33.408260] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-21T19:27:33.408880] [DEBUG] [LOCAL ] JCE: Trimmed 9691 records to 7278 (keeping 200 days of data) [2025-10-21T19:27:33.452887] [DEBUG] [LOCAL ] JCE: Primary data saved (7278 records). [2025-10-21T19:27:33.453025] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-21T19:27:33.453144] [INFO ] [MAIN ] Update Progress: 1146/2366 symbols completed. JCE took 36.9s. Estimated remaining: 2h 37m 1s. Rate: 7.8 symbols/min [2025-10-21T19:27:33.620774] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:27:33.635013] [DEBUG] [LOCAL ] JGH: Loaded 12697 existing records from primary storage. [2025-10-21T19:27:33.635232] [INFO ] [MAIN ] JGH: Loaded 12697 existing records. [2025-10-21T19:27:33.756250] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-21T19:27:33.818540] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:27:33.818908] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-21T19:27:33.818961] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-21T19:27:33.819114] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-21T19:27:33.819164] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-21T19:27:34.166110] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:27:34.550990] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-21T19:27:34.666910] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T19:27:35.351005] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-21T19:27:35.444350] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T19:27:35.544142] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T19:27:36.151041] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-21T19:27:36.951002] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-21T19:27:37.065147] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T19:27:37.073900] [INFO ] [REMOTE ] JEF: Full fetch complete (73341 records). [2025-10-21T19:27:37.074045] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-21T19:27:37.473495] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-21T19:27:37.473596] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-21T19:27:37.474728] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-21T19:27:37.474808] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-21T19:27:37.492911] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T19:27:37.499591] [DEBUG] [LOCAL ] JEF: Trimmed 73341 records to 50196 (keeping 200 days of data) [2025-10-21T19:27:37.500339] [INFO ] [REMOTE ] JELD: Full fetch complete (64585 records). [2025-10-21T19:27:37.500601] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-21T19:27:37.773721] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-21T19:27:38.107741] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-21T19:27:38.109229] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-21T19:27:38.117850] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-21T19:27:38.118197] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-21T19:27:38.148518] [DEBUG] [LOCAL ] JELD: Trimmed 64585 records to 45921 (keeping 200 days of data) [2025-10-21T19:27:38.261384] [DEBUG] [LOCAL ] JEF: Primary data saved (50196 records). [2025-10-21T19:27:38.286903] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-21T19:27:38.287049] [INFO ] [MAIN ] Update Progress: 1147/2366 symbols completed. JEF took 30.7s. Estimated remaining: 2h 36m 50s. Rate: 7.8 symbols/min [2025-10-21T19:27:38.626504] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-21T19:27:38.659253] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-21T19:27:38.678131] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:27:38.678992] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-21T19:27:38.674070] [DEBUG] [LOCAL ] JELD: Primary data saved (45921 records). [2025-10-21T19:27:38.688032] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-21T19:27:38.688167] [INFO ] [MAIN ] Update Progress: 1148/2366 symbols completed. JELD took 27.3s. Estimated remaining: 2h 36m 35s. Rate: 7.8 symbols/min [2025-10-21T19:27:38.873801] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:27:38.879012] [DEBUG] [LOCAL ] JHI: Loaded 4157 existing records from primary storage. [2025-10-21T19:27:38.879229] [INFO ] [MAIN ] JHI: Loaded 4157 existing records. [2025-10-21T19:27:39.004889] [DEBUG] [LOCAL ] JHG: Loaded 47569 existing records from primary storage. [2025-10-21T19:27:39.015512] [INFO ] [MAIN ] JHG: Loaded 47569 existing records. [2025-10-21T19:27:39.153716] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:27:39.171750] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-21T19:27:39.171830] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-21T19:27:39.184316] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-21T19:27:39.184445] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-21T19:27:39.355798] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-21T19:27:39.388302] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:27:39.405459] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-21T19:27:39.432992] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-21T19:27:39.462508] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T19:27:39.462588] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-21T19:27:39.500346] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-21T19:27:39.867018] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:27:40.047169] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:27:40.151015] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-21T19:27:40.868890] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-21T19:27:40.951011] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-21T19:27:41.707193] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T19:27:41.751115] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-21T19:27:42.307279] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-21T19:27:42.329215] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T19:27:42.551058] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-21T19:27:43.295605] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-21T19:27:43.351029] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-21T19:27:44.126739] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-21T19:27:44.151020] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-21T19:27:44.910545] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T19:27:44.951047] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-21T19:27:45.681844] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-21T19:27:45.750987] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-21T19:27:46.540673] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-21T19:27:46.550985] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-21T19:27:47.316240] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T19:27:47.350981] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-21T19:27:48.163011] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-21T19:27:48.167391] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-21T19:27:48.950995] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-21T19:27:49.315551] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T19:27:49.408311] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-21T19:27:49.751038] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-21T19:27:50.316230] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-21T19:27:50.551077] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-21T19:27:51.148996] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-21T19:27:51.351046] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-21T19:27:51.977421] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-21T19:27:52.151063] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-21T19:27:52.951063] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-21T19:27:53.228027] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T19:27:53.232082] [INFO ] [REMOTE ] JGH: Full fetch complete (16419 records). [2025-10-21T19:27:53.232153] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-21T19:27:53.589749] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-21T19:27:53.589827] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-21T19:27:53.590167] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-21T19:27:53.590207] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-21T19:27:53.590747] [DEBUG] [LOCAL ] JGH: Trimmed 16419 records to 12652 (keeping 200 days of data) [2025-10-21T19:27:53.666427] [DEBUG] [LOCAL ] JGH: Primary data saved (12652 records). [2025-10-21T19:27:53.666555] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-21T19:27:53.666629] [INFO ] [MAIN ] Update Progress: 1149/2366 symbols completed. JGH took 20.2s. Estimated remaining: 2h 36m 35s. Rate: 7.8 symbols/min [2025-10-21T19:27:53.757540] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-21T19:27:53.839361] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:27:53.844550] [DEBUG] [LOCAL ] JHS: Loaded 2931 existing records from primary storage. [2025-10-21T19:27:53.844724] [INFO ] [MAIN ] JHS: Loaded 2931 existing records. [2025-10-21T19:27:54.025618] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:27:54.025945] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-21T19:27:54.025998] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-21T19:27:54.026150] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-21T19:27:54.026206] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-21T19:27:54.328698] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T19:27:54.406791] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:27:54.550999] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-21T19:27:55.097150] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-21T19:27:55.287980] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-21T19:27:55.350996] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-21T19:27:56.151045] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-21T19:27:56.693974] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-21T19:27:56.962677] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-21T19:27:56.968494] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T19:27:57.445783] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T19:27:57.751015] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-21T19:27:58.551063] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-21T19:27:59.117866] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T19:27:59.351001] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-21T19:27:59.433754] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T19:27:59.815140] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-21T19:28:00.151024] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-21T19:28:00.951083] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-21T19:28:01.751001] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-21T19:28:02.024369] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T19:28:02.130750] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T19:28:02.190437] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-21T19:28:02.551034] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-21T19:28:02.997896] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-21T19:28:03.351032] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-21T19:28:03.770793] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-21T19:28:04.151018] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-21T19:28:04.951068] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-21T19:28:05.734819] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-21T19:28:05.735771] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T19:28:05.747310] [INFO ] [REMOTE ] JHI: Full fetch complete (5813 records). [2025-10-21T19:28:05.747820] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-21T19:28:05.759450] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-21T19:28:06.103421] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-21T19:28:06.103492] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-21T19:28:06.103628] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-21T19:28:06.103700] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-21T19:28:06.104050] [DEBUG] [LOCAL ] JHI: Trimmed 5813 records to 4184 (keeping 200 days of data) [2025-10-21T19:28:06.131175] [DEBUG] [LOCAL ] JHI: Primary data saved (4184 records). [2025-10-21T19:28:06.131260] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-21T19:28:06.131339] [INFO ] [MAIN ] Update Progress: 1150/2366 symbols completed. JHI took 27.4s. Estimated remaining: 2h 36m 32s. Rate: 7.8 symbols/min [2025-10-21T19:28:06.307283] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:28:06.353619] [DEBUG] [LOCAL ] JHX: Loaded 53195 existing records from primary storage. [2025-10-21T19:28:06.353933] [INFO ] [MAIN ] JHX: Loaded 53195 existing records. [2025-10-21T19:28:06.526871] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:28:06.527061] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-21T19:28:06.527106] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-21T19:28:06.527411] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-21T19:28:06.527466] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-21T19:28:06.557677] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-21T19:28:06.884107] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:28:07.182369] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T19:28:07.351027] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-21T19:28:08.151011] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-21T19:28:08.320904] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T19:28:08.395528] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T19:28:08.951019] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-21T19:28:09.481575] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T19:28:09.751010] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-21T19:28:09.775736] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T19:28:10.230391] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-21T19:28:10.551048] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-21T19:28:11.131204] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-21T19:28:11.351018] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-21T19:28:11.973260] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-21T19:28:12.151064] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-21T19:28:12.951030] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-21T19:28:13.395352] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T19:28:13.751021] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-21T19:28:14.293219] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T19:28:14.551044] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-21T19:28:15.161007] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-21T19:28:15.166839] [INFO ] [REMOTE ] JFR: Full fetch complete (48379 records). [2025-10-21T19:28:15.166957] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-21T19:28:15.357022] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-21T19:28:15.568879] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-21T19:28:15.568954] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-21T19:28:15.569728] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-21T19:28:15.569790] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-21T19:28:15.570700] [DEBUG] [LOCAL ] JFR: Trimmed 48379 records to 31046 (keeping 200 days of data) [2025-10-21T19:28:15.750703] [DEBUG] [LOCAL ] JFR: Primary data saved (31046 records). [2025-10-21T19:28:15.750836] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-21T19:28:15.750924] [INFO ] [MAIN ] Update Progress: 1151/2366 symbols completed. JFR took 45.4s. Estimated remaining: 2h 36m 26s. Rate: 7.8 symbols/min [2025-10-21T19:28:15.922267] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:28:15.938374] [DEBUG] [LOCAL ] JILL: Loaded 15604 existing records from primary storage. [2025-10-21T19:28:15.938576] [INFO ] [MAIN ] JILL: Loaded 15604 existing records. [2025-10-21T19:28:16.117611] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:28:16.117848] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-21T19:28:16.117916] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-21T19:28:16.118145] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-21T19:28:16.118202] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-21T19:28:16.162732] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-21T19:28:16.492009] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:28:16.520606] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-21T19:28:16.682138] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-21T19:28:16.961149] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-21T19:28:16.964045] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T19:28:17.751019] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-21T19:28:17.765222] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-21T19:28:18.317668] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-21T19:28:18.550999] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-21T19:28:19.351061] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-21T19:28:20.151127] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-21T19:28:20.299041] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T19:28:20.317230] [INFO ] [REMOTE ] JHG: Full fetch complete (68627 records). [2025-10-21T19:28:20.317605] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T19:28:20.318077] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-21T19:28:20.735030] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-21T19:28:20.735111] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-21T19:28:20.736128] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-21T19:28:20.736190] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-21T19:28:20.737504] [DEBUG] [LOCAL ] JHG: Trimmed 68627 records to 47511 (keeping 200 days of data) [2025-10-21T19:28:20.951713] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-21T19:28:21.017508] [DEBUG] [LOCAL ] JHG: Primary data saved (47511 records). [2025-10-21T19:28:21.017692] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-21T19:28:21.018121] [INFO ] [MAIN ] Update Progress: 1152/2366 symbols completed. JHG took 42.7s. Estimated remaining: 2h 36m 16s. Rate: 7.8 symbols/min [2025-10-21T19:28:21.187420] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:28:21.225034] [DEBUG] [LOCAL ] JKS: Loaded 39426 existing records from primary storage. [2025-10-21T19:28:21.225324] [INFO ] [MAIN ] JKS: Loaded 39426 existing records. [2025-10-21T19:28:21.399790] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:28:21.400013] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-21T19:28:21.400061] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-21T19:28:21.400257] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-21T19:28:21.400312] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-21T19:28:21.755005] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-21T19:28:21.759960] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:28:21.987071] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-21T19:28:22.020059] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-21T19:28:22.357083] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-21T19:28:22.358204] [INFO ] [REMOTE ] JHS: Full fetch complete (4530 records). [2025-10-21T19:28:22.358274] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-21T19:28:22.556798] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-21T19:28:22.723479] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-21T19:28:22.723554] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-21T19:28:22.723708] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-21T19:28:22.723766] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-21T19:28:22.724103] [DEBUG] [LOCAL ] JHS: Trimmed 4530 records to 2986 (keeping 200 days of data) [2025-10-21T19:28:22.741622] [DEBUG] [LOCAL ] JHS: Primary data saved (2986 records). [2025-10-21T19:28:22.741711] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-21T19:28:22.741787] [INFO ] [MAIN ] Update Progress: 1153/2366 symbols completed. JHS took 29.1s. Estimated remaining: 2h 36m 2s. Rate: 7.8 symbols/min [2025-10-21T19:28:22.916846] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:28:22.949413] [DEBUG] [LOCAL ] JLL: Loaded 31753 existing records from primary storage. [2025-10-21T19:28:22.949703] [INFO ] [MAIN ] JLL: Loaded 31753 existing records. [2025-10-21T19:28:23.133529] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:28:23.133792] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-21T19:28:23.133842] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-21T19:28:23.134022] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-21T19:28:23.134092] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-21T19:28:23.356103] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-21T19:28:23.507285] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:28:23.710271] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-21T19:28:24.151082] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-21T19:28:24.951079] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-21T19:28:25.014543] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-21T19:28:25.194744] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-21T19:28:25.751036] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-21T19:28:26.555249] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-21T19:28:26.560358] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T19:28:26.785603] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T19:28:27.351009] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-21T19:28:27.924577] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T19:28:28.151088] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-21T19:28:28.840118] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T19:28:28.951010] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-21T19:28:29.510777] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-21T19:28:29.751081] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-21T19:28:30.505997] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T19:28:30.550988] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-21T19:28:30.655595] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-21T19:28:31.351025] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-21T19:28:32.150995] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-21T19:28:32.287261] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T19:28:32.951024] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-21T19:28:33.192826] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T19:28:33.475633] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-21T19:28:33.751026] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-21T19:28:34.541783] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T19:28:34.550974] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-21T19:28:35.351036] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-21T19:28:35.613091] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-21T19:28:35.914896] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-21T19:28:36.151040] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-21T19:28:36.806783] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T19:28:36.950990] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-21T19:28:37.106134] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-21T19:28:37.751038] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-21T19:28:38.396416] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T19:28:38.551031] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-21T19:28:39.231538] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T19:28:39.351027] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-21T19:28:39.927338] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T19:28:40.151028] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-21T19:28:40.951004] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-21T19:28:41.205701] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-21T19:28:41.213868] [INFO ] [REMOTE ] JHX: Full fetch complete (62291 records). [2025-10-21T19:28:41.213985] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-21T19:28:41.608473] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-21T19:28:41.608633] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-21T19:28:41.609591] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-21T19:28:41.609714] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-21T19:28:41.611195] [DEBUG] [LOCAL ] JHX: Trimmed 62291 records to 53200 (keeping 200 days of data) [2025-10-21T19:28:41.736736] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T19:28:41.751868] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-21T19:28:41.966880] [DEBUG] [LOCAL ] JHX: Primary data saved (53200 records). [2025-10-21T19:28:41.967008] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-21T19:28:41.967086] [INFO ] [MAIN ] Update Progress: 1154/2366 symbols completed. JHX took 35.8s. Estimated remaining: 2h 36m 6s. Rate: 7.8 symbols/min [2025-10-21T19:28:42.083888] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T19:28:42.160299] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:28:42.166847] [DEBUG] [LOCAL ] JLS: Loaded 4066 existing records from primary storage. [2025-10-21T19:28:42.167022] [INFO ] [MAIN ] JLS: Loaded 4066 existing records. [2025-10-21T19:28:42.344427] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:28:42.344685] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-21T19:28:42.344754] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-21T19:28:42.344897] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-21T19:28:42.344936] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-21T19:28:42.559905] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-21T19:28:42.714290] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:28:43.254867] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T19:28:43.350995] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-21T19:28:43.851610] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T19:28:44.151087] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-21T19:28:44.913358] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-21T19:28:44.913545] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-21T19:28:44.921610] [INFO ] [REMOTE ] JKS: Full fetch complete (58723 records). [2025-10-21T19:28:44.921781] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-21T19:28:44.956118] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-21T19:28:45.337142] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-21T19:28:45.337223] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-21T19:28:45.338124] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-21T19:28:45.338188] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-21T19:28:45.339325] [DEBUG] [LOCAL ] JKS: Trimmed 58723 records to 39289 (keeping 200 days of data) [2025-10-21T19:28:45.583380] [DEBUG] [LOCAL ] JKS: Primary data saved (39289 records). [2025-10-21T19:28:45.583510] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-21T19:28:45.583592] [INFO ] [MAIN ] Update Progress: 1155/2366 symbols completed. JKS took 24.6s. Estimated remaining: 2h 35m 54s. Rate: 7.8 symbols/min [2025-10-21T19:28:45.661956] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-21T19:28:45.757700] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:28:45.757760] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-21T19:28:45.805626] [DEBUG] [LOCAL ] JMIA: Loaded 51222 existing records from primary storage. [2025-10-21T19:28:45.805971] [INFO ] [MAIN ] JMIA: Loaded 51222 existing records. [2025-10-21T19:28:45.986094] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:28:45.986287] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-21T19:28:45.986334] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-21T19:28:45.986518] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-21T19:28:45.986554] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-21T19:28:46.347813] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:28:46.378473] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-21T19:28:46.550999] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-21T19:28:47.351100] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-21T19:28:47.727425] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-21T19:28:48.021234] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T19:28:48.150988] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-21T19:28:48.951044] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-21T19:28:49.599507] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-21T19:28:49.751013] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-21T19:28:49.940813] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T19:28:50.551075] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-21T19:28:51.140756] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T19:28:51.351008] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-21T19:28:51.481388] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T19:28:51.483973] [INFO ] [REMOTE ] JILL: Full fetch complete (22371 records). [2025-10-21T19:28:51.484064] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-21T19:28:51.856490] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-21T19:28:51.856578] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-21T19:28:51.857060] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-21T19:28:51.857122] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-21T19:28:51.857983] [DEBUG] [LOCAL ] JILL: Trimmed 22371 records to 15442 (keeping 200 days of data) [2025-10-21T19:28:51.948377] [DEBUG] [LOCAL ] JILL: Primary data saved (15442 records). [2025-10-21T19:28:51.948503] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-21T19:28:51.948579] [INFO ] [MAIN ] Update Progress: 1156/2366 symbols completed. JILL took 36.2s. Estimated remaining: 2h 35m 45s. Rate: 7.8 symbols/min [2025-10-21T19:28:52.114511] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:28:52.114695] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-21T19:28:52.114745] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-21T19:28:52.114852] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-21T19:28:52.114892] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-21T19:28:52.114932] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-21T19:28:52.114962] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-21T19:28:52.157326] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-21T19:28:52.475693] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:28:52.885188] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-21T19:28:52.888080] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T19:28:52.951084] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-21T19:28:53.289827] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-21T19:28:53.751095] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-21T19:28:54.551010] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-21T19:28:55.119059] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T19:28:55.129500] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-21T19:28:55.351025] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-21T19:28:56.150998] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-21T19:28:56.507195] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T19:28:56.511572] [INFO ] [REMOTE ] JLL: Full fetch complete (45067 records). [2025-10-21T19:28:56.511690] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-21T19:28:56.751375] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-21T19:28:56.898436] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-21T19:28:56.898513] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-21T19:28:56.899336] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-21T19:28:56.899397] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-21T19:28:56.900357] [DEBUG] [LOCAL ] JLL: Trimmed 45067 records to 31598 (keeping 200 days of data) [2025-10-21T19:28:56.958925] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-21T19:28:57.091325] [DEBUG] [LOCAL ] JLL: Primary data saved (31598 records). [2025-10-21T19:28:57.091454] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-21T19:28:57.091534] [INFO ] [MAIN ] Update Progress: 1157/2366 symbols completed. JLL took 34.3s. Estimated remaining: 2h 35m 35s. Rate: 7.8 symbols/min [2025-10-21T19:28:57.751024] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-21T19:28:58.292860] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-21T19:28:58.551084] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-21T19:28:58.749861] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T19:28:59.098357] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-21T19:28:59.100184] [INFO ] [REMOTE ] JLS: Full fetch complete (5825 records). [2025-10-21T19:28:59.100281] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-21T19:28:59.356246] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-21T19:28:59.469960] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-21T19:28:59.470041] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-21T19:28:59.470231] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-21T19:28:59.470291] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-21T19:28:59.470679] [DEBUG] [LOCAL ] JLS: Trimmed 5825 records to 4074 (keeping 200 days of data) [2025-10-21T19:28:59.494727] [DEBUG] [LOCAL ] JLS: Primary data saved (4074 records). [2025-10-21T19:28:59.494800] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-21T19:28:59.494869] [INFO ] [MAIN ] Update Progress: 1158/2366 symbols completed. JLS took 17.5s. Estimated remaining: 2h 35m 21s. Rate: 7.8 symbols/min [2025-10-21T19:29:00.151041] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-21T19:29:00.768769] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-21T19:29:00.951022] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-21T19:29:01.344820] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-21T19:29:01.348510] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-21T19:29:01.751051] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-21T19:29:02.551071] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-21T19:29:03.004069] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-21T19:29:03.351082] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-21T19:29:03.465907] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T19:29:03.839103] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-21T19:29:04.151048] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-21T19:29:04.951064] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-21T19:29:05.421821] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-21T19:29:05.751081] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-21T19:29:05.843792] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T19:29:06.224878] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-21T19:29:06.551023] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-21T19:29:07.010103] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-21T19:29:07.351053] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-21T19:29:08.151049] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-21T19:29:08.596085] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-21T19:29:08.951057] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-21T19:29:09.203794] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-21T19:29:09.442202] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-21T19:29:09.443142] [INFO ] [REMOTE ] JMM: Full fetch complete (2295 records). [2025-10-21T19:29:09.443215] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-21T19:29:09.642558] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-21T19:29:09.642804] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:29:09.642872] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:29:09.642947] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-21T19:29:09.643014] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-21T19:29:09.643053] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-21T19:29:09.643094] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-21T19:29:09.643157] [INFO ] [MAIN ] Update Progress: 1159/2366 symbols completed. JMM took 17.7s. Estimated remaining: 2h 35m 16s. Rate: 7.8 symbols/min [2025-10-21T19:29:09.751031] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-21T19:29:11.727915] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-21T19:29:11.740269] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-21T19:29:13.546199] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T19:29:13.558764] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-21T19:29:15.627971] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-21T19:29:15.636938] [INFO ] [REMOTE ] JMIA: Full fetch complete (73460 records). [2025-10-21T19:29:15.637045] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-21T19:29:16.031610] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-21T19:29:16.031734] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-21T19:29:16.032887] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-21T19:29:16.032954] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-21T19:29:16.034371] [DEBUG] [LOCAL ] JMIA: Trimmed 73460 records to 51203 (keeping 200 days of data) [2025-10-21T19:29:16.330209] [DEBUG] [LOCAL ] JMIA: Primary data saved (51203 records). [2025-10-21T19:29:16.330347] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-21T19:29:16.330437] [INFO ] [MAIN ] Update Progress: 1160/2366 symbols completed. JMIA took 30.7s. Estimated remaining: 2h 35m 7s. Rate: 7.8 symbols/min [2025-10-21T19:29:16.975261] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:29:16.962448] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:29:17.038815] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:29:17.110533] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:29:17.114472] [DEBUG] [LOCAL ] JOF: Loaded 6925 existing records from primary storage. [2025-10-21T19:29:17.115319] [INFO ] [MAIN ] JOF: Loaded 6925 existing records. [2025-10-21T19:29:17.346780] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:29:17.348952] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-21T19:29:17.364933] [DEBUG] [LOCAL ] JOE: Loaded 23890 existing records from primary storage. [2025-10-21T19:29:17.364525] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-21T19:29:17.366902] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-21T19:29:17.367264] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-21T19:29:17.367074] [INFO ] [MAIN ] JOE: Loaded 23890 existing records. [2025-10-21T19:29:17.403111] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-21T19:29:17.428493] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-21T19:29:17.463126] [DEBUG] [LOCAL ] JOBY: Loaded 53809 existing records from primary storage. [2025-10-21T19:29:17.513220] [INFO ] [MAIN ] JOBY: Loaded 53809 existing records. [2025-10-21T19:29:18.033966] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:29:18.058845] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-21T19:29:18.064740] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-21T19:29:18.058676] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:29:18.110445] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-21T19:29:18.129758] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-21T19:29:18.168767] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-21T19:29:18.168712] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-21T19:29:18.259793] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-21T19:29:18.262982] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:29:18.286368] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-21T19:29:18.285968] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-21T19:29:18.302218] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-21T19:29:18.333461] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-21T19:29:18.343842] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-21T19:29:18.528258] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:29:18.596303] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-21T19:29:19.294797] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:29:19.346702] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-21T19:29:19.380161] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:29:19.385397] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-21T19:29:19.420423] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-21T19:29:19.423585] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:29:19.427110] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-21T19:29:19.426555] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-21T19:29:20.040609] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T19:29:20.042113] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-21T19:29:20.661088] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T19:29:20.666826] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-21T19:29:20.767005] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-21T19:29:20.769335] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-21T19:29:21.596389] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-21T19:29:21.607192] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-21T19:29:21.619744] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-21T19:29:21.622182] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-21T19:29:21.641385] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T19:29:21.646891] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-21T19:29:21.770168] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-21T19:29:21.781300] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-21T19:29:22.271786] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-21T19:29:22.273535] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-21T19:29:22.703413] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-21T19:29:22.705864] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-21T19:29:22.722985] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T19:29:23.322892] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-21T19:29:23.351002] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-21T19:29:23.439269] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T19:29:23.799411] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-21T19:29:24.151045] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-21T19:29:24.281012] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-21T19:29:24.951020] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-21T19:29:25.476670] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T19:29:25.674876] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-21T19:29:25.751020] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-21T19:29:26.551014] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-21T19:29:26.720692] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-21T19:29:27.351032] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-21T19:29:28.151091] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-21T19:29:28.838018] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-21T19:29:28.951006] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-21T19:29:29.310303] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T19:29:29.495201] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-21T19:29:29.751022] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-21T19:29:30.551083] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-21T19:29:31.088155] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-21T19:29:31.284176] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-21T19:29:31.285742] [INFO ] [REMOTE ] JOF: Full fetch complete (9471 records). [2025-10-21T19:29:31.285809] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-21T19:29:31.360685] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-21T19:29:31.653710] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-21T19:29:31.653792] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-21T19:29:31.654038] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-21T19:29:31.654077] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-21T19:29:31.654488] [DEBUG] [LOCAL ] JOF: Trimmed 9471 records to 6932 (keeping 200 days of data) [2025-10-21T19:29:31.695956] [DEBUG] [LOCAL ] JOF: Primary data saved (6932 records). [2025-10-21T19:29:31.696064] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-21T19:29:31.696138] [INFO ] [MAIN ] Update Progress: 1161/2366 symbols completed. JOF took 15.3s. Estimated remaining: 2h 35m 8s. Rate: 7.8 symbols/min [2025-10-21T19:29:31.874984] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:29:31.926288] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-21T19:29:31.949787] [DEBUG] [LOCAL ] JPC: Loaded 37073 existing records from primary storage. [2025-10-21T19:29:31.950404] [INFO ] [MAIN ] JPC: Loaded 37073 existing records. [2025-10-21T19:29:32.134405] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:29:32.134617] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-21T19:29:32.134696] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-21T19:29:32.134891] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-21T19:29:32.134930] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-21T19:29:32.156596] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-21T19:29:32.511161] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:29:32.555126] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T19:29:32.951032] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-21T19:29:33.751001] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-21T19:29:34.042099] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T19:29:34.446998] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-21T19:29:34.550992] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-21T19:29:35.351043] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-21T19:29:36.150999] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-21T19:29:36.257951] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-21T19:29:36.475498] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-21T19:29:36.716393] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-21T19:29:36.951103] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-21T19:29:37.694485] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T19:29:37.750999] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-21T19:29:38.551049] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-21T19:29:39.123971] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T19:29:39.322829] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-21T19:29:39.350976] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-21T19:29:39.717539] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T19:29:39.721190] [INFO ] [REMOTE ] JOE: Full fetch complete (35550 records). [2025-10-21T19:29:39.721263] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-21T19:29:40.100390] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-21T19:29:40.100463] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-21T19:29:40.101157] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-21T19:29:40.101217] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-21T19:29:40.101972] [DEBUG] [LOCAL ] JOE: Trimmed 35550 records to 23783 (keeping 200 days of data) [2025-10-21T19:29:40.152032] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-21T19:29:40.242263] [DEBUG] [LOCAL ] JOE: Primary data saved (23783 records). [2025-10-21T19:29:40.242380] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-21T19:29:40.242453] [INFO ] [MAIN ] Update Progress: 1162/2366 symbols completed. JOE took 23.9s. Estimated remaining: 2h 35m 1s. Rate: 7.8 symbols/min [2025-10-21T19:29:40.410612] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:29:40.459025] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-21T19:29:40.459322] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-21T19:29:40.631031] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:29:40.631267] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-21T19:29:40.631320] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-21T19:29:40.631498] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-21T19:29:40.631535] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-21T19:29:40.953674] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-21T19:29:40.979230] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:29:41.648190] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-21T19:29:41.674306] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T19:29:41.751016] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-21T19:29:42.551160] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-21T19:29:43.152213] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-21T19:29:43.186026] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T19:29:43.351002] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-21T19:29:44.151026] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-21T19:29:44.795937] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-21T19:29:44.830384] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T19:29:44.950991] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-21T19:29:45.751021] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-21T19:29:46.257254] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T19:29:46.473787] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-21T19:29:46.548808] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T19:29:46.556695] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-21T19:29:46.558672] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-10-21T19:29:46.558840] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-21T19:29:47.011247] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-21T19:29:47.011340] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-21T19:29:47.012464] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-21T19:29:47.012541] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-21T19:29:47.014201] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 53753 (keeping 200 days of data) [2025-10-21T19:29:47.355325] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-21T19:29:47.363723] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-10-21T19:29:47.363968] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-21T19:29:47.364059] [INFO ] [MAIN ] Update Progress: 1163/2366 symbols completed. JNJ took 31.0s. Estimated remaining: 2h 34m 52s. Rate: 7.8 symbols/min [2025-10-21T19:29:47.559447] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:29:47.590905] [DEBUG] [LOCAL ] JQC: Loaded 33824 existing records from primary storage. [2025-10-21T19:29:47.591181] [INFO ] [MAIN ] JQC: Loaded 33824 existing records. [2025-10-21T19:29:47.770202] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:29:47.770447] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-21T19:29:47.770514] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-21T19:29:47.770779] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-21T19:29:47.770856] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-21T19:29:48.148096] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:29:48.150986] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-21T19:29:48.937105] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T19:29:48.950989] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-21T19:29:49.431902] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-10-21T19:29:49.594800] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T19:29:49.751050] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-21T19:29:50.383113] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T19:29:50.551045] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-21T19:29:50.784366] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T19:29:51.351052] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-21T19:29:52.151018] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-21T19:29:52.751795] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T19:29:52.951022] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-21T19:29:53.266528] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-10-21T19:29:53.572368] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-21T19:29:53.751038] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-21T19:29:54.378190] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T19:29:54.384456] [INFO ] [REMOTE ] JPC: Full fetch complete (55059 records). [2025-10-21T19:29:54.384611] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-21T19:29:54.564209] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-21T19:29:54.782283] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-21T19:29:54.782381] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-21T19:29:54.783201] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-21T19:29:54.783262] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-21T19:29:54.784349] [DEBUG] [LOCAL ] JPC: Trimmed 55059 records to 37060 (keeping 200 days of data) [2025-10-21T19:29:55.003694] [DEBUG] [LOCAL ] JPC: Primary data saved (37060 records). [2025-10-21T19:29:55.003912] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-21T19:29:55.004065] [INFO ] [MAIN ] Update Progress: 1164/2366 symbols completed. JPC took 23.3s. Estimated remaining: 2h 34m 44s. Rate: 7.8 symbols/min [2025-10-21T19:29:55.179240] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:29:55.196828] [DEBUG] [LOCAL ] JRI: Loaded 15423 existing records from primary storage. [2025-10-21T19:29:55.197066] [INFO ] [MAIN ] JRI: Loaded 15423 existing records. [2025-10-21T19:29:55.402804] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:29:55.372818] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-21T19:29:55.403696] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-21T19:29:55.404024] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-21T19:29:55.406134] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T19:29:55.413574] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-21T19:29:55.413731] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-21T19:29:55.773877] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:29:56.151082] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-21T19:29:56.813118] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-21T19:29:56.951052] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-21T19:29:57.445506] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T19:29:57.751048] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-21T19:29:58.166094] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-10-21T19:29:58.550992] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-21T19:29:58.919546] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T19:29:59.186942] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-21T19:29:59.351031] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-21T19:30:00.151080] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-21T19:30:00.951003] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-21T19:30:01.154251] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T19:30:01.315628] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.76 seconds). [2025-10-21T19:30:01.324507] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-10-21T19:30:01.324718] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-21T19:30:01.751954] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-21T19:30:01.820785] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-21T19:30:01.821043] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-21T19:30:01.822111] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-21T19:30:01.822188] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-21T19:30:01.823752] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 53809 (keeping 200 days of data) [2025-10-21T19:30:01.990081] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-21T19:30:02.208130] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-21T19:30:02.309179] [DEBUG] [LOCAL ] JOBY: Primary data saved (53809 records). [2025-10-21T19:30:02.309337] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-21T19:30:02.309419] [INFO ] [MAIN ] Update Progress: 1165/2366 symbols completed. JOBY took 46.0s. Estimated remaining: 2h 34m 36s. Rate: 7.8 symbols/min [2025-10-21T19:30:02.485386] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:30:02.497857] [DEBUG] [LOCAL ] JRS: Loaded 11623 existing records from primary storage. [2025-10-21T19:30:02.498097] [INFO ] [MAIN ] JRS: Loaded 11623 existing records. [2025-10-21T19:30:02.562199] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-21T19:30:02.681676] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:30:02.681973] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-21T19:30:02.682029] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-21T19:30:02.682188] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-21T19:30:02.682243] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-21T19:30:02.993723] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-21T19:30:03.071708] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:30:03.351027] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-21T19:30:04.150997] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-21T19:30:04.377173] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-21T19:30:04.633915] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-21T19:30:04.951016] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-21T19:30:05.470969] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T19:30:05.751025] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-21T19:30:06.542254] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-21T19:30:06.550975] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-21T19:30:07.182145] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-21T19:30:07.245361] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T19:30:07.350986] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-21T19:30:08.151025] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-21T19:30:08.644384] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-21T19:30:08.950991] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-21T19:30:09.164464] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-21T19:30:09.751014] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-21T19:30:09.792225] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-21T19:30:10.551018] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-21T19:30:10.689710] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T19:30:11.351010] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-21T19:30:11.382639] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-21T19:30:12.151025] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-21T19:30:12.927225] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T19:30:12.950974] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-21T19:30:13.524533] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-21T19:30:13.751022] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-21T19:30:13.785086] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-21T19:30:14.551001] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-21T19:30:14.701188] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-21T19:30:15.351012] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-21T19:30:15.950450] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T19:30:15.956428] [INFO ] [REMOTE ] JQC: Full fetch complete (49963 records). [2025-10-21T19:30:15.956529] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-21T19:30:16.164541] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-21T19:30:16.369221] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-21T19:30:16.369366] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-21T19:30:16.370350] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-21T19:30:16.370555] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-21T19:30:16.382882] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-21T19:30:16.387471] [DEBUG] [LOCAL ] JQC: Trimmed 49963 records to 33940 (keeping 200 days of data) [2025-10-21T19:30:16.580416] [DEBUG] [LOCAL ] JQC: Primary data saved (33940 records). [2025-10-21T19:30:16.580546] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-21T19:30:16.580672] [INFO ] [MAIN ] Update Progress: 1166/2366 symbols completed. JQC took 29.2s. Estimated remaining: 2h 34m 35s. Rate: 7.8 symbols/min [2025-10-21T19:30:16.746541] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:30:16.786241] [DEBUG] [LOCAL ] JXN: Loaded 44551 existing records from primary storage. [2025-10-21T19:30:16.786516] [INFO ] [MAIN ] JXN: Loaded 44551 existing records. [2025-10-21T19:30:16.967394] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:30:16.961614] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-21T19:30:16.968406] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-21T19:30:16.968471] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-21T19:30:16.969015] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-21T19:30:16.969094] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-21T19:30:17.268804] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T19:30:17.341345] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:30:17.751077] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-21T19:30:18.551079] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-21T19:30:19.000101] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-21T19:30:19.054034] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T19:30:19.305252] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-21T19:30:19.351020] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-21T19:30:20.151058] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-21T19:30:20.844634] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T19:30:20.951022] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-21T19:30:20.989257] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-21T19:30:21.748641] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T19:30:21.751610] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-21T19:30:22.551029] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-21T19:30:23.351021] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-21T19:30:23.467279] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T19:30:24.152714] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-21T19:30:24.158272] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-21T19:30:24.294915] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T19:30:24.298113] [INFO ] [REMOTE ] JRS: Full fetch complete (16214 records). [2025-10-21T19:30:24.298235] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-21T19:30:24.694736] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-21T19:30:24.694857] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-21T19:30:24.695681] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-21T19:30:24.695752] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-21T19:30:24.696611] [DEBUG] [LOCAL ] JRS: Trimmed 16214 records to 11594 (keeping 200 days of data) [2025-10-21T19:30:24.770796] [DEBUG] [LOCAL ] JRS: Primary data saved (11594 records). [2025-10-21T19:30:24.770987] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-21T19:30:24.771085] [INFO ] [MAIN ] Update Progress: 1167/2366 symbols completed. JRS took 22.5s. Estimated remaining: 2h 34m 28s. Rate: 7.8 symbols/min [2025-10-21T19:30:24.956239] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-21T19:30:24.962103] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:30:25.015478] [DEBUG] [LOCAL ] K: Loaded 50372 existing records from primary storage. [2025-10-21T19:30:25.015849] [INFO ] [MAIN ] K: Loaded 50372 existing records. [2025-10-21T19:30:25.193181] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:30:25.193385] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-21T19:30:25.193431] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-21T19:30:25.193612] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-21T19:30:25.193687] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-21T19:30:25.549582] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:30:25.751024] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-21T19:30:25.836712] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T19:30:25.845319] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-10-21T19:30:25.845561] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-21T19:30:25.978532] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T19:30:26.273309] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-21T19:30:26.273395] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-21T19:30:26.274407] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-21T19:30:26.274472] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-21T19:30:26.275900] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 53794 (keeping 200 days of data) [2025-10-21T19:30:26.560388] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-21T19:30:26.611325] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-10-21T19:30:26.611472] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-21T19:30:26.611553] [INFO ] [MAIN ] Update Progress: 1168/2366 symbols completed. JPM took 46.4s. Estimated remaining: 2h 34m 14s. Rate: 7.8 symbols/min [2025-10-21T19:30:26.784006] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:30:26.798514] [DEBUG] [LOCAL ] KAI: Loaded 13606 existing records from primary storage. [2025-10-21T19:30:26.798744] [INFO ] [MAIN ] KAI: Loaded 13606 existing records. [2025-10-21T19:30:26.990534] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:30:26.990770] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-21T19:30:26.990839] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-21T19:30:26.991040] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-21T19:30:26.991096] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-21T19:30:27.358086] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-21T19:30:27.363869] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:30:27.392515] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T19:30:27.546380] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T19:30:27.549512] [INFO ] [REMOTE ] JRI: Full fetch complete (23063 records). [2025-10-21T19:30:27.549585] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-21T19:30:27.915316] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-21T19:30:27.915394] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-21T19:30:27.915906] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-21T19:30:27.915971] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-21T19:30:27.916526] [DEBUG] [LOCAL ] JRI: Trimmed 23063 records to 15402 (keeping 200 days of data) [2025-10-21T19:30:28.021857] [DEBUG] [LOCAL ] JRI: Primary data saved (15402 records). [2025-10-21T19:30:28.022002] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-21T19:30:28.022082] [INFO ] [MAIN ] Update Progress: 1169/2366 symbols completed. JRI took 33.0s. Estimated remaining: 2h 34m 0s. Rate: 7.8 symbols/min [2025-10-21T19:30:28.156103] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-21T19:30:28.202960] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:30:28.237904] [DEBUG] [LOCAL ] KAR: Loaded 39864 existing records from primary storage. [2025-10-21T19:30:28.238174] [INFO ] [MAIN ] KAR: Loaded 39864 existing records. [2025-10-21T19:30:28.412180] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:30:28.412369] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-21T19:30:28.412414] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-21T19:30:28.412714] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-21T19:30:28.412770] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-21T19:30:28.769268] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:30:28.799594] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T19:30:28.951029] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-21T19:30:29.751082] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-21T19:30:29.803418] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T19:30:30.551034] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-21T19:30:30.610720] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T19:30:31.064782] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T19:30:31.351024] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-21T19:30:32.151081] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-21T19:30:32.194993] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T19:30:32.224420] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-21T19:30:32.951080] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-21T19:30:33.757287] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-21T19:30:33.760090] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T19:30:34.550996] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-21T19:30:34.628817] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T19:30:34.686476] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-21T19:30:35.351076] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-21T19:30:35.931432] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T19:30:36.151075] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-21T19:30:36.293904] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-21T19:30:36.951070] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-21T19:30:37.626817] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T19:30:37.751063] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-21T19:30:38.444305] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T19:30:38.550988] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-21T19:30:39.351077] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-21T19:30:39.502681] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T19:30:39.893908] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-21T19:30:40.151097] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-21T19:30:40.433985] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-21T19:30:40.951051] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-21T19:30:41.476876] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T19:30:41.751028] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-21T19:30:42.369361] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-21T19:30:42.551048] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-21T19:30:43.290224] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T19:30:43.351000] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-21T19:30:43.507928] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T19:30:44.151032] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-21T19:30:44.911181] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T19:30:44.951003] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-21T19:30:45.064041] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-21T19:30:45.751087] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-21T19:30:46.551003] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-21T19:30:46.686076] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T19:30:47.334270] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T19:30:47.350997] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-21T19:30:47.892499] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T19:30:48.151034] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-21T19:30:48.916431] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T19:30:48.922992] [INFO ] [REMOTE ] JXN: Full fetch complete (65529 records). [2025-10-21T19:30:48.923093] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-21T19:30:48.961148] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-21T19:30:49.360423] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-21T19:30:49.360521] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-21T19:30:49.361914] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-21T19:30:49.361983] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-21T19:30:49.363392] [DEBUG] [LOCAL ] JXN: Trimmed 65529 records to 44418 (keeping 200 days of data) [2025-10-21T19:30:49.657623] [DEBUG] [LOCAL ] JXN: Primary data saved (44418 records). [2025-10-21T19:30:49.657890] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-21T19:30:49.658104] [INFO ] [MAIN ] Update Progress: 1170/2366 symbols completed. JXN took 33.1s. Estimated remaining: 2h 34m 7s. Rate: 7.8 symbols/min [2025-10-21T19:30:49.752386] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-21T19:30:49.859359] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:30:49.883372] [DEBUG] [LOCAL ] KB: Loaded 23270 existing records from primary storage. [2025-10-21T19:30:49.883684] [INFO ] [MAIN ] KB: Loaded 23270 existing records. [2025-10-21T19:30:50.109332] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T19:30:50.116161] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:30:50.124277] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-21T19:30:50.124501] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-21T19:30:50.124739] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-21T19:30:50.124908] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-21T19:30:50.124852] [INFO ] [REMOTE ] K: Full fetch complete (72296 records). [2025-10-21T19:30:50.170711] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-21T19:30:50.870554] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:30:50.914197] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-21T19:30:50.947550] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-21T19:30:50.982283] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-21T19:30:50.984293] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-21T19:30:50.985413] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-21T19:30:50.983778] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T19:30:50.985880] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-21T19:30:50.991581] [DEBUG] [LOCAL ] K: Trimmed 72296 records to 50401 (keeping 200 days of data) [2025-10-21T19:30:51.287556] [DEBUG] [LOCAL ] K: Primary data saved (50401 records). [2025-10-21T19:30:51.287717] [INFO ] [MAIN ] K: Full history saved. [2025-10-21T19:30:51.287829] [INFO ] [MAIN ] Update Progress: 1171/2366 symbols completed. K took 26.5s. Estimated remaining: 2h 33m 53s. Rate: 7.8 symbols/min [2025-10-21T19:30:51.356241] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-21T19:30:51.456918] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:30:51.478664] [DEBUG] [LOCAL ] KBDC: Loaded 22651 existing records from primary storage. [2025-10-21T19:30:51.478911] [INFO ] [MAIN ] KBDC: Loaded 22651 existing records. [2025-10-21T19:30:51.652127] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:30:51.652360] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-21T19:30:51.652406] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-21T19:30:51.652565] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-21T19:30:51.652602] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-21T19:30:52.050761] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:30:52.095104] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T19:30:52.150999] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-21T19:30:52.253932] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-21T19:30:52.951077] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-21T19:30:53.481065] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T19:30:53.751062] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-21T19:30:54.049153] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T19:30:54.551044] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-21T19:30:54.645869] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-21T19:30:55.351064] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-21T19:30:55.957395] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-21T19:30:56.151950] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-21T19:30:56.152946] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-21T19:30:56.951020] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-21T19:30:57.636068] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T19:30:57.642394] [INFO ] [REMOTE ] KAR: Full fetch complete (56859 records). [2025-10-21T19:30:57.642516] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-21T19:30:57.754337] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-21T19:30:57.989164] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-21T19:30:58.073978] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-21T19:30:58.074052] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-21T19:30:58.074922] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-21T19:30:58.074986] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-21T19:30:58.076078] [DEBUG] [LOCAL ] KAR: Trimmed 56859 records to 39768 (keeping 200 days of data) [2025-10-21T19:30:58.300490] [DEBUG] [LOCAL ] KAR: Primary data saved (39768 records). [2025-10-21T19:30:58.300627] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-21T19:30:58.300742] [INFO ] [MAIN ] Update Progress: 1172/2366 symbols completed. KAR took 30.3s. Estimated remaining: 2h 33m 44s. Rate: 7.8 symbols/min [2025-10-21T19:30:58.470832] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:30:58.514062] [DEBUG] [LOCAL ] KBH: Loaded 48759 existing records from primary storage. [2025-10-21T19:30:58.514369] [INFO ] [MAIN ] KBH: Loaded 48759 existing records. [2025-10-21T19:30:58.556545] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-21T19:30:58.642045] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-21T19:30:58.715870] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:30:58.716107] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-21T19:30:58.716153] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-21T19:30:58.716399] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-21T19:30:58.716454] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-21T19:30:59.076448] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:30:59.351033] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-21T19:30:59.656252] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T19:31:00.151123] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-21T19:31:00.951094] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-21T19:31:01.411502] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-21T19:31:01.460508] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T19:31:01.751020] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-21T19:31:02.275330] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-21T19:31:02.278156] [INFO ] [REMOTE ] KAI: Full fetch complete (19268 records). [2025-10-21T19:31:02.278251] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-21T19:31:02.556122] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-21T19:31:02.647504] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-21T19:31:02.647595] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-21T19:31:02.648106] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-21T19:31:02.648168] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-21T19:31:02.648936] [DEBUG] [LOCAL ] KAI: Trimmed 19268 records to 13490 (keeping 200 days of data) [2025-10-21T19:31:02.731076] [DEBUG] [LOCAL ] KAI: Primary data saved (13490 records). [2025-10-21T19:31:02.731198] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-21T19:31:02.731275] [INFO ] [MAIN ] Update Progress: 1173/2366 symbols completed. KAI took 36.1s. Estimated remaining: 2h 33m 33s. Rate: 7.8 symbols/min [2025-10-21T19:31:02.900071] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:31:02.915150] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T19:31:02.956821] [DEBUG] [LOCAL ] KBR: Loaded 48051 existing records from primary storage. [2025-10-21T19:31:02.957102] [INFO ] [MAIN ] KBR: Loaded 48051 existing records. [2025-10-21T19:31:03.135229] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:31:03.135465] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-21T19:31:03.135532] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-21T19:31:03.135868] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-21T19:31:03.135924] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-21T19:31:03.361324] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-21T19:31:03.484984] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:31:03.798245] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-21T19:31:04.151018] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-21T19:31:04.782022] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T19:31:04.951055] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-21T19:31:05.280560] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-21T19:31:05.751051] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-21T19:31:06.551050] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-21T19:31:06.586171] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T19:31:07.327450] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T19:31:07.350987] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-21T19:31:07.523613] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T19:31:08.151056] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-21T19:31:08.933751] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T19:31:08.950977] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-21T19:31:08.991790] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-21T19:31:09.751025] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-21T19:31:10.550999] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-21T19:31:10.618495] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T19:31:10.837308] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T19:31:11.351043] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-21T19:31:12.151007] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-21T19:31:12.301673] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T19:31:12.809063] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-21T19:31:12.951022] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-21T19:31:13.174116] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T19:31:13.751035] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-21T19:31:14.234350] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T19:31:14.551068] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-21T19:31:15.159575] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T19:31:15.351025] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-21T19:31:15.605148] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-21T19:31:16.151006] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-21T19:31:16.518342] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-21T19:31:16.951055] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-21T19:31:17.751038] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-21T19:31:17.800428] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T19:31:17.849091] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-21T19:31:18.551077] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-21T19:31:19.328539] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T19:31:19.350992] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-21T19:31:19.884850] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T19:31:20.151031] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-21T19:31:20.951056] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-21T19:31:21.033232] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T19:31:21.358354] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T19:31:21.363286] [INFO ] [REMOTE ] KB: Full fetch complete (33599 records). [2025-10-21T19:31:21.363391] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-21T19:31:21.738153] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-21T19:31:21.738253] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-21T19:31:21.738948] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-21T19:31:21.739233] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-21T19:31:21.740143] [DEBUG] [LOCAL ] KB: Trimmed 33599 records to 23189 (keeping 200 days of data) [2025-10-21T19:31:21.792233] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-21T19:31:21.881824] [DEBUG] [LOCAL ] KB: Primary data saved (23189 records). [2025-10-21T19:31:21.881937] [INFO ] [MAIN ] KB: Full history saved. [2025-10-21T19:31:21.882008] [INFO ] [MAIN ] Update Progress: 1174/2366 symbols completed. KB took 32.2s. Estimated remaining: 2h 33m 37s. Rate: 7.8 symbols/min [2025-10-21T19:31:22.054040] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:31:22.103873] [DEBUG] [LOCAL ] KD: Loaded 52354 existing records from primary storage. [2025-10-21T19:31:22.104168] [INFO ] [MAIN ] KD: Loaded 52354 existing records. [2025-10-21T19:31:22.279903] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:31:22.280077] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-21T19:31:22.280122] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-21T19:31:22.280322] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-21T19:31:22.280377] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-21T19:31:22.558362] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-21T19:31:22.638816] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:31:22.667725] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T19:31:23.139322] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T19:31:23.144588] [INFO ] [REMOTE ] KBDC: Full fetch complete (30891 records). [2025-10-21T19:31:23.144700] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-21T19:31:23.356187] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-21T19:31:23.507523] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-21T19:31:23.507593] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-21T19:31:23.508215] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-21T19:31:23.508275] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-21T19:31:23.508992] [DEBUG] [LOCAL ] KBDC: Trimmed 30891 records to 22747 (keeping 200 days of data) [2025-10-21T19:31:23.639812] [DEBUG] [LOCAL ] KBDC: Primary data saved (22747 records). [2025-10-21T19:31:23.639931] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-21T19:31:23.640002] [INFO ] [MAIN ] Update Progress: 1175/2366 symbols completed. KBDC took 32.4s. Estimated remaining: 2h 33m 23s. Rate: 7.8 symbols/min [2025-10-21T19:31:23.808831] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:31:23.815102] [DEBUG] [LOCAL ] KEN: Loaded 4695 existing records from primary storage. [2025-10-21T19:31:23.815257] [INFO ] [MAIN ] KEN: Loaded 4695 existing records. [2025-10-21T19:31:23.995046] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:31:23.995262] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-21T19:31:23.995311] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-21T19:31:23.995574] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-21T19:31:23.995691] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-21T19:31:24.163288] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-21T19:31:24.299891] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T19:31:24.395730] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:31:24.951050] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-21T19:31:25.304484] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-21T19:31:25.523747] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-21T19:31:25.750991] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-21T19:31:25.861521] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T19:31:26.551043] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-21T19:31:27.128816] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T19:31:27.351062] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-21T19:31:27.804149] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-21T19:31:28.157975] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-21T19:31:28.160593] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-21T19:31:28.810450] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-21T19:31:28.951046] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-21T19:31:29.751109] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-21T19:31:30.551041] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-21T19:31:30.843999] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T19:31:30.851437] [INFO ] [REMOTE ] KBR: Full fetch complete (69927 records). [2025-10-21T19:31:30.851548] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-21T19:31:31.251588] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-21T19:31:31.251753] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-21T19:31:31.252862] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-21T19:31:31.252981] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-21T19:31:31.254493] [DEBUG] [LOCAL ] KBR: Trimmed 69927 records to 47999 (keeping 200 days of data) [2025-10-21T19:31:31.352451] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-21T19:31:31.366976] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-21T19:31:31.515412] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T19:31:31.606908] [DEBUG] [LOCAL ] KBR: Primary data saved (47999 records). [2025-10-21T19:31:31.607048] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-21T19:31:31.607128] [INFO ] [MAIN ] Update Progress: 1176/2366 symbols completed. KBR took 28.9s. Estimated remaining: 2h 33m 16s. Rate: 7.8 symbols/min [2025-10-21T19:31:31.778942] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:31:31.809767] [DEBUG] [LOCAL ] KEP: Loaded 32390 existing records from primary storage. [2025-10-21T19:31:31.810029] [INFO ] [MAIN ] KEP: Loaded 32390 existing records. [2025-10-21T19:31:31.988317] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:31:31.988507] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-21T19:31:31.988557] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-21T19:31:31.988776] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-21T19:31:31.988834] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-21T19:31:32.151337] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-21T19:31:32.379206] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:31:32.835453] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-21T19:31:32.875870] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T19:31:32.951032] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-21T19:31:33.751066] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-21T19:31:34.558863] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-21T19:31:34.577661] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T19:31:34.943820] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-21T19:31:35.191445] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-21T19:31:35.351072] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-21T19:31:35.963780] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-21T19:31:36.151043] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-21T19:31:36.950992] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-21T19:31:37.193750] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-21T19:31:37.751031] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-21T19:31:38.551014] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-21T19:31:38.698095] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T19:31:38.705991] [INFO ] [REMOTE ] KBH: Full fetch complete (71107 records). [2025-10-21T19:31:38.706130] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-21T19:31:38.842099] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-21T19:31:39.115159] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-21T19:31:39.115247] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-21T19:31:39.116202] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-21T19:31:39.116264] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-21T19:31:39.117584] [DEBUG] [LOCAL ] KBH: Trimmed 71107 records to 48751 (keeping 200 days of data) [2025-10-21T19:31:39.209075] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-21T19:31:39.355685] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-21T19:31:39.416549] [DEBUG] [LOCAL ] KBH: Primary data saved (48751 records). [2025-10-21T19:31:39.416678] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-21T19:31:39.416767] [INFO ] [MAIN ] Update Progress: 1177/2366 symbols completed. KBH took 41.1s. Estimated remaining: 2h 33m 8s. Rate: 7.8 symbols/min [2025-10-21T19:31:39.588094] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:31:39.624476] [DEBUG] [LOCAL ] KEX: Loaded 38824 existing records from primary storage. [2025-10-21T19:31:39.624781] [INFO ] [MAIN ] KEX: Loaded 38824 existing records. [2025-10-21T19:31:39.802965] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:31:39.803200] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-21T19:31:39.803256] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-21T19:31:39.803421] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-21T19:31:39.803460] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-21T19:31:40.098916] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T19:31:40.156135] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-21T19:31:40.189089] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:31:40.951083] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-21T19:31:41.445140] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-21T19:31:41.461092] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-21T19:31:41.462045] [INFO ] [REMOTE ] KEN: Full fetch complete (5922 records). [2025-10-21T19:31:41.462111] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-21T19:31:41.756232] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-21T19:31:41.834858] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-21T19:31:41.834963] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-21T19:31:41.835162] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-21T19:31:41.835203] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-21T19:31:41.835583] [DEBUG] [LOCAL ] KEN: Trimmed 5922 records to 4665 (keeping 200 days of data) [2025-10-21T19:31:41.863573] [DEBUG] [LOCAL ] KEN: Primary data saved (4665 records). [2025-10-21T19:31:41.863711] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-21T19:31:41.863800] [INFO ] [MAIN ] Update Progress: 1178/2366 symbols completed. KEN took 18.2s. Estimated remaining: 2h 32m 55s. Rate: 7.8 symbols/min [2025-10-21T19:31:42.035827] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:31:42.035991] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-21T19:31:42.036027] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-21T19:31:42.036141] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-21T19:31:42.036182] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-21T19:31:42.036220] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-21T19:31:42.036250] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-21T19:31:42.385034] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:31:42.551140] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-21T19:31:43.114735] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-21T19:31:43.351032] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-21T19:31:44.133337] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T19:31:44.150991] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-21T19:31:44.951011] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-21T19:31:45.026326] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T19:31:45.664460] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T19:31:45.751084] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-21T19:31:46.215505] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-21T19:31:46.551085] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-21T19:31:47.351071] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-21T19:31:47.601793] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T19:31:47.700522] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T19:31:48.151041] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-21T19:31:48.444459] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T19:31:48.951042] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-21T19:31:49.564838] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T19:31:49.751011] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-21T19:31:50.267014] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-21T19:31:50.551094] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-21T19:31:51.352677] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T19:31:51.351087] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-21T19:31:51.937803] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T19:31:52.151018] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-21T19:31:52.951028] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-21T19:31:53.298844] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T19:31:53.591504] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T19:31:53.751066] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-21T19:31:54.551003] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-21T19:31:54.640376] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T19:31:55.351050] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-21T19:31:55.658775] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T19:31:56.138428] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T19:31:56.150986] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-21T19:31:56.558445] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T19:31:56.951086] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-21T19:31:57.507715] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T19:31:57.751095] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-21T19:31:58.561748] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-21T19:31:58.569844] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T19:31:59.116213] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T19:31:59.351023] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-21T19:31:59.871534] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T19:32:00.151034] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-21T19:32:00.951027] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-21T19:32:01.589240] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-21T19:32:01.660522] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T19:32:01.751039] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-21T19:32:02.385816] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T19:32:02.391424] [INFO ] [REMOTE ] KEP: Full fetch complete (42411 records). [2025-10-21T19:32:02.391569] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-21T19:32:02.555203] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-21T19:32:02.796436] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-21T19:32:02.796512] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-21T19:32:02.797343] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-21T19:32:02.797404] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-21T19:32:02.798449] [DEBUG] [LOCAL ] KEP: Trimmed 42411 records to 32502 (keeping 200 days of data) [2025-10-21T19:32:02.980617] [DEBUG] [LOCAL ] KEP: Primary data saved (32502 records). [2025-10-21T19:32:02.980766] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-21T19:32:02.981634] [INFO ] [MAIN ] Update Progress: 1179/2366 symbols completed. KEP took 31.4s. Estimated remaining: 2h 33m 1s. Rate: 7.8 symbols/min [2025-10-21T19:32:03.151364] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:32:03.193176] [DEBUG] [LOCAL ] KEYS: Loaded 43295 existing records from primary storage. [2025-10-21T19:32:03.193468] [INFO ] [MAIN ] KEYS: Loaded 43295 existing records. [2025-10-21T19:32:03.354748] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-21T19:32:03.375919] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:32:03.377361] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-21T19:32:03.377475] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-21T19:32:03.377860] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-21T19:32:03.377919] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-21T19:32:03.730018] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-21T19:32:03.777357] [INFO ] [REMOTE ] KD: Full fetch complete (76120 records). [2025-10-21T19:32:03.777220] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:32:03.777859] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-21T19:32:04.161491] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-21T19:32:04.179820] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-21T19:32:04.180615] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-21T19:32:04.181967] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-21T19:32:04.190629] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-21T19:32:04.208909] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T19:32:04.217690] [DEBUG] [LOCAL ] KD: Trimmed 76120 records to 52344 (keeping 200 days of data) [2025-10-21T19:32:04.518729] [DEBUG] [LOCAL ] KD: Primary data saved (52344 records). [2025-10-21T19:32:04.518902] [INFO ] [MAIN ] KD: Full history saved. [2025-10-21T19:32:04.519735] [INFO ] [MAIN ] Update Progress: 1180/2366 symbols completed. KD took 42.6s. Estimated remaining: 2h 32m 47s. Rate: 7.8 symbols/min [2025-10-21T19:32:04.688361] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:32:04.692830] [DEBUG] [LOCAL ] KF: Loaded 2366 existing records from primary storage. [2025-10-21T19:32:04.692967] [INFO ] [MAIN ] KF: Loaded 2366 existing records. [2025-10-21T19:32:04.873127] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:32:04.873296] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-21T19:32:04.873342] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-21T19:32:04.873480] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-21T19:32:04.873535] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-21T19:32:04.964604] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-21T19:32:05.236448] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:32:05.331535] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-21T19:32:05.643205] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T19:32:05.751080] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-21T19:32:06.307226] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-21T19:32:06.392488] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T19:32:06.551035] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-21T19:32:07.351051] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-21T19:32:07.796480] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-21T19:32:08.135935] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T19:32:08.150986] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-21T19:32:08.951030] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-21T19:32:09.569825] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-21T19:32:09.751025] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-21T19:32:10.160464] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-21T19:32:10.167554] [INFO ] [REMOTE ] KEX: Full fetch complete (56094 records). [2025-10-21T19:32:10.167755] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-21T19:32:10.547910] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-21T19:32:10.547990] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-21T19:32:10.548848] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-21T19:32:10.548914] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-21T19:32:10.550122] [DEBUG] [LOCAL ] KEX: Trimmed 56094 records to 38788 (keeping 200 days of data) [2025-10-21T19:32:10.551013] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-21T19:32:10.775620] [DEBUG] [LOCAL ] KEX: Primary data saved (38788 records). [2025-10-21T19:32:10.775788] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-21T19:32:10.775885] [INFO ] [MAIN ] Update Progress: 1181/2366 symbols completed. KEX took 31.4s. Estimated remaining: 2h 32m 38s. Rate: 7.8 symbols/min [2025-10-21T19:32:10.948605] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:32:10.969542] [DEBUG] [LOCAL ] KFRC: Loaded 20727 existing records from primary storage. [2025-10-21T19:32:10.969781] [INFO ] [MAIN ] KFRC: Loaded 20727 existing records. [2025-10-21T19:32:11.147232] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:32:11.148027] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-21T19:32:11.148104] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-21T19:32:11.148381] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-21T19:32:11.148439] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-21T19:32:11.239071] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-21T19:32:11.358841] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-21T19:32:11.530159] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:32:11.553914] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T19:32:12.151071] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-21T19:32:12.682231] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-21T19:32:12.951028] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-21T19:32:13.034739] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T19:32:13.751021] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-21T19:32:14.332170] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-21T19:32:14.553943] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-21T19:32:14.561906] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T19:32:14.984252] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-21T19:32:15.351040] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-21T19:32:15.802095] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-21T19:32:16.151035] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-21T19:32:16.951001] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-21T19:32:17.213080] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-21T19:32:17.221574] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-10-21T19:32:17.221738] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-21T19:32:17.417281] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T19:32:17.420982] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-21T19:32:17.420850] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:32:17.422340] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:32:17.422419] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-21T19:32:17.422481] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-21T19:32:17.422515] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-21T19:32:17.422553] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-21T19:32:17.422607] [INFO ] [MAIN ] Update Progress: 1182/2366 symbols completed. KEY took 35.6s. Estimated remaining: 2h 32m 29s. Rate: 7.8 symbols/min [2025-10-21T19:32:17.591819] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:32:17.602495] [DEBUG] [LOCAL ] KFS: Loaded 8699 existing records from primary storage. [2025-10-21T19:32:17.602712] [INFO ] [MAIN ] KFS: Loaded 8699 existing records. [2025-10-21T19:32:17.761141] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-21T19:32:17.793938] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:32:17.794133] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-21T19:32:17.794179] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-21T19:32:17.794334] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-21T19:32:17.794388] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-21T19:32:18.166143] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:32:18.551025] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-21T19:32:19.103353] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-21T19:32:19.104329] [INFO ] [REMOTE ] KF: Full fetch complete (3512 records). [2025-10-21T19:32:19.104404] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-21T19:32:19.356293] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-21T19:32:19.469956] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-21T19:32:19.470030] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-21T19:32:19.470164] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-21T19:32:19.470202] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-21T19:32:19.470532] [DEBUG] [LOCAL ] KF: Trimmed 3512 records to 2359 (keeping 200 days of data) [2025-10-21T19:32:19.484120] [DEBUG] [LOCAL ] KF: Primary data saved (2359 records). [2025-10-21T19:32:19.484178] [INFO ] [MAIN ] KF: Full history saved. [2025-10-21T19:32:19.484241] [INFO ] [MAIN ] Update Progress: 1183/2366 symbols completed. KF took 15.0s. Estimated remaining: 2h 32m 15s. Rate: 7.8 symbols/min [2025-10-21T19:32:19.662553] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:32:19.695785] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T19:32:19.733407] [DEBUG] [LOCAL ] KFY: Loaded 29744 existing records from primary storage. [2025-10-21T19:32:19.733736] [INFO ] [MAIN ] KFY: Loaded 29744 existing records. [2025-10-21T19:32:19.851294] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-21T19:32:19.927717] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:32:19.927919] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-21T19:32:19.927969] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-21T19:32:19.928178] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-21T19:32:19.928235] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-21T19:32:20.160521] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-21T19:32:20.289288] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:32:20.951009] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-21T19:32:21.118303] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-21T19:32:21.751026] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-21T19:32:22.328841] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T19:32:22.551025] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-21T19:32:22.606343] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T19:32:23.351007] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-21T19:32:23.582947] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T19:32:24.036180] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-21T19:32:24.151038] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-21T19:32:24.951031] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-21T19:32:25.642081] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T19:32:25.751018] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-21T19:32:26.100331] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-21T19:32:26.515385] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-21T19:32:26.551017] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-21T19:32:27.351004] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-21T19:32:27.468908] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-21T19:32:28.131424] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T19:32:28.150974] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-21T19:32:28.951015] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-21T19:32:29.224429] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T19:32:29.751028] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-21T19:32:30.128620] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T19:32:30.510632] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-21T19:32:30.551025] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-21T19:32:31.351039] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-21T19:32:31.581514] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T19:32:32.151034] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-21T19:32:32.884468] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T19:32:32.950992] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-21T19:32:33.537948] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T19:32:33.751048] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-21T19:32:33.943323] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-21T19:32:34.551117] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-21T19:32:35.111116] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-21T19:32:35.351052] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-21T19:32:35.612012] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-21T19:32:36.151055] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-21T19:32:36.310220] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T19:32:36.951029] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-21T19:32:36.963896] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-21T19:32:37.751050] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-21T19:32:38.090231] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T19:32:38.551217] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-21T19:32:39.259925] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-21T19:32:39.346676] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T19:32:39.350968] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-21T19:32:40.069122] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-21T19:32:40.150997] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-21T19:32:40.925389] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-21T19:32:40.927277] [INFO ] [REMOTE ] KFS: Full fetch complete (11173 records). [2025-10-21T19:32:40.927343] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-21T19:32:40.956122] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-21T19:32:41.334710] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-21T19:32:41.334809] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-21T19:32:41.335117] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-21T19:32:41.335193] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-21T19:32:41.335706] [DEBUG] [LOCAL ] KFS: Trimmed 11173 records to 8691 (keeping 200 days of data) [2025-10-21T19:32:41.387712] [DEBUG] [LOCAL ] KFS: Primary data saved (8691 records). [2025-10-21T19:32:41.387875] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-21T19:32:41.387972] [INFO ] [MAIN ] Update Progress: 1184/2366 symbols completed. KFS took 24.0s. Estimated remaining: 2h 32m 22s. Rate: 7.8 symbols/min [2025-10-21T19:32:41.565327] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:32:41.618447] [DEBUG] [LOCAL ] KGC: Loaded 53700 existing records from primary storage. [2025-10-21T19:32:41.618777] [INFO ] [MAIN ] KGC: Loaded 53700 existing records. [2025-10-21T19:32:41.757761] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-21T19:32:41.799865] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:32:41.800220] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-21T19:32:41.800291] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-21T19:32:41.800504] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-21T19:32:41.800545] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-21T19:32:42.179867] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:32:42.195963] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-21T19:32:42.551037] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-21T19:32:43.235869] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T19:32:43.351101] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-21T19:32:44.129444] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T19:32:44.151057] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-21T19:32:44.611813] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T19:32:44.616948] [INFO ] [REMOTE ] KFRC: Full fetch complete (26958 records). [2025-10-21T19:32:44.617062] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-21T19:32:44.956195] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-21T19:32:45.018317] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-21T19:32:45.018409] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-21T19:32:45.019027] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-21T19:32:45.019101] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-21T19:32:45.019937] [DEBUG] [LOCAL ] KFRC: Trimmed 26958 records to 20800 (keeping 200 days of data) [2025-10-21T19:32:45.149344] [DEBUG] [LOCAL ] KFRC: Primary data saved (20800 records). [2025-10-21T19:32:45.149487] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-21T19:32:45.149592] [INFO ] [MAIN ] Update Progress: 1185/2366 symbols completed. KFRC took 34.4s. Estimated remaining: 2h 32m 10s. Rate: 7.8 symbols/min [2025-10-21T19:32:45.324475] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:32:45.367059] [DEBUG] [LOCAL ] KGS: Loaded 46120 existing records from primary storage. [2025-10-21T19:32:45.367402] [INFO ] [MAIN ] KGS: Loaded 46120 existing records. [2025-10-21T19:32:45.557564] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:32:45.557838] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-21T19:32:45.557905] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-21T19:32:45.558116] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-21T19:32:45.558170] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-21T19:32:45.756386] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-21T19:32:45.928974] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T19:32:45.965893] [INFO ] [REMOTE ] KEYS: Full fetch complete (63114 records). [2025-10-21T19:32:45.965724] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:32:45.966462] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-21T19:32:46.374772] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-21T19:32:46.374855] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-21T19:32:46.375741] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-21T19:32:46.375804] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-21T19:32:46.377078] [DEBUG] [LOCAL ] KEYS: Trimmed 63114 records to 43207 (keeping 200 days of data) [2025-10-21T19:32:46.556618] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-21T19:32:46.640344] [DEBUG] [LOCAL ] KEYS: Primary data saved (43207 records). [2025-10-21T19:32:46.640615] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-21T19:32:46.641286] [INFO ] [MAIN ] Update Progress: 1186/2366 symbols completed. KEYS took 43.7s. Estimated remaining: 2h 31m 56s. Rate: 7.8 symbols/min [2025-10-21T19:32:46.832529] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:32:46.854405] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T19:32:46.915808] [DEBUG] [LOCAL ] KIM: Loaded 53012 existing records from primary storage. [2025-10-21T19:32:46.916165] [INFO ] [MAIN ] KIM: Loaded 53012 existing records. [2025-10-21T19:32:47.101947] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:32:47.102249] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-21T19:32:47.102363] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-21T19:32:47.109308] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-21T19:32:47.109397] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-21T19:32:47.188882] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T19:32:47.356228] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-21T19:32:47.493445] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:32:48.156786] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-21T19:32:48.159816] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T19:32:48.217294] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T19:32:48.951035] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-21T19:32:49.751021] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-21T19:32:50.008056] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-21T19:32:50.551067] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-21T19:32:50.618168] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T19:32:51.180732] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-21T19:32:51.351021] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-21T19:32:51.929289] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T19:32:52.151060] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-21T19:32:52.951058] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-21T19:32:53.409321] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-21T19:32:53.695888] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T19:32:53.751053] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-21T19:32:54.551059] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-21T19:32:54.602115] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T19:32:55.317411] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T19:32:55.350995] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-21T19:32:55.849566] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T19:32:55.854802] [INFO ] [REMOTE ] KFY: Full fetch complete (43305 records). [2025-10-21T19:32:55.854901] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-21T19:32:56.153937] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-21T19:32:56.243833] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-21T19:32:56.243939] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-21T19:32:56.245389] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-21T19:32:56.245456] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-21T19:32:56.246690] [DEBUG] [LOCAL ] KFY: Trimmed 43305 records to 29615 (keeping 200 days of data) [2025-10-21T19:32:56.437457] [DEBUG] [LOCAL ] KFY: Primary data saved (29615 records). [2025-10-21T19:32:56.437669] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-21T19:32:56.437810] [INFO ] [MAIN ] Update Progress: 1187/2366 symbols completed. KFY took 37.0s. Estimated remaining: 2h 31m 51s. Rate: 7.8 symbols/min [2025-10-21T19:32:56.615826] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:32:56.640105] [DEBUG] [LOCAL ] KIO: Loaded 21766 existing records from primary storage. [2025-10-21T19:32:56.640448] [INFO ] [MAIN ] KIO: Loaded 21766 existing records. [2025-10-21T19:32:56.830616] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:32:56.831016] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-21T19:32:56.831282] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-21T19:32:56.831593] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-21T19:32:56.831693] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-21T19:32:56.954513] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-21T19:32:57.108807] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-21T19:32:57.266274] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:32:57.751087] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-21T19:32:58.471384] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-21T19:32:58.551011] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-21T19:32:58.807136] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T19:32:59.228770] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T19:32:59.351005] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-21T19:33:00.151017] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-21T19:33:00.838028] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-21T19:33:00.877166] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T19:33:00.950992] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-21T19:33:01.550833] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T19:33:01.751066] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-21T19:33:02.551001] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-21T19:33:02.676068] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T19:33:02.873252] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T19:33:03.351082] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-21T19:33:04.151001] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-21T19:33:04.316636] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T19:33:04.951012] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-21T19:33:05.371269] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-21T19:33:05.751142] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-21T19:33:05.802114] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T19:33:06.035365] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T19:33:06.551035] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-21T19:33:07.350993] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-21T19:33:07.462867] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T19:33:08.150997] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-21T19:33:08.224035] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T19:33:08.231133] [INFO ] [REMOTE ] KGS: Full fetch complete (66544 records). [2025-10-21T19:33:08.231238] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-21T19:33:08.646362] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-21T19:33:08.646436] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-21T19:33:08.647347] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-21T19:33:08.647408] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-21T19:33:08.648708] [DEBUG] [LOCAL ] KGS: Trimmed 66544 records to 46136 (keeping 200 days of data) [2025-10-21T19:33:08.914754] [DEBUG] [LOCAL ] KGS: Primary data saved (46136 records). [2025-10-21T19:33:08.914865] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-21T19:33:08.914938] [INFO ] [MAIN ] Update Progress: 1188/2366 symbols completed. KGS took 23.8s. Estimated remaining: 2h 31m 48s. Rate: 7.8 symbols/min [2025-10-21T19:33:08.957711] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-21T19:33:09.085683] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:33:09.140324] [DEBUG] [LOCAL ] KKR: Loaded 53503 existing records from primary storage. [2025-10-21T19:33:09.140748] [INFO ] [MAIN ] KKR: Loaded 53503 existing records. [2025-10-21T19:33:09.323473] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:33:09.324221] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-21T19:33:09.335937] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-21T19:33:09.336814] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-21T19:33:09.337418] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-21T19:33:09.337260] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-21T19:33:09.712667] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-21T19:33:09.763333] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-21T19:33:09.799984] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:33:10.551062] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-21T19:33:10.764908] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T19:33:11.351038] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-21T19:33:11.928393] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-21T19:33:12.151028] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-21T19:33:12.524779] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-21T19:33:12.815541] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-21T19:33:12.951032] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-21T19:33:13.129315] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-21T19:33:13.751053] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-21T19:33:14.551038] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-21T19:33:14.760005] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T19:33:15.351027] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-21T19:33:15.524417] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T19:33:15.583475] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T19:33:16.151051] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-21T19:33:16.951040] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-21T19:33:17.109931] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-21T19:33:17.250601] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T19:33:17.751075] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-21T19:33:18.550997] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-21T19:33:18.826023] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T19:33:19.217750] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-21T19:33:19.351084] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-21T19:33:20.151064] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-21T19:33:20.199170] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T19:33:20.780230] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T19:33:20.951018] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-21T19:33:21.751074] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-21T19:33:22.277854] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-21T19:33:22.286846] [INFO ] [REMOTE ] KGC: Full fetch complete (77873 records). [2025-10-21T19:33:22.287076] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-21T19:33:22.559310] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-21T19:33:22.699296] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-21T19:33:22.699419] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-21T19:33:22.700571] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-21T19:33:22.700639] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-21T19:33:22.702177] [DEBUG] [LOCAL ] KGC: Trimmed 77873 records to 53700 (keeping 200 days of data) [2025-10-21T19:33:22.930927] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-21T19:33:23.054883] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-21T19:33:23.073722] [INFO ] [REMOTE ] KIM: Full fetch complete (76969 records). [2025-10-21T19:33:23.080777] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-21T19:33:23.089779] [DEBUG] [LOCAL ] KGC: Primary data saved (53700 records). [2025-10-21T19:33:23.089960] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-21T19:33:23.090536] [INFO ] [MAIN ] Update Progress: 1189/2366 symbols completed. KGC took 41.7s. Estimated remaining: 2h 31m 46s. Rate: 7.8 symbols/min [2025-10-21T19:33:23.362803] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-21T19:33:23.491967] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:33:23.609117] [DEBUG] [LOCAL ] KKRS: Loaded 5590 existing records from primary storage. [2025-10-21T19:33:23.619572] [INFO ] [MAIN ] KKRS: Loaded 5590 existing records. [2025-10-21T19:33:23.800194] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-21T19:33:23.805403] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-21T19:33:23.811509] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-21T19:33:23.816722] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-21T19:33:23.865771] [DEBUG] [LOCAL ] KIM: Trimmed 76969 records to 53000 (keeping 200 days of data) [2025-10-21T19:33:23.869313] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:33:23.869510] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-21T19:33:23.869566] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-21T19:33:23.869858] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-21T19:33:23.869914] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-21T19:33:24.458744] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:33:24.471108] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-21T19:33:24.563228] [DEBUG] [LOCAL ] KIM: Primary data saved (53000 records). [2025-10-21T19:33:24.563464] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-21T19:33:24.564218] [INFO ] [MAIN ] Update Progress: 1190/2366 symbols completed. KIM took 37.9s. Estimated remaining: 2h 31m 32s. Rate: 7.8 symbols/min [2025-10-21T19:33:24.778536] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:33:24.784123] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-21T19:33:24.788930] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-21T19:33:24.792458] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-21T19:33:24.804625] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-21T19:33:24.805448] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-21T19:33:24.805693] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-21T19:33:24.805828] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-21T19:33:24.812057] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-21T19:33:24.846365] [INFO ] [REMOTE ] KIO: Full fetch complete (32297 records). [2025-10-21T19:33:24.878296] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-21T19:33:24.956100] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-21T19:33:25.078291] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-21T19:33:25.474420] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:33:25.566195] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-21T19:33:25.566276] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-21T19:33:25.567184] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-21T19:33:25.567248] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-21T19:33:25.568038] [DEBUG] [LOCAL ] KIO: Trimmed 32297 records to 21750 (keeping 200 days of data) [2025-10-21T19:33:25.705543] [DEBUG] [LOCAL ] KIO: Primary data saved (21750 records). [2025-10-21T19:33:25.705746] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-21T19:33:25.705859] [INFO ] [MAIN ] Update Progress: 1191/2366 symbols completed. KIO took 29.3s. Estimated remaining: 2h 31m 18s. Rate: 7.8 symbols/min [2025-10-21T19:33:25.762523] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-21T19:33:25.878601] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:33:25.878841] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-21T19:33:25.878883] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-21T19:33:25.879005] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-21T19:33:25.879054] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-21T19:33:25.879101] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-21T19:33:25.879133] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-21T19:33:26.247446] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:33:26.418436] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-21T19:33:26.418611] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T19:33:26.551007] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-21T19:33:27.351047] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-10-21T19:33:27.546159] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T19:33:27.546330] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-10-21T19:33:27.546413] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:33:27.546457] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-21T19:33:27.546489] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:33:27.546524] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-21T19:33:27.546571] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-21T19:33:27.546606] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-21T19:33:27.546693] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-21T19:33:27.546759] [INFO ] [MAIN ] Update Progress: 1192/2366 symbols completed. KLAR took 1.8s. Estimated remaining: 2h 31m 5s. Rate: 7.8 symbols/min [2025-10-21T19:33:27.712576] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:33:27.744700] [DEBUG] [LOCAL ] KLC: Loaded 36293 existing records from primary storage. [2025-10-21T19:33:27.744969] [INFO ] [MAIN ] KLC: Loaded 36293 existing records. [2025-10-21T19:33:27.921298] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:33:27.921465] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-21T19:33:27.921510] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-21T19:33:27.921756] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-21T19:33:27.921814] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-21T19:33:28.159981] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-10-21T19:33:28.287383] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:33:28.405946] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T19:33:28.406292] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-10-21T19:33:28.406395] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:33:28.406461] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-21T19:33:28.406534] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:33:28.406619] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-21T19:33:28.406739] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-21T19:33:28.406796] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-21T19:33:28.406855] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-21T19:33:28.406917] [INFO ] [MAIN ] Update Progress: 1193/2366 symbols completed. KKRT took 3.8s. Estimated remaining: 2h 30m 50s. Rate: 7.8 symbols/min [2025-10-21T19:33:28.573110] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-21T19:33:28.641819] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:33:28.694771] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-21T19:33:28.695116] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-21T19:33:28.868049] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:33:28.868240] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-21T19:33:28.868287] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-21T19:33:28.868564] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-21T19:33:28.868602] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-21T19:33:28.956239] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-21T19:33:29.219102] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:33:29.751084] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-21T19:33:30.337733] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-21T19:33:30.551047] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-21T19:33:30.675271] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T19:33:31.255547] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-21T19:33:31.351023] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-21T19:33:32.151073] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-21T19:33:32.158783] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T19:33:32.951074] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-21T19:33:33.596678] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-21T19:33:33.751096] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-21T19:33:33.957467] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T19:33:34.258951] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-21T19:33:34.551060] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-21T19:33:35.351074] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-21T19:33:36.151106] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-21T19:33:36.588685] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T19:33:36.719910] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-21T19:33:36.748864] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-21T19:33:36.951028] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-21T19:33:37.751025] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-21T19:33:38.323307] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-21T19:33:38.551095] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-21T19:33:38.810881] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-21T19:33:39.135803] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-21T19:33:39.136851] [INFO ] [REMOTE ] KKRS: Full fetch complete (7543 records). [2025-10-21T19:33:39.136917] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-21T19:33:39.356209] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-21T19:33:39.500564] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-21T19:33:39.500686] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-21T19:33:39.500920] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-21T19:33:39.500963] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-21T19:33:39.501490] [DEBUG] [LOCAL ] KKRS: Trimmed 7543 records to 5573 (keeping 200 days of data) [2025-10-21T19:33:39.538097] [DEBUG] [LOCAL ] KKRS: Primary data saved (5573 records). [2025-10-21T19:33:39.538231] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-21T19:33:39.538311] [INFO ] [MAIN ] Update Progress: 1194/2366 symbols completed. KKRS took 16.4s. Estimated remaining: 2h 30m 46s. Rate: 7.8 symbols/min [2025-10-21T19:33:39.709159] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:33:39.714702] [DEBUG] [LOCAL ] KMPB: Loaded 3558 existing records from primary storage. [2025-10-21T19:33:39.714861] [INFO ] [MAIN ] KMPB: Loaded 3558 existing records. [2025-10-21T19:33:39.886685] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:33:39.886892] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-21T19:33:39.886939] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-21T19:33:39.887071] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-21T19:33:39.887107] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-21T19:33:40.157302] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-21T19:33:40.245716] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:33:40.541278] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T19:33:40.951076] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-21T19:33:41.751001] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-21T19:33:42.107498] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T19:33:42.196283] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-21T19:33:42.259831] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T19:33:42.551046] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-21T19:33:43.351037] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-21T19:33:44.151030] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-21T19:33:44.151725] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-21T19:33:44.951079] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-21T19:33:45.639907] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-21T19:33:45.648839] [INFO ] [REMOTE ] KKR: Full fetch complete (77652 records). [2025-10-21T19:33:45.648993] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-21T19:33:45.757535] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-21T19:33:46.076574] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-21T19:33:46.076722] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-21T19:33:46.077972] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-21T19:33:46.078060] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-21T19:33:46.079621] [DEBUG] [LOCAL ] KKR: Trimmed 77652 records to 53500 (keeping 200 days of data) [2025-10-21T19:33:46.416281] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T19:33:46.444184] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-21T19:33:46.471822] [DEBUG] [LOCAL ] KKR: Primary data saved (53500 records). [2025-10-21T19:33:46.472270] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-21T19:33:46.472530] [INFO ] [MAIN ] Update Progress: 1195/2366 symbols completed. KKR took 37.6s. Estimated remaining: 2h 30m 37s. Rate: 7.8 symbols/min [2025-10-21T19:33:46.556976] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-21T19:33:46.603061] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T19:33:46.684876] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:33:46.721128] [DEBUG] [LOCAL ] KMPR: Loaded 40452 existing records from primary storage. [2025-10-21T19:33:46.721431] [INFO ] [MAIN ] KMPR: Loaded 40452 existing records. [2025-10-21T19:33:46.910017] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:33:46.910442] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-21T19:33:46.910495] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-21T19:33:46.910880] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-21T19:33:46.910936] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-21T19:33:47.193508] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T19:33:47.272159] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:33:47.351008] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-21T19:33:48.151083] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-21T19:33:48.819117] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T19:33:48.951024] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-21T19:33:49.465839] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-21T19:33:49.751040] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-21T19:33:49.901786] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T19:33:50.221428] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-21T19:33:50.551025] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-21T19:33:51.351022] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-21T19:33:51.770980] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-21T19:33:51.827629] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-21T19:33:52.151063] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-21T19:33:52.656465] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-21T19:33:52.951022] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-21T19:33:53.750995] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-21T19:33:54.315033] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T19:33:54.551029] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-21T19:33:54.643751] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T19:33:55.351053] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-21T19:33:55.853288] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-21T19:33:55.873765] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-21T19:33:56.151050] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-21T19:33:56.760626] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-21T19:33:56.761589] [INFO ] [REMOTE ] KMPB: Full fetch complete (4961 records). [2025-10-21T19:33:56.761687] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-21T19:33:56.957707] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-21T19:33:57.145054] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-21T19:33:57.145150] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-21T19:33:57.145375] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-21T19:33:57.145430] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-21T19:33:57.145896] [DEBUG] [LOCAL ] KMPB: Trimmed 4961 records to 3533 (keeping 200 days of data) [2025-10-21T19:33:57.168137] [DEBUG] [LOCAL ] KMPB: Primary data saved (3533 records). [2025-10-21T19:33:57.168230] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-21T19:33:57.168307] [INFO ] [MAIN ] Update Progress: 1196/2366 symbols completed. KMPB took 17.6s. Estimated remaining: 2h 30m 32s. Rate: 7.8 symbols/min [2025-10-21T19:33:57.352834] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:33:57.394435] [DEBUG] [LOCAL ] KMT: Loaded 42948 existing records from primary storage. [2025-10-21T19:33:57.394854] [INFO ] [MAIN ] KMT: Loaded 42948 existing records. [2025-10-21T19:33:57.576671] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:33:57.576908] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-21T19:33:57.576956] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-21T19:33:57.577145] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-21T19:33:57.577200] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-21T19:33:57.761720] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-21T19:33:57.934863] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:33:58.349816] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T19:33:58.551027] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-21T19:33:59.351057] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-21T19:33:59.962166] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T19:34:00.002388] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-21T19:34:00.151028] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-21T19:34:00.682497] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T19:34:00.951045] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-21T19:34:01.751045] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-21T19:34:01.924315] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T19:34:02.551093] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-21T19:34:02.942300] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-21T19:34:02.998808] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T19:34:03.351032] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-21T19:34:04.033323] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T19:34:04.150996] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-21T19:34:04.794947] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-21T19:34:04.951034] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-21T19:34:05.671916] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T19:34:05.751029] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-21T19:34:06.222526] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-21T19:34:06.551084] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-21T19:34:07.351015] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-21T19:34:07.686268] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T19:34:08.137884] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T19:34:08.150967] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-21T19:34:08.957112] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-21T19:34:08.962734] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T19:34:09.739512] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T19:34:09.750979] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-21T19:34:10.173008] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T19:34:10.178962] [INFO ] [REMOTE ] KLC: Full fetch complete (50526 records). [2025-10-21T19:34:10.179050] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-21T19:34:10.557050] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-21T19:34:10.558635] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-21T19:34:10.558755] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-21T19:34:10.559558] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-21T19:34:10.559668] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-21T19:34:10.560849] [DEBUG] [LOCAL ] KLC: Trimmed 50526 records to 36207 (keeping 200 days of data) [2025-10-21T19:34:10.760130] [DEBUG] [LOCAL ] KLC: Primary data saved (36207 records). [2025-10-21T19:34:10.760262] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-21T19:34:10.760352] [INFO ] [MAIN ] Update Progress: 1197/2366 symbols completed. KLC took 43.2s. Estimated remaining: 2h 30m 30s. Rate: 7.8 symbols/min [2025-10-21T19:34:11.351026] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-21T19:34:11.465464] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T19:34:11.539258] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T19:34:11.547710] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-10-21T19:34:11.547863] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-21T19:34:11.936176] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-21T19:34:11.936270] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-21T19:34:11.937315] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-21T19:34:11.937400] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-21T19:34:11.938780] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 53693 (keeping 200 days of data) [2025-10-21T19:34:12.154673] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-21T19:34:12.256508] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-10-21T19:34:12.256632] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-21T19:34:12.256747] [INFO ] [MAIN ] Update Progress: 1198/2366 symbols completed. KMI took 43.8s. Estimated remaining: 2h 30m 17s. Rate: 7.8 symbols/min [2025-10-21T19:34:13.064088] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T19:34:13.074032] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-21T19:34:13.605468] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T19:34:13.751050] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-21T19:34:14.667524] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-21T19:34:14.677277] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-21T19:34:15.234121] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T19:34:15.350977] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-21T19:34:16.462982] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T19:34:16.470242] [INFO ] [REMOTE ] KMPR: Full fetch complete (53461 records). [2025-10-21T19:34:16.470353] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-21T19:34:16.897089] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-21T19:34:16.897192] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-21T19:34:16.898157] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-21T19:34:16.898240] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-21T19:34:16.899381] [DEBUG] [LOCAL ] KMPR: Trimmed 53461 records to 40497 (keeping 200 days of data) [2025-10-21T19:34:17.052199] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T19:34:17.143732] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-21T19:34:17.180287] [DEBUG] [LOCAL ] KMPR: Primary data saved (40497 records). [2025-10-21T19:34:17.180381] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-21T19:34:17.180450] [INFO ] [MAIN ] Update Progress: 1199/2366 symbols completed. KMPR took 30.7s. Estimated remaining: 2h 30m 6s. Rate: 7.8 symbols/min [2025-10-21T19:34:18.669693] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-21T19:34:18.678808] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-21T19:34:20.188586] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-21T19:34:20.194946] [INFO ] [REMOTE ] KMT: Full fetch complete (61914 records). [2025-10-21T19:34:20.195070] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-21T19:34:20.585589] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-21T19:34:20.585716] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-21T19:34:20.586815] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-21T19:34:20.586892] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-21T19:34:20.588213] [DEBUG] [LOCAL ] KMT: Trimmed 61914 records to 42860 (keeping 200 days of data) [2025-10-21T19:34:20.843380] [DEBUG] [LOCAL ] KMT: Primary data saved (42860 records). [2025-10-21T19:34:20.843505] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-21T19:34:20.844106] [INFO ] [MAIN ] Update Progress: 1200/2366 symbols completed. KMT took 23.7s. Estimated remaining: 2h 29m 55s. Rate: 7.8 symbols/min [2025-10-21T19:34:21.448609] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:34:21.526816] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:34:21.539804] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:34:21.557568] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:34:21.569743] [DEBUG] [LOCAL ] KNOP: Loaded 10181 existing records from primary storage. [2025-10-21T19:34:21.570263] [INFO ] [MAIN ] KNOP: Loaded 10181 existing records. [2025-10-21T19:34:21.711103] [DEBUG] [LOCAL ] KN: Loaded 38488 existing records from primary storage. [2025-10-21T19:34:21.723707] [INFO ] [MAIN ] KN: Loaded 38488 existing records. [2025-10-21T19:34:21.910024] [DEBUG] [LOCAL ] KNF: Loaded 36667 existing records from primary storage. [2025-10-21T19:34:21.921786] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:34:21.940608] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-21T19:34:21.940808] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-21T19:34:21.980676] [INFO ] [MAIN ] KNF: Loaded 36667 existing records. [2025-10-21T19:34:21.941911] [DEBUG] [LOCAL ] KMX: Loaded 53284 existing records from primary storage. [2025-10-21T19:34:21.996855] [INFO ] [MAIN ] KMX: Loaded 53284 existing records. [2025-10-21T19:34:21.998580] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-21T19:34:22.016614] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-21T19:34:22.036477] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:34:22.177332] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-21T19:34:22.204098] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-21T19:34:22.306232] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-21T19:34:22.331958] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-21T19:34:22.647420] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:34:22.688246] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-21T19:34:22.670866] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:34:22.731177] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-21T19:34:22.731266] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-21T19:34:22.755439] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-21T19:34:22.791575] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-21T19:34:22.796861] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-21T19:34:22.874816] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-21T19:34:22.880357] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-21T19:34:23.285939] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:34:23.362452] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-21T19:34:23.639029] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:34:23.689084] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-21T19:34:23.854975] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:34:23.871163] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-21T19:34:23.876055] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:34:23.876324] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-21T19:34:24.562821] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T19:34:24.565366] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-21T19:34:24.919676] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T19:34:24.926179] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-21T19:34:25.285886] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-21T19:34:25.288468] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-21T19:34:25.308887] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T19:34:25.316334] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-21T19:34:25.849101] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-21T19:34:25.859259] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-21T19:34:26.211072] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T19:34:26.218453] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-21T19:34:26.226631] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-21T19:34:26.229914] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-21T19:34:26.796706] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T19:34:26.807049] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-21T19:34:27.053713] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-21T19:34:27.254015] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-21T19:34:27.350982] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-21T19:34:27.584157] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T19:34:28.151093] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-21T19:34:28.288896] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T19:34:28.951152] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-21T19:34:29.107033] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T19:34:29.667550] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T19:34:29.751081] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-21T19:34:29.978271] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T19:34:30.551015] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-21T19:34:31.336352] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T19:34:31.350974] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-21T19:34:31.715449] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-21T19:34:31.821209] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-21T19:34:32.151021] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-21T19:34:32.951004] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-21T19:34:33.496690] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T19:34:33.751088] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-21T19:34:34.544208] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T19:34:34.554669] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-21T19:34:34.585524] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-21T19:34:35.351039] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-21T19:34:36.044103] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T19:34:36.086670] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-21T19:34:36.151073] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-21T19:34:36.951079] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-21T19:34:37.751006] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-21T19:34:38.023190] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-21T19:34:38.293101] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T19:34:38.551029] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-21T19:34:38.950841] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T19:34:39.351022] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-21T19:34:39.806170] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-21T19:34:40.151071] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-21T19:34:40.253251] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-21T19:34:40.950997] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-21T19:34:41.431391] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T19:34:41.751059] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-21T19:34:41.981767] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T19:34:41.984371] [INFO ] [REMOTE ] KNOP: Full fetch complete (14711 records). [2025-10-21T19:34:41.984443] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-21T19:34:42.359147] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-21T19:34:42.359227] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-21T19:34:42.359588] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-21T19:34:42.359626] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-21T19:34:42.360126] [DEBUG] [LOCAL ] KNOP: Trimmed 14711 records to 10137 (keeping 200 days of data) [2025-10-21T19:34:42.417626] [DEBUG] [LOCAL ] KNOP: Primary data saved (10137 records). [2025-10-21T19:34:42.417804] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-21T19:34:42.417917] [INFO ] [MAIN ] Update Progress: 1201/2366 symbols completed. KNOP took 21.6s. Estimated remaining: 2h 30m 0s. Rate: 7.8 symbols/min [2025-10-21T19:34:42.557755] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-21T19:34:42.589589] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:34:42.613492] [DEBUG] [LOCAL ] KNSL: Loaded 18516 existing records from primary storage. [2025-10-21T19:34:42.613765] [INFO ] [MAIN ] KNSL: Loaded 18516 existing records. [2025-10-21T19:34:42.788544] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:34:42.788804] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-21T19:34:42.788892] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-21T19:34:42.789105] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-21T19:34:42.789159] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-21T19:34:43.145833] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:34:43.351007] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-21T19:34:43.655278] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T19:34:43.714831] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-21T19:34:44.151036] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-21T19:34:44.569680] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T19:34:44.951052] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-21T19:34:45.751051] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-21T19:34:46.030479] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-21T19:34:46.182631] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-21T19:34:46.551100] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-21T19:34:47.081437] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T19:34:47.351084] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-21T19:34:48.151036] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-21T19:34:48.427157] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T19:34:48.810281] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T19:34:48.951024] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-21T19:34:49.661779] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T19:34:49.751039] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-21T19:34:50.019841] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-21T19:34:50.026148] [INFO ] [REMOTE ] KNF: Full fetch complete (51457 records). [2025-10-21T19:34:50.026239] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-21T19:34:50.402725] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-21T19:34:50.402809] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-21T19:34:50.403618] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-21T19:34:50.403703] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-21T19:34:50.404685] [DEBUG] [LOCAL ] KNF: Trimmed 51457 records to 36664 (keeping 200 days of data) [2025-10-21T19:34:50.576213] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-21T19:34:50.632788] [DEBUG] [LOCAL ] KNF: Primary data saved (36664 records). [2025-10-21T19:34:50.632900] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-21T19:34:50.632975] [INFO ] [MAIN ] Update Progress: 1202/2366 symbols completed. KNF took 29.8s. Estimated remaining: 2h 29m 53s. Rate: 7.8 symbols/min [2025-10-21T19:34:50.800057] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:34:50.840792] [DEBUG] [LOCAL ] KNTK: Loaded 47220 existing records from primary storage. [2025-10-21T19:34:50.841127] [INFO ] [MAIN ] KNTK: Loaded 47220 existing records. [2025-10-21T19:34:51.017352] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:34:51.017529] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-21T19:34:51.017575] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-21T19:34:51.017787] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-21T19:34:51.017844] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-21T19:34:51.340882] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-21T19:34:51.351345] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-21T19:34:51.399015] [INFO ] [REMOTE ] KN: Full fetch complete (56601 records). [2025-10-21T19:34:51.442897] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-21T19:34:51.442797] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:34:51.832697] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-21T19:34:51.855292] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-21T19:34:51.855348] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-21T19:34:51.856205] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-21T19:34:51.856265] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-21T19:34:51.857286] [DEBUG] [LOCAL ] KN: Trimmed 56601 records to 38436 (keeping 200 days of data) [2025-10-21T19:34:52.074681] [DEBUG] [LOCAL ] KN: Primary data saved (38436 records). [2025-10-21T19:34:52.074806] [INFO ] [MAIN ] KN: Full history saved. [2025-10-21T19:34:52.075554] [INFO ] [MAIN ] Update Progress: 1203/2366 symbols completed. KN took 31.2s. Estimated remaining: 2h 29m 39s. Rate: 7.8 symbols/min [2025-10-21T19:34:52.151316] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-21T19:34:52.247480] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:34:52.298606] [DEBUG] [LOCAL ] KNX: Loaded 52639 existing records from primary storage. [2025-10-21T19:34:52.298943] [INFO ] [MAIN ] KNX: Loaded 52639 existing records. [2025-10-21T19:34:52.490608] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:34:52.503739] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-21T19:34:52.505040] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-21T19:34:52.504292] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-21T19:34:52.507915] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-21T19:34:52.513368] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-21T19:34:52.557708] [INFO ] [REMOTE ] KMX: Full fetch complete (76396 records). [2025-10-21T19:34:52.587375] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-21T19:34:52.956255] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-21T19:34:53.180850] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:34:53.286075] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-21T19:34:53.286151] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-21T19:34:53.287164] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-21T19:34:53.287226] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-21T19:34:53.288818] [DEBUG] [LOCAL ] KMX: Trimmed 76396 records to 53285 (keeping 200 days of data) [2025-10-21T19:34:53.411453] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-21T19:34:53.626560] [DEBUG] [LOCAL ] KMX: Primary data saved (53285 records). [2025-10-21T19:34:53.626708] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-21T19:34:53.626794] [INFO ] [MAIN ] Update Progress: 1204/2366 symbols completed. KMX took 32.8s. Estimated remaining: 2h 29m 26s. Rate: 7.8 symbols/min [2025-10-21T19:34:53.756269] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-21T19:34:53.801070] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:34:53.801197] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-21T19:34:53.801233] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-21T19:34:53.801338] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-21T19:34:53.801381] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-21T19:34:53.801476] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-21T19:34:53.801526] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-21T19:34:54.166014] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:34:54.551061] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-21T19:34:54.762039] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T19:34:55.351005] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-21T19:34:55.629202] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-21T19:34:55.692893] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-21T19:34:56.151036] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-21T19:34:56.951007] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-21T19:34:57.242538] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T19:34:57.751023] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-21T19:34:58.077275] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-10-21T19:34:58.402771] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T19:34:58.551102] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-21T19:34:59.337764] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T19:34:59.350973] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-21T19:34:59.738841] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T19:35:00.150988] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-21T19:35:00.807554] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-21T19:35:00.951017] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-21T19:35:01.751090] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-21T19:35:01.951341] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-21T19:35:02.550997] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-21T19:35:02.651352] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-21T19:35:03.351054] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-21T19:35:03.600834] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-21T19:35:04.119418] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T19:35:04.150999] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-21T19:35:04.402639] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T19:35:04.951127] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-21T19:35:05.751092] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-21T19:35:06.551065] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-21T19:35:06.713138] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T19:35:06.890408] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-21T19:35:06.937138] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T19:35:06.941065] [INFO ] [REMOTE ] KNSL: Full fetch complete (27244 records). [2025-10-21T19:35:06.941225] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-21T19:35:07.309904] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-21T19:35:07.309979] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-21T19:35:07.310589] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-21T19:35:07.310631] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-21T19:35:07.311294] [DEBUG] [LOCAL ] KNSL: Trimmed 27244 records to 18446 (keeping 200 days of data) [2025-10-21T19:35:07.359389] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-21T19:35:07.427568] [DEBUG] [LOCAL ] KNSL: Primary data saved (18446 records). [2025-10-21T19:35:07.427712] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-21T19:35:07.427823] [INFO ] [MAIN ] Update Progress: 1205/2366 symbols completed. KNSL took 25.0s. Estimated remaining: 2h 29m 24s. Rate: 7.8 symbols/min [2025-10-21T19:35:07.599133] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:35:07.599296] [DEBUG] [LOCAL ] KODK: No existing data file found in primary storage. [2025-10-21T19:35:07.599334] [WARN ] [MAIN ] KODK: No existing data found, performing full refresh instead. [2025-10-21T19:35:07.599450] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-21T19:35:07.599492] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-21T19:35:07.599532] [DEBUG] [LOCAL ] KODK: No primary data file found to delete. [2025-10-21T19:35:07.599566] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-21T19:35:07.961226] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:35:08.151026] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-21T19:35:08.300268] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T19:35:08.951068] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-21T19:35:09.751096] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-21T19:35:09.942678] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T19:35:10.041860] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-21T19:35:10.551092] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-21T19:35:10.622697] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T19:35:11.362461] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-21T19:35:11.367825] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-21T19:35:12.151064] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-21T19:35:12.951083] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-21T19:35:13.000068] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T19:35:13.040014] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-21T19:35:13.299056] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-21T19:35:13.751034] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-21T19:35:14.379730] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T19:35:14.551032] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-21T19:35:15.351012] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-21T19:35:15.622052] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T19:35:16.151005] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-21T19:35:16.209313] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T19:35:16.951035] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-21T19:35:17.751006] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-21T19:35:17.789968] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T19:35:17.962575] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-21T19:35:18.285246] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T19:35:18.551032] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-21T19:35:19.351032] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-21T19:35:19.494783] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T19:35:20.151035] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-21T19:35:20.201798] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T19:35:20.695705] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-21T19:35:20.704038] [INFO ] [REMOTE ] KNX: Full fetch complete (76298 records). [2025-10-21T19:35:20.704148] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-21T19:35:20.957701] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-21T19:35:21.136574] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-21T19:35:21.136732] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-21T19:35:21.137891] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-21T19:35:21.138169] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-21T19:35:21.140312] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T19:35:21.151615] [DEBUG] [LOCAL ] KNX: Trimmed 76298 records to 52645 (keeping 200 days of data) [2025-10-21T19:35:21.460690] [DEBUG] [LOCAL ] KNX: Primary data saved (52645 records). [2025-10-21T19:35:21.460822] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-21T19:35:21.460896] [INFO ] [MAIN ] Update Progress: 1206/2366 symbols completed. KNX took 29.4s. Estimated remaining: 2h 29m 22s. Rate: 7.8 symbols/min [2025-10-21T19:35:21.628436] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:35:21.653989] [DEBUG] [LOCAL ] KOF: Loaded 26742 existing records from primary storage. [2025-10-21T19:35:21.654226] [INFO ] [MAIN ] KOF: Loaded 26742 existing records. [2025-10-21T19:35:21.753855] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-21T19:35:21.834393] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:35:21.834587] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-21T19:35:21.834692] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-21T19:35:21.834877] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-21T19:35:21.834916] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-21T19:35:22.185284] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:35:22.551017] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-21T19:35:23.351088] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-21T19:35:23.542972] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T19:35:23.551529] [INFO ] [REMOTE ] KNTK: Full fetch complete (65727 records). [2025-10-21T19:35:23.551759] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-21T19:35:23.948349] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-21T19:35:23.948670] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-21T19:35:23.949952] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-21T19:35:23.950090] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-21T19:35:23.984193] [DEBUG] [LOCAL ] KNTK: Trimmed 65727 records to 47232 (keeping 200 days of data) [2025-10-21T19:35:23.986836] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (3.03 seconds). [2025-10-21T19:35:24.137278] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T19:35:24.151004] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-21T19:35:24.321446] [DEBUG] [LOCAL ] KNTK: Primary data saved (47232 records). [2025-10-21T19:35:24.321544] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-21T19:35:24.321631] [INFO ] [MAIN ] Update Progress: 1207/2366 symbols completed. KNTK took 33.7s. Estimated remaining: 2h 29m 10s. Rate: 7.8 symbols/min [2025-10-21T19:35:24.499784] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:35:24.518069] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T19:35:24.535812] [DEBUG] [LOCAL ] KOP: Loaded 17454 existing records from primary storage. [2025-10-21T19:35:24.536121] [INFO ] [MAIN ] KOP: Loaded 17454 existing records. [2025-10-21T19:35:24.716099] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:35:24.716299] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-21T19:35:24.716346] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-21T19:35:24.716527] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-21T19:35:24.716585] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-21T19:35:24.962194] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-21T19:35:25.082395] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:35:25.751034] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-21T19:35:26.494204] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T19:35:26.550987] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-21T19:35:26.838144] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-10-21T19:35:26.879926] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T19:35:27.351026] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-21T19:35:28.041983] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T19:35:28.090433] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-21T19:35:28.151023] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-21T19:35:28.951047] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-21T19:35:29.072485] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T19:35:29.751027] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-21T19:35:30.551020] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-21T19:35:30.661960] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T19:35:30.823599] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-21T19:35:31.351023] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-21T19:35:31.561165] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-21T19:35:32.151049] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-21T19:35:32.392769] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-21T19:35:32.951074] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-21T19:35:33.466788] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T19:35:33.751041] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-21T19:35:34.551155] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-21T19:35:35.026240] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T19:35:35.081418] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-21T19:35:35.351087] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-21T19:35:36.156629] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-21T19:35:36.180094] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T19:35:36.247887] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T19:35:36.256468] [INFO ] [REMOTE ] KO: Full fetch complete (77218 records). [2025-10-21T19:35:36.256629] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-21T19:35:36.463475] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-21T19:35:36.464300] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:35:36.464375] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:35:36.464448] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-21T19:35:36.464517] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-21T19:35:36.464558] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-21T19:35:36.464635] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-21T19:35:36.464753] [INFO ] [MAIN ] Update Progress: 1208/2366 symbols completed. KO took 42.8s. Estimated remaining: 2h 29m 6s. Rate: 7.8 symbols/min [2025-10-21T19:35:36.663074] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:35:36.667439] [DEBUG] [LOCAL ] KORE: Loaded 2176 existing records from primary storage. [2025-10-21T19:35:36.667617] [INFO ] [MAIN ] KORE: Loaded 2176 existing records. [2025-10-21T19:35:36.868920] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:35:36.869173] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-21T19:35:36.869222] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-21T19:35:36.869366] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-21T19:35:36.869438] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-21T19:35:36.956197] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-21T19:35:37.268556] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-21T19:35:37.267887] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:35:37.751054] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-21T19:35:38.175100] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T19:35:38.551031] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-21T19:35:38.623924] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-21T19:35:39.351028] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-21T19:35:39.481952] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-21T19:35:40.151114] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-21T19:35:40.951067] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-21T19:35:41.109005] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-21T19:35:41.125206] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-21T19:35:41.128770] [INFO ] [REMOTE ] KODK: Full fetch complete (63372 records). [2025-10-21T19:35:41.129272] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-21T19:35:41.525805] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-21T19:35:41.529137] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-21T19:35:41.529276] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T19:35:41.531830] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-21T19:35:41.531895] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-21T19:35:41.533035] [DEBUG] [LOCAL ] KODK: Trimmed 63372 records to 43762 (keeping 200 days of data) [2025-10-21T19:35:41.751099] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-21T19:35:41.778064] [DEBUG] [LOCAL ] KODK: Primary data saved (43762 records). [2025-10-21T19:35:41.778180] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-21T19:35:41.778249] [INFO ] [MAIN ] Update Progress: 1209/2366 symbols completed. KODK took 34.4s. Estimated remaining: 2h 28m 56s. Rate: 7.8 symbols/min [2025-10-21T19:35:41.950098] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:35:42.000639] [DEBUG] [LOCAL ] KOS: Loaded 53095 existing records from primary storage. [2025-10-21T19:35:42.001058] [INFO ] [MAIN ] KOS: Loaded 53095 existing records. [2025-10-21T19:35:42.181736] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:35:42.181937] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-21T19:35:42.181984] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-21T19:35:42.182157] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-21T19:35:42.182195] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-21T19:35:42.266819] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-21T19:35:42.554824] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:35:42.554928] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-21T19:35:42.996269] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-21T19:35:43.351039] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-21T19:35:44.151071] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-21T19:35:44.951040] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-21T19:35:45.177032] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-21T19:35:45.218883] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T19:35:45.751003] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-21T19:35:46.163003] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-21T19:35:46.172004] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-21T19:35:46.551034] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-21T19:35:47.351037] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-21T19:35:47.643631] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-21T19:35:48.151032] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-21T19:35:48.586257] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-21T19:35:48.951069] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-21T19:35:49.004272] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T19:35:49.751097] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-21T19:35:50.086570] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T19:35:50.551051] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-21T19:35:50.831501] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T19:35:50.834677] [INFO ] [REMOTE ] KOP: Full fetch complete (25443 records). [2025-10-21T19:35:50.834775] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-21T19:35:51.087003] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-21T19:35:51.205591] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-21T19:35:51.205683] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-21T19:35:51.206176] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-21T19:35:51.206216] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-21T19:35:51.206835] [DEBUG] [LOCAL ] KOP: Trimmed 25443 records to 17428 (keeping 200 days of data) [2025-10-21T19:35:51.308084] [DEBUG] [LOCAL ] KOP: Primary data saved (17428 records). [2025-10-21T19:35:51.308209] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-21T19:35:51.308285] [INFO ] [MAIN ] Update Progress: 1210/2366 symbols completed. KOP took 27.0s. Estimated remaining: 2h 28m 50s. Rate: 7.8 symbols/min [2025-10-21T19:35:51.361108] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-21T19:35:51.493449] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:35:51.540478] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-21T19:35:51.540813] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-10-21T19:35:51.714117] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:35:51.714288] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-21T19:35:51.714360] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-21T19:35:51.714709] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-21T19:35:51.714780] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-21T19:35:52.062948] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:35:52.151028] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-21T19:35:52.660878] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T19:35:52.951009] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-21T19:35:53.645225] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T19:35:53.750988] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-21T19:35:54.346461] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T19:35:54.351212] [INFO ] [REMOTE ] KOF: Full fetch complete (38167 records). [2025-10-21T19:35:54.351295] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-21T19:35:54.557360] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-21T19:35:54.743853] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-21T19:35:54.743927] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-21T19:35:54.744629] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-21T19:35:54.744703] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-21T19:35:54.745482] [DEBUG] [LOCAL ] KOF: Trimmed 38167 records to 26600 (keeping 200 days of data) [2025-10-21T19:35:54.904920] [DEBUG] [LOCAL ] KOF: Primary data saved (26600 records). [2025-10-21T19:35:54.905045] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-21T19:35:54.905120] [INFO ] [MAIN ] Update Progress: 1211/2366 symbols completed. KOF took 33.4s. Estimated remaining: 2h 28m 38s. Rate: 7.8 symbols/min [2025-10-21T19:35:55.074259] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:35:55.116574] [DEBUG] [LOCAL ] KRC: Loaded 48217 existing records from primary storage. [2025-10-21T19:35:55.116912] [INFO ] [MAIN ] KRC: Loaded 48217 existing records. [2025-10-21T19:35:55.314858] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:35:55.315108] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-21T19:35:55.315162] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-21T19:35:55.315353] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-21T19:35:55.315407] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-21T19:35:55.379242] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-21T19:35:55.677728] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:35:55.711287] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-21T19:35:55.943936] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T19:35:56.151014] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-21T19:35:56.352207] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T19:35:56.606862] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-21T19:35:56.951063] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-21T19:35:57.751033] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-21T19:35:58.551052] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-21T19:35:58.808721] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T19:35:59.123025] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-21T19:35:59.124082] [INFO ] [REMOTE ] KORE: Full fetch complete (4144 records). [2025-10-21T19:35:59.124149] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-21T19:35:59.378203] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-21T19:35:59.518309] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-21T19:35:59.518434] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-21T19:35:59.518589] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-21T19:35:59.518852] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-21T19:35:59.520106] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T19:35:59.529700] [DEBUG] [LOCAL ] KORE: Trimmed 4144 records to 2184 (keeping 200 days of data) [2025-10-21T19:35:59.541557] [DEBUG] [LOCAL ] KORE: Primary data saved (2184 records). [2025-10-21T19:35:59.541619] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-21T19:35:59.541716] [INFO ] [MAIN ] Update Progress: 1212/2366 symbols completed. KORE took 23.1s. Estimated remaining: 2h 28m 28s. Rate: 7.8 symbols/min [2025-10-21T19:35:59.707436] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:35:59.746427] [DEBUG] [LOCAL ] KREF: Loaded 38036 existing records from primary storage. [2025-10-21T19:35:59.746713] [INFO ] [MAIN ] KREF: Loaded 38036 existing records. [2025-10-21T19:35:59.924046] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:35:59.924293] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-21T19:35:59.924341] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-21T19:35:59.924513] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-21T19:35:59.924553] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-21T19:36:00.161731] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-21T19:36:00.287037] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:36:00.951088] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-21T19:36:01.733724] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-21T19:36:01.750968] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-21T19:36:02.019553] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-21T19:36:02.551012] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-21T19:36:02.834734] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T19:36:03.351069] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-21T19:36:03.886226] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-21T19:36:03.954142] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T19:36:04.151056] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-21T19:36:04.951061] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-21T19:36:04.980679] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T19:36:05.450511] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T19:36:05.751053] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-21T19:36:06.550997] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-21T19:36:07.001863] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-21T19:36:07.288088] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T19:36:07.351071] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-21T19:36:07.980539] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-21T19:36:08.151029] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-21T19:36:08.735266] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T19:36:08.951052] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-21T19:36:09.751005] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-21T19:36:10.050150] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-21T19:36:10.430875] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-21T19:36:10.551027] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-21T19:36:11.350995] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-21T19:36:11.618405] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T19:36:11.991302] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-21T19:36:12.151027] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-21T19:36:12.834849] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T19:36:12.951020] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-21T19:36:13.756703] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-21T19:36:13.762906] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T19:36:14.551039] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-21T19:36:14.736384] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T19:36:15.255690] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-21T19:36:15.351045] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-21T19:36:15.686245] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T19:36:16.151061] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-21T19:36:16.950990] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-21T19:36:17.300610] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-21T19:36:17.751006] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-21T19:36:18.018968] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T19:36:18.189754] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-21T19:36:18.551038] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-21T19:36:19.351088] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-21T19:36:19.451835] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T19:36:19.986208] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T19:36:20.151011] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-21T19:36:20.951064] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-21T19:36:21.076608] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T19:36:21.456605] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-21T19:36:21.554224] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-21T19:36:21.564050] [INFO ] [REMOTE ] KR: Full fetch complete (77843 records). [2025-10-21T19:36:21.564298] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-21T19:36:21.756298] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-21T19:36:22.003776] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-21T19:36:22.003897] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-21T19:36:22.005329] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-21T19:36:22.005398] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-21T19:36:22.007474] [DEBUG] [LOCAL ] KR: Trimmed 77843 records to 53681 (keeping 200 days of data) [2025-10-21T19:36:22.370412] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-10-21T19:36:22.370934] [INFO ] [MAIN ] KR: Full history saved. [2025-10-21T19:36:22.371072] [INFO ] [MAIN ] Update Progress: 1213/2366 symbols completed. KR took 31.1s. Estimated remaining: 2h 28m 34s. Rate: 7.8 symbols/min [2025-10-21T19:36:22.549794] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:36:22.551086] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-21T19:36:22.600498] [DEBUG] [LOCAL ] KRG: Loaded 49298 existing records from primary storage. [2025-10-21T19:36:22.600932] [INFO ] [MAIN ] KRG: Loaded 49298 existing records. [2025-10-21T19:36:22.789396] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:36:22.789734] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-21T19:36:22.789793] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-21T19:36:22.790405] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-21T19:36:22.790464] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-21T19:36:23.187086] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:36:23.312349] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T19:36:23.351008] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-21T19:36:24.151042] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-21T19:36:24.657013] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-21T19:36:24.951021] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-21T19:36:25.047082] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-21T19:36:25.053758] [INFO ] [REMOTE ] KREF: Full fetch complete (52886 records). [2025-10-21T19:36:25.053861] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-21T19:36:25.441696] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-21T19:36:25.441783] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-21T19:36:25.442682] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-21T19:36:25.442745] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-21T19:36:25.443795] [DEBUG] [LOCAL ] KREF: Trimmed 52886 records to 38066 (keeping 200 days of data) [2025-10-21T19:36:25.674218] [DEBUG] [LOCAL ] KREF: Primary data saved (38066 records). [2025-10-21T19:36:25.674432] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-21T19:36:25.674552] [INFO ] [MAIN ] Update Progress: 1214/2366 symbols completed. KREF took 26.1s. Estimated remaining: 2h 28m 22s. Rate: 7.8 symbols/min [2025-10-21T19:36:25.756359] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-21T19:36:25.848484] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:36:25.848677] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-21T19:36:25.848731] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-21T19:36:25.848837] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-21T19:36:25.848880] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-21T19:36:25.848920] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-21T19:36:25.848995] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-21T19:36:26.203757] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:36:26.361419] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-21T19:36:26.370157] [INFO ] [REMOTE ] KOS: Full fetch complete (77023 records). [2025-10-21T19:36:26.370339] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-21T19:36:26.551958] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-10-21T19:36:26.822515] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-21T19:36:26.817113] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T19:36:26.840121] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-21T19:36:26.844491] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-21T19:36:26.844719] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-10-21T19:36:26.845121] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:36:26.849709] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T19:36:26.845684] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-21T19:36:26.849838] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-21T19:36:26.850066] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:36:26.859314] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-21T19:36:26.860913] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-21T19:36:26.861076] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-21T19:36:26.861214] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-21T19:36:26.861303] [INFO ] [MAIN ] Update Progress: 1215/2366 symbols completed. KRMN took 1.2s. Estimated remaining: 2h 28m 9s. Rate: 7.8 symbols/min [2025-10-21T19:36:26.872778] [DEBUG] [LOCAL ] KOS: Trimmed 77023 records to 53093 (keeping 200 days of data) [2025-10-21T19:36:27.141122] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:36:27.268857] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-21T19:36:27.320181] [INFO ] [REMOTE ] KRC: Full fetch complete (70013 records). [2025-10-21T19:36:27.354982] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-21T19:36:27.354588] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-21T19:36:27.444904] [DEBUG] [LOCAL ] KRO: Loaded 26644 existing records from primary storage. [2025-10-21T19:36:27.488019] [INFO ] [MAIN ] KRO: Loaded 26644 existing records. [2025-10-21T19:36:27.477427] [DEBUG] [LOCAL ] KOS: Primary data saved (53093 records). [2025-10-21T19:36:27.493549] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-21T19:36:27.559782] [INFO ] [MAIN ] Update Progress: 1216/2366 symbols completed. KOS took 45.8s. Estimated remaining: 2h 27m 54s. Rate: 7.8 symbols/min [2025-10-21T19:36:28.022707] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:36:28.075030] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-21T19:36:28.075193] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-21T19:36:28.091477] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-21T19:36:28.130428] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-21T19:36:28.130304] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:36:28.225723] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-21T19:36:28.232817] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-21T19:36:28.246192] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-21T19:36:28.260345] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-21T19:36:28.305261] [DEBUG] [LOCAL ] KRC: Trimmed 70013 records to 48149 (keeping 200 days of data) [2025-10-21T19:36:28.583330] [DEBUG] [LOCAL ] KRP: Loaded 36203 existing records from primary storage. [2025-10-21T19:36:28.633722] [INFO ] [MAIN ] KRP: Loaded 36203 existing records. [2025-10-21T19:36:28.943990] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:36:28.966549] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-21T19:36:29.081302] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:36:29.097157] [DEBUG] [LOCAL ] KRC: Primary data saved (48149 records). [2025-10-21T19:36:29.097726] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-21T19:36:29.098068] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-21T19:36:29.098372] [INFO ] [MAIN ] Update Progress: 1217/2366 symbols completed. KRC took 34.2s. Estimated remaining: 2h 27m 41s. Rate: 7.8 symbols/min [2025-10-21T19:36:29.098203] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-21T19:36:29.109715] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-21T19:36:29.134343] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-21T19:36:29.405018] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:36:29.417434] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-21T19:36:29.468546] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-21T19:36:29.705419] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:36:29.725154] [DEBUG] [LOCAL ] KSS: Loaded 53591 existing records from primary storage. [2025-10-21T19:36:29.725497] [INFO ] [MAIN ] KSS: Loaded 53591 existing records. [2025-10-21T19:36:29.756269] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-21T19:36:29.905981] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:36:29.906336] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-21T19:36:29.906395] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-21T19:36:29.906747] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-21T19:36:29.906803] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-21T19:36:30.229182] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-21T19:36:30.286833] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:36:30.551035] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-21T19:36:31.272404] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T19:36:31.350987] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-21T19:36:31.494661] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T19:36:32.151051] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-21T19:36:32.799204] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-21T19:36:32.951067] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-21T19:36:32.998968] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T19:36:33.099099] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T19:36:33.750999] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-21T19:36:34.551059] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-21T19:36:34.850338] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T19:36:34.881869] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-21T19:36:35.351026] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-21T19:36:35.913489] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-21T19:36:36.151002] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-21T19:36:36.600387] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T19:36:36.951050] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-21T19:36:37.750997] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-21T19:36:38.210823] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-21T19:36:38.508202] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T19:36:38.550978] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-21T19:36:39.351007] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-21T19:36:39.444624] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T19:36:39.995375] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T19:36:40.151019] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-21T19:36:40.951138] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-21T19:36:41.354424] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-21T19:36:41.751020] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-21T19:36:41.806866] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T19:36:42.092926] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T19:36:42.551086] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-21T19:36:43.254349] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T19:36:43.350999] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-21T19:36:44.151013] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-21T19:36:44.261539] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T19:36:44.737156] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T19:36:44.951002] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-21T19:36:44.967980] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-21T19:36:45.751056] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-21T19:36:46.333043] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-21T19:36:46.550985] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-21T19:36:46.945876] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T19:36:47.351059] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-21T19:36:48.150996] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-21T19:36:48.255019] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T19:36:48.706917] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T19:36:48.951055] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-21T19:36:49.751002] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-21T19:36:50.164366] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T19:36:50.225028] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T19:36:50.551017] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-21T19:36:51.351006] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-21T19:36:51.437255] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T19:36:52.151002] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-21T19:36:52.478393] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T19:36:52.685233] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T19:36:52.951027] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-21T19:36:53.575979] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-21T19:36:53.583659] [INFO ] [REMOTE ] KRG: Full fetch complete (71341 records). [2025-10-21T19:36:53.583783] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-21T19:36:53.756295] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-21T19:36:53.971275] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-21T19:36:53.971422] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-21T19:36:53.972473] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-21T19:36:53.972537] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-21T19:36:53.973991] [DEBUG] [LOCAL ] KRG: Trimmed 71341 records to 49291 (keeping 200 days of data) [2025-10-21T19:36:54.206857] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-21T19:36:54.295775] [DEBUG] [LOCAL ] KRG: Primary data saved (49291 records). [2025-10-21T19:36:54.295901] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-21T19:36:54.295977] [INFO ] [MAIN ] Update Progress: 1218/2366 symbols completed. KRG took 31.9s. Estimated remaining: 2h 27m 49s. Rate: 7.8 symbols/min [2025-10-21T19:36:54.461521] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:36:54.461723] [DEBUG] [LOCAL ] KT: No existing data file found in primary storage. [2025-10-21T19:36:54.461769] [WARN ] [MAIN ] KT: No existing data found, performing full refresh instead. [2025-10-21T19:36:54.461889] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-21T19:36:54.461928] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-21T19:36:54.461969] [DEBUG] [LOCAL ] KT: No primary data file found to delete. [2025-10-21T19:36:54.461999] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-21T19:36:54.557927] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-21T19:36:54.808604] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:36:55.150157] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T19:36:55.155301] [INFO ] [REMOTE ] KRP: Full fetch complete (54981 records). [2025-10-21T19:36:55.155407] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-21T19:36:55.362095] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-21T19:36:55.547820] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-21T19:36:55.547929] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-21T19:36:55.548839] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-21T19:36:55.548900] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-21T19:36:55.550131] [DEBUG] [LOCAL ] KRP: Trimmed 54981 records to 36048 (keeping 200 days of data) [2025-10-21T19:36:55.760613] [DEBUG] [LOCAL ] KRP: Primary data saved (36048 records). [2025-10-21T19:36:55.760769] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-21T19:36:55.760848] [INFO ] [MAIN ] Update Progress: 1219/2366 symbols completed. KRP took 28.2s. Estimated remaining: 2h 27m 36s. Rate: 7.8 symbols/min [2025-10-21T19:36:55.927186] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:36:55.963951] [DEBUG] [LOCAL ] KTB: Loaded 40517 existing records from primary storage. [2025-10-21T19:36:55.964263] [INFO ] [MAIN ] KTB: Loaded 40517 existing records. [2025-10-21T19:36:56.161126] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-21T19:36:56.165675] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:36:56.166576] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-21T19:36:56.166632] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-21T19:36:56.166855] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-21T19:36:56.166898] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-21T19:36:56.517613] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:36:56.796791] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-21T19:36:56.951023] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-21T19:36:57.034087] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T19:36:57.434231] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T19:36:57.439271] [INFO ] [REMOTE ] KRO: Full fetch complete (35288 records). [2025-10-21T19:36:57.439438] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-21T19:36:57.756180] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-21T19:36:57.821805] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-21T19:36:57.821895] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-21T19:36:57.822686] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-21T19:36:57.822750] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-21T19:36:57.823532] [DEBUG] [LOCAL ] KRO: Trimmed 35288 records to 26642 (keeping 200 days of data) [2025-10-21T19:36:57.975163] [DEBUG] [LOCAL ] KRO: Primary data saved (26642 records). [2025-10-21T19:36:57.975302] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-21T19:36:57.975380] [INFO ] [MAIN ] Update Progress: 1220/2366 symbols completed. KRO took 31.1s. Estimated remaining: 2h 27m 23s. Rate: 7.8 symbols/min [2025-10-21T19:36:58.143894] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:36:58.156702] [DEBUG] [LOCAL ] KTF: Loaded 11669 existing records from primary storage. [2025-10-21T19:36:58.156918] [INFO ] [MAIN ] KTF: Loaded 11669 existing records. [2025-10-21T19:36:58.333131] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:36:58.333328] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-21T19:36:58.333373] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-21T19:36:58.333525] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-21T19:36:58.333561] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-21T19:36:58.574588] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-21T19:36:58.691340] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:36:59.054172] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-21T19:36:59.348041] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T19:36:59.355082] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-21T19:37:00.151022] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-21T19:37:00.231935] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T19:37:00.951570] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-21T19:37:00.957309] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T19:37:01.170457] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-21T19:37:01.751074] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-21T19:37:02.551039] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-21T19:37:02.941581] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-21T19:37:03.361337] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-21T19:37:03.367045] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T19:37:03.407460] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T19:37:04.151030] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-21T19:37:04.951045] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-21T19:37:05.195858] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T19:37:05.751014] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-21T19:37:05.837251] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T19:37:05.939446] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T19:37:06.551040] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-21T19:37:07.350996] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-21T19:37:07.745671] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T19:37:07.754119] [INFO ] [REMOTE ] KSS: Full fetch complete (77751 records). [2025-10-21T19:37:07.754256] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-21T19:37:08.151522] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-21T19:37:08.151892] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-21T19:37:08.152804] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-21T19:37:08.154005] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-21T19:37:08.154172] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-21T19:37:08.169453] [DEBUG] [LOCAL ] KSS: Trimmed 77751 records to 53589 (keeping 200 days of data) [2025-10-21T19:37:08.182579] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T19:37:08.505868] [DEBUG] [LOCAL ] KSS: Primary data saved (53589 records). [2025-10-21T19:37:08.505994] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-21T19:37:08.507011] [INFO ] [MAIN ] Update Progress: 1221/2366 symbols completed. KSS took 39.4s. Estimated remaining: 2h 27m 18s. Rate: 7.8 symbols/min [2025-10-21T19:37:08.675815] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:37:08.675958] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-21T19:37:08.675994] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-21T19:37:08.676099] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-21T19:37:08.676153] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-21T19:37:08.676196] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-21T19:37:08.676229] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-21T19:37:08.956328] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-21T19:37:09.040752] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:37:09.067791] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T19:37:09.172959] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-21T19:37:09.751094] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-21T19:37:10.303098] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T19:37:10.551085] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-21T19:37:11.292255] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T19:37:11.350988] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-21T19:37:11.586337] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-21T19:37:12.151015] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-21T19:37:12.785111] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-21T19:37:12.867898] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T19:37:12.950994] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-21T19:37:13.751034] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-21T19:37:14.551019] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-21T19:37:14.622066] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T19:37:15.259031] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T19:37:15.351054] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-21T19:37:15.426614] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-21T19:37:16.133488] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T19:37:16.150989] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-21T19:37:16.951092] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-21T19:37:17.078413] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-21T19:37:17.516678] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-21T19:37:17.751011] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-21T19:37:18.546267] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-21T19:37:18.550969] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-21T19:37:19.350999] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-21T19:37:19.437981] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-21T19:37:20.151027] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-21T19:37:20.912578] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-21T19:37:20.950992] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-21T19:37:20.992438] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T19:37:21.688462] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-21T19:37:21.690260] [INFO ] [REMOTE ] KTF: Full fetch complete (17289 records). [2025-10-21T19:37:21.690329] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-21T19:37:21.756201] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-21T19:37:22.056090] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-21T19:37:22.056161] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-21T19:37:22.056526] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-21T19:37:22.056565] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-21T19:37:22.057076] [DEBUG] [LOCAL ] KTF: Trimmed 17289 records to 11685 (keeping 200 days of data) [2025-10-21T19:37:22.129008] [DEBUG] [LOCAL ] KTF: Primary data saved (11685 records). [2025-10-21T19:37:22.129142] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-21T19:37:22.129245] [INFO ] [MAIN ] Update Progress: 1222/2366 symbols completed. KTF took 24.2s. Estimated remaining: 2h 27m 16s. Rate: 7.8 symbols/min [2025-10-21T19:37:22.283921] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-21T19:37:22.300517] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:37:22.351991] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-21T19:37:22.352283] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-21T19:37:22.526637] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:37:22.526878] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-21T19:37:22.526926] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-21T19:37:22.527113] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-21T19:37:22.527149] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-21T19:37:22.556244] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-21T19:37:22.881028] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:37:23.351074] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-21T19:37:23.769444] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-21T19:37:24.150997] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-21T19:37:24.248128] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T19:37:24.951084] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-21T19:37:25.420360] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-21T19:37:25.751136] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-21T19:37:25.845257] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T19:37:26.551110] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-21T19:37:27.128774] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-21T19:37:27.351024] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-21T19:37:27.630630] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T19:37:28.151025] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-21T19:37:28.761470] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-21T19:37:28.951015] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-21T19:37:29.751081] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-21T19:37:30.122892] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-21T19:37:30.551083] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-21T19:37:30.687254] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T19:37:30.692940] [INFO ] [REMOTE ] KTB: Full fetch complete (58222 records). [2025-10-21T19:37:30.693062] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-21T19:37:31.087719] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-21T19:37:31.088062] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-21T19:37:31.089368] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-21T19:37:31.089478] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-21T19:37:31.103884] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-21T19:37:31.125752] [DEBUG] [LOCAL ] KTB: Trimmed 58222 records to 40377 (keeping 200 days of data) [2025-10-21T19:37:31.128019] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T19:37:31.139095] [INFO ] [REMOTE ] KT: Full fetch complete (66789 records). [2025-10-21T19:37:31.139226] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-21T19:37:31.354849] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-21T19:37:31.826136] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-21T19:37:31.826876] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-21T19:37:31.826810] [DEBUG] [LOCAL ] KTB: Primary data saved (40377 records). [2025-10-21T19:37:31.828158] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-21T19:37:31.828236] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-21T19:37:31.828420] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-21T19:37:31.829086] [INFO ] [MAIN ] Update Progress: 1223/2366 symbols completed. KTB took 36.1s. Estimated remaining: 2h 27m 10s. Rate: 7.8 symbols/min [2025-10-21T19:37:31.929047] [DEBUG] [LOCAL ] KT: Trimmed 66789 records to 45470 (keeping 200 days of data) [2025-10-21T19:37:32.089806] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:37:32.175293] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-21T19:37:32.263521] [DEBUG] [LOCAL ] KVYO: Loaded 50869 existing records from primary storage. [2025-10-21T19:37:32.272734] [INFO ] [MAIN ] KVYO: Loaded 50869 existing records. [2025-10-21T19:37:32.407716] [DEBUG] [LOCAL ] KT: Primary data saved (45470 records). [2025-10-21T19:37:32.411907] [INFO ] [MAIN ] KT: Full history saved. [2025-10-21T19:37:32.432536] [INFO ] [MAIN ] Update Progress: 1224/2366 symbols completed. KT took 38.1s. Estimated remaining: 2h 26m 55s. Rate: 7.8 symbols/min [2025-10-21T19:37:32.575790] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:37:32.617065] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-21T19:37:32.617319] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-21T19:37:32.629915] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T19:37:32.646252] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-21T19:37:32.647893] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-21T19:37:32.679231] [INFO ] [REMOTE ] KUKE: Full fetch complete (9347 records). [2025-10-21T19:37:32.702434] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-21T19:37:32.733075] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:37:33.138554] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T19:37:33.159954] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:37:33.172606] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:37:33.183921] [DEBUG] [LOCAL ] KW: Loaded 40515 existing records from primary storage. [2025-10-21T19:37:33.201846] [INFO ] [MAIN ] KW: Loaded 40515 existing records. [2025-10-21T19:37:33.190633] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-21T19:37:33.202050] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-21T19:37:33.213201] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-21T19:37:33.222562] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-21T19:37:33.238222] [INFO ] [MAIN ] Update Progress: 1225/2366 symbols completed. KUKE took 24.7s. Estimated remaining: 2h 26m 41s. Rate: 7.8 symbols/min [2025-10-21T19:37:33.451566] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:37:33.467532] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-21T19:37:33.655619] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:37:33.660598] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:37:33.661354] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-21T19:37:33.661405] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-21T19:37:33.661609] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-21T19:37:33.661721] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-21T19:37:33.871827] [DEBUG] [LOCAL ] KWR: Loaded 15952 existing records from primary storage. [2025-10-21T19:37:33.897071] [INFO ] [MAIN ] KWR: Loaded 15952 existing records. [2025-10-21T19:37:34.185820] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:37:34.186272] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-21T19:37:34.251446] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:37:34.251985] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-21T19:37:34.252145] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-21T19:37:34.252388] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-21T19:37:34.252446] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-21T19:37:34.384114] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-21T19:37:34.559459] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-21T19:37:34.648068] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:37:35.251618] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T19:37:35.351006] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-21T19:37:35.742054] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T19:37:36.151051] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-21T19:37:36.185587] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T19:37:36.951011] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-21T19:37:37.048066] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T19:37:37.495139] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T19:37:37.751012] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-21T19:37:38.551063] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-21T19:37:38.643683] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T19:37:39.147992] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T19:37:39.351049] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-21T19:37:39.511510] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-21T19:37:39.918290] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T19:37:40.151021] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-21T19:37:40.951069] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-21T19:37:41.751052] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-21T19:37:41.806285] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T19:37:41.930841] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-21T19:37:42.551084] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-21T19:37:43.350984] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-21T19:37:43.523920] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T19:37:43.671019] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-21T19:37:44.151047] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-21T19:37:44.951013] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-21T19:37:45.048401] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T19:37:45.122680] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-21T19:37:45.751091] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-21T19:37:46.003164] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-21T19:37:46.551086] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-21T19:37:46.905269] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T19:37:47.351074] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-21T19:37:48.151050] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-21T19:37:48.296728] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T19:37:48.951185] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-21T19:37:49.234204] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T19:37:49.298369] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-21T19:37:49.751077] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-21T19:37:50.507520] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T19:37:50.550989] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-21T19:37:50.785251] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T19:37:51.351054] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-21T19:37:52.151003] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-21T19:37:52.220853] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-21T19:37:52.285075] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T19:37:52.951027] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-21T19:37:53.654091] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T19:37:53.751049] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-21T19:37:54.550995] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-21T19:37:54.632010] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T19:37:55.350990] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-21T19:37:55.521446] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T19:37:55.918491] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T19:37:56.151080] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-21T19:37:56.951000] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-21T19:37:56.991497] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T19:37:57.025623] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T19:37:57.027760] [INFO ] [REMOTE ] KWR: Full fetch complete (23228 records). [2025-10-21T19:37:57.027867] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-21T19:37:57.408548] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-21T19:37:57.408622] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-21T19:37:57.409138] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-21T19:37:57.409210] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-21T19:37:57.409818] [DEBUG] [LOCAL ] KWR: Trimmed 23228 records to 15865 (keeping 200 days of data) [2025-10-21T19:37:57.506593] [DEBUG] [LOCAL ] KWR: Primary data saved (15865 records). [2025-10-21T19:37:57.506747] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-21T19:37:57.506829] [INFO ] [MAIN ] Update Progress: 1226/2366 symbols completed. KWR took 24.2s. Estimated remaining: 2h 26m 49s. Rate: 7.8 symbols/min [2025-10-21T19:37:57.672299] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:37:57.703728] [DEBUG] [LOCAL ] KYN: Loaded 30326 existing records from primary storage. [2025-10-21T19:37:57.703998] [INFO ] [MAIN ] KYN: Loaded 30326 existing records. [2025-10-21T19:37:57.757527] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-21T19:37:57.884198] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:37:57.884425] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-21T19:37:57.884472] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-21T19:37:57.884696] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-21T19:37:57.884752] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-21T19:37:58.227694] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:37:58.551067] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-21T19:37:59.154761] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-21T19:37:59.351005] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-21T19:37:59.662861] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T19:37:59.670943] [INFO ] [REMOTE ] KVYO: Full fetch complete (72193 records). [2025-10-21T19:37:59.671056] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-21T19:38:00.072622] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-21T19:38:00.072802] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-21T19:38:00.074015] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-21T19:38:00.074383] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-21T19:38:00.099828] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T19:38:00.119067] [DEBUG] [LOCAL ] KVYO: Trimmed 72193 records to 50885 (keeping 200 days of data) [2025-10-21T19:38:00.130713] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-21T19:38:00.176330] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-21T19:38:00.222103] [INFO ] [REMOTE ] KVUE: Full fetch complete (77844 records). [2025-10-21T19:38:00.224714] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-21T19:38:00.822527] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-21T19:38:00.823443] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-21T19:38:00.836848] [DEBUG] [LOCAL ] KVYO: Primary data saved (50885 records). [2025-10-21T19:38:00.828617] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-21T19:38:00.836975] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-21T19:38:00.837047] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-21T19:38:00.837164] [INFO ] [MAIN ] Update Progress: 1227/2366 symbols completed. KVYO took 29.0s. Estimated remaining: 2h 26m 37s. Rate: 7.8 symbols/min [2025-10-21T19:38:00.938683] [DEBUG] [LOCAL ] KVUE: Trimmed 77844 records to 53667 (keeping 200 days of data) [2025-10-21T19:38:01.007290] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-21T19:38:01.103905] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:38:01.363483] [DEBUG] [LOCAL ] L: Loaded 41243 existing records from primary storage. [2025-10-21T19:38:01.367543] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-10-21T19:38:01.367901] [INFO ] [MAIN ] L: Loaded 41243 existing records. [2025-10-21T19:38:01.367973] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-21T19:38:01.374116] [INFO ] [MAIN ] Update Progress: 1228/2366 symbols completed. KVUE took 39.2s. Estimated remaining: 2h 26m 23s. Rate: 7.8 symbols/min [2025-10-21T19:38:01.744900] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:38:01.738226] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:38:01.745670] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-21T19:38:01.745761] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-21T19:38:01.746100] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-21T19:38:01.746226] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-21T19:38:02.056782] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T19:38:02.097362] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-21T19:38:02.120386] [DEBUG] [LOCAL ] LAC: Loaded 52554 existing records from primary storage. [2025-10-21T19:38:02.140378] [INFO ] [MAIN ] LAC: Loaded 52554 existing records. [2025-10-21T19:38:02.201993] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:38:02.358104] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:38:02.358308] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-21T19:38:02.358364] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-21T19:38:02.358537] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-21T19:38:02.358574] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-21T19:38:02.556358] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-21T19:38:02.707875] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T19:38:02.736635] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:38:03.351018] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-21T19:38:03.434599] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T19:38:04.151032] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-21T19:38:04.183562] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T19:38:04.632067] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T19:38:04.951095] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-21T19:38:05.751027] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-21T19:38:06.252277] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-21T19:38:06.467337] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-21T19:38:06.473367] [INFO ] [REMOTE ] KW: Full fetch complete (57265 records). [2025-10-21T19:38:06.473463] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-21T19:38:06.556143] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-21T19:38:06.877601] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-21T19:38:06.877782] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-21T19:38:06.878746] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-21T19:38:06.878825] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-21T19:38:06.897211] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-21T19:38:06.904501] [DEBUG] [LOCAL ] KW: Trimmed 57265 records to 40418 (keeping 200 days of data) [2025-10-21T19:38:07.137587] [DEBUG] [LOCAL ] KW: Primary data saved (40418 records). [2025-10-21T19:38:07.137732] [INFO ] [MAIN ] KW: Full history saved. [2025-10-21T19:38:07.137845] [INFO ] [MAIN ] Update Progress: 1229/2366 symbols completed. KW took 34.7s. Estimated remaining: 2h 26m 13s. Rate: 7.8 symbols/min [2025-10-21T19:38:07.305844] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:38:07.327630] [DEBUG] [LOCAL ] LAD: Loaded 23301 existing records from primary storage. [2025-10-21T19:38:07.327917] [INFO ] [MAIN ] LAD: Loaded 23301 existing records. [2025-10-21T19:38:07.357857] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-21T19:38:07.505146] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:38:07.505343] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-21T19:38:07.505389] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-21T19:38:07.505590] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-21T19:38:07.505628] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-21T19:38:07.857216] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:38:08.151066] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-21T19:38:08.249181] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T19:38:08.951050] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-21T19:38:09.264863] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T19:38:09.568465] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T19:38:09.751051] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-21T19:38:10.232980] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-21T19:38:10.551031] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-21T19:38:11.350995] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-21T19:38:11.688525] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T19:38:11.922112] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T19:38:12.151047] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-21T19:38:12.732429] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-21T19:38:12.951070] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-21T19:38:13.505734] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-21T19:38:13.751079] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-21T19:38:14.551034] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-21T19:38:14.926381] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T19:38:15.046883] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T19:38:15.351017] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-21T19:38:15.803425] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T19:38:16.151021] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-21T19:38:16.951069] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-21T19:38:17.233876] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T19:38:17.520339] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T19:38:17.678245] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-21T19:38:17.751028] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-21T19:38:18.551016] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-21T19:38:19.281585] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T19:38:19.351137] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-21T19:38:19.876207] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T19:38:20.151075] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-21T19:38:20.906133] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T19:38:20.951061] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-21T19:38:21.500159] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-21T19:38:21.751079] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-21T19:38:22.551011] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-21T19:38:23.347196] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-21T19:38:23.358113] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-21T19:38:23.586069] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T19:38:24.151047] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-21T19:38:24.432073] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T19:38:24.459760] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T19:38:24.951043] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-21T19:38:25.502012] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T19:38:25.751027] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-21T19:38:26.173306] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-21T19:38:26.551022] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-21T19:38:27.350988] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-21T19:38:27.609795] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T19:38:27.772109] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T19:38:27.777165] [INFO ] [REMOTE ] KYN: Full fetch complete (44372 records). [2025-10-21T19:38:27.777332] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-21T19:38:28.162942] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-21T19:38:28.160526] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-21T19:38:28.163746] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-21T19:38:28.164532] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-21T19:38:28.164688] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-21T19:38:28.165623] [DEBUG] [LOCAL ] KYN: Trimmed 44372 records to 30292 (keeping 200 days of data) [2025-10-21T19:38:28.356405] [DEBUG] [LOCAL ] KYN: Primary data saved (30292 records). [2025-10-21T19:38:28.356838] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-21T19:38:28.357669] [INFO ] [MAIN ] Update Progress: 1230/2366 symbols completed. KYN took 30.9s. Estimated remaining: 2h 26m 18s. Rate: 7.8 symbols/min [2025-10-21T19:38:28.536314] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:38:28.577758] [DEBUG] [LOCAL ] LADR: Loaded 39435 existing records from primary storage. [2025-10-21T19:38:28.578050] [INFO ] [MAIN ] LADR: Loaded 39435 existing records. [2025-10-21T19:38:28.762558] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:38:28.762912] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-21T19:38:28.763094] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-21T19:38:28.763597] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-21T19:38:28.763695] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-21T19:38:28.956057] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-21T19:38:29.082048] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T19:38:29.209062] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:38:29.751064] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-21T19:38:30.154363] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T19:38:30.496261] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-21T19:38:30.551035] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-21T19:38:31.351002] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-21T19:38:31.429263] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T19:38:31.437008] [INFO ] [REMOTE ] L: Full fetch complete (59408 records). [2025-10-21T19:38:31.437141] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-21T19:38:31.841252] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-21T19:38:31.841327] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-21T19:38:31.842223] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-21T19:38:31.842284] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-21T19:38:31.844429] [DEBUG] [LOCAL ] L: Trimmed 59408 records to 41211 (keeping 200 days of data) [2025-10-21T19:38:32.081486] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T19:38:32.131286] [DEBUG] [LOCAL ] L: Primary data saved (41211 records). [2025-10-21T19:38:32.131415] [INFO ] [MAIN ] L: Full history saved. [2025-10-21T19:38:32.132018] [INFO ] [MAIN ] Update Progress: 1231/2366 symbols completed. L took 31.3s. Estimated remaining: 2h 26m 7s. Rate: 7.8 symbols/min [2025-10-21T19:38:32.156956] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-21T19:38:32.308934] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:38:32.314388] [DEBUG] [LOCAL ] LANV: Loaded 2795 existing records from primary storage. [2025-10-21T19:38:32.314590] [INFO ] [MAIN ] LANV: Loaded 2795 existing records. [2025-10-21T19:38:32.490994] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:38:32.491204] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-21T19:38:32.491252] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-21T19:38:32.491393] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-21T19:38:32.491450] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-21T19:38:32.853485] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:38:32.951006] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-21T19:38:33.437047] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T19:38:33.512610] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-21T19:38:33.751039] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-21T19:38:34.126348] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.78 seconds). [2025-10-21T19:38:34.134930] [INFO ] [REMOTE ] LAC: Full fetch complete (76140 records). [2025-10-21T19:38:34.135094] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-21T19:38:34.539573] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-21T19:38:34.539739] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-21T19:38:34.540857] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-21T19:38:34.540920] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-21T19:38:34.542315] [DEBUG] [LOCAL ] LAC: Trimmed 76140 records to 52565 (keeping 200 days of data) [2025-10-21T19:38:34.587259] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-21T19:38:34.864815] [DEBUG] [LOCAL ] LAC: Primary data saved (52565 records). [2025-10-21T19:38:34.865637] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-21T19:38:34.866610] [INFO ] [MAIN ] Update Progress: 1232/2366 symbols completed. LAC took 33.5s. Estimated remaining: 2h 25m 54s. Rate: 7.8 symbols/min [2025-10-21T19:38:34.866483] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-21T19:38:35.043613] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:38:35.043799] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-21T19:38:35.043841] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-21T19:38:35.043963] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-21T19:38:35.044004] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-21T19:38:35.044043] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-21T19:38:35.044074] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-21T19:38:35.127305] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-21T19:38:35.365161] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-21T19:38:35.404897] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:38:35.853122] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-21T19:38:36.151041] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-10-21T19:38:36.916744] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-21T19:38:36.951012] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-10-21T19:38:37.751016] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-21T19:38:38.551002] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-21T19:38:38.595220] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T19:38:39.123447] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-21T19:38:39.142578] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-21T19:38:39.351050] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-21T19:38:39.846872] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-21T19:38:40.151038] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-21T19:38:40.951049] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-21T19:38:41.271329] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-21T19:38:41.401215] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-21T19:38:41.751024] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-21T19:38:42.551033] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-10-21T19:38:42.990482] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-21T19:38:42.994421] [INFO ] [REMOTE ] LAD: Full fetch complete (35402 records). [2025-10-21T19:38:42.994502] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-21T19:38:43.364857] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-21T19:38:43.367718] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-21T19:38:43.367800] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-21T19:38:43.368696] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-21T19:38:43.368864] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-21T19:38:43.369716] [DEBUG] [LOCAL ] LAD: Trimmed 35402 records to 23222 (keeping 200 days of data) [2025-10-21T19:38:43.507729] [DEBUG] [LOCAL ] LAD: Primary data saved (23222 records). [2025-10-21T19:38:43.507873] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-21T19:38:43.507950] [INFO ] [MAIN ] Update Progress: 1233/2366 symbols completed. LAD took 36.4s. Estimated remaining: 2h 25m 47s. Rate: 7.8 symbols/min [2025-10-21T19:38:43.676422] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:38:43.691717] [DEBUG] [LOCAL ] LAW: Loaded 14803 existing records from primary storage. [2025-10-21T19:38:43.691930] [INFO ] [MAIN ] LAW: Loaded 14803 existing records. [2025-10-21T19:38:43.865530] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:38:43.865740] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-21T19:38:43.865792] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-21T19:38:43.865933] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-21T19:38:43.865971] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-21T19:38:44.153804] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-21T19:38:44.228302] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:38:44.253339] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T19:38:44.734271] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-21T19:38:44.770775] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-21T19:38:44.951038] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-21T19:38:45.341017] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-21T19:38:45.751069] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-10-21T19:38:46.551009] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-21T19:38:47.351043] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-21T19:38:47.405432] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T19:38:47.999218] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-21T19:38:48.111248] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T19:38:48.151002] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-10-21T19:38:48.951082] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-21T19:38:49.710292] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T19:38:49.750978] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-10-21T19:38:49.766594] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-21T19:38:50.551119] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-21T19:38:51.210772] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-21T19:38:51.351011] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-21T19:38:51.439535] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T19:38:51.981755] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-21T19:38:51.982758] [INFO ] [REMOTE ] LANV: Full fetch complete (4243 records). [2025-10-21T19:38:51.982826] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-21T19:38:52.153808] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-10-21T19:38:52.340829] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-21T19:38:52.340906] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-21T19:38:52.341046] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-21T19:38:52.341106] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-21T19:38:52.341442] [DEBUG] [LOCAL ] LANV: Trimmed 4243 records to 2794 (keeping 200 days of data) [2025-10-21T19:38:52.356208] [DEBUG] [LOCAL ] LANV: Primary data saved (2794 records). [2025-10-21T19:38:52.356271] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-21T19:38:52.356336] [INFO ] [MAIN ] Update Progress: 1234/2366 symbols completed. LANV took 20.2s. Estimated remaining: 2h 25m 41s. Rate: 7.8 symbols/min [2025-10-21T19:38:52.522486] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:38:52.562580] [DEBUG] [LOCAL ] LAZ: Loaded 44543 existing records from primary storage. [2025-10-21T19:38:52.562918] [INFO ] [MAIN ] LAZ: Loaded 44543 existing records. [2025-10-21T19:38:52.758763] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:38:52.758947] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-21T19:38:52.758994] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-21T19:38:52.759195] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-21T19:38:52.759251] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-21T19:38:52.957722] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-21T19:38:53.126173] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:38:53.751056] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-21T19:38:53.809870] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T19:38:53.830796] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-21T19:38:54.551056] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-10-21T19:38:55.350993] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-21T19:38:55.390393] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T19:38:56.151053] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-21T19:38:56.261558] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T19:38:56.800966] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T19:38:56.951111] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-21T19:38:57.594488] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T19:38:57.742377] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-21T19:38:57.750965] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-21T19:38:58.551055] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-21T19:38:58.728795] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-21T19:38:59.351066] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-21T19:38:59.881362] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T19:39:00.151026] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-21T19:39:00.951015] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-21T19:39:01.204228] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T19:39:01.750998] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-21T19:39:01.925141] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-21T19:39:02.176046] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T19:39:02.551021] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-21T19:39:03.351014] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-10-21T19:39:03.445139] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T19:39:03.531257] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-21T19:39:04.151082] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-21T19:39:04.951068] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-21T19:39:05.083214] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T19:39:05.756106] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-10. [2025-10-21T19:39:05.772660] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-21T19:39:05.964685] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-21T19:39:06.551059] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-21T19:39:07.351065] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-21T19:39:07.651592] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T19:39:07.659846] [INFO ] [REMOTE ] LAR: Full fetch complete (62080 records). [2025-10-21T19:39:07.659995] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-10-21T19:39:07.877852] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 186 unique days, need 200 days [2025-10-21T19:39:07.878501] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:39:07.878573] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:39:07.878684] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-21T19:39:07.878778] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-21T19:39:07.878819] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-21T19:39:07.878858] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-21T19:39:07.878919] [INFO ] [MAIN ] Update Progress: 1235/2366 symbols completed. LAR took 33.0s. Estimated remaining: 2h 25m 40s. Rate: 7.8 symbols/min [2025-10-21T19:39:08.050665] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:39:08.075700] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T19:39:08.114932] [DEBUG] [LOCAL ] LB: Loaded 37212 existing records from primary storage. [2025-10-21T19:39:08.115213] [INFO ] [MAIN ] LB: Loaded 37212 existing records. [2025-10-21T19:39:08.157151] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-21T19:39:08.292558] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:39:08.292786] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-21T19:39:08.292835] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-21T19:39:08.293006] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-21T19:39:08.293043] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-21T19:39:08.655286] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:39:08.797000] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T19:39:08.951012] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-21T19:39:09.513105] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-21T19:39:09.519375] [INFO ] [REMOTE ] LADR: Full fetch complete (55565 records). [2025-10-21T19:39:09.519476] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-21T19:39:09.756204] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-21T19:39:09.901178] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-21T19:39:09.901263] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-21T19:39:09.902134] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-21T19:39:09.902195] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-21T19:39:09.903280] [DEBUG] [LOCAL ] LADR: Trimmed 55565 records to 39406 (keeping 200 days of data) [2025-10-21T19:39:10.136759] [DEBUG] [LOCAL ] LADR: Primary data saved (39406 records). [2025-10-21T19:39:10.136883] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-21T19:39:10.137413] [INFO ] [MAIN ] Update Progress: 1236/2366 symbols completed. LADR took 41.8s. Estimated remaining: 2h 25m 27s. Rate: 7.8 symbols/min [2025-10-21T19:39:10.307504] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:39:10.362155] [DEBUG] [LOCAL ] LBRT: Loaded 53003 existing records from primary storage. [2025-10-21T19:39:10.362485] [INFO ] [MAIN ] LBRT: Loaded 53003 existing records. [2025-10-21T19:39:10.545012] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:39:10.545415] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-21T19:39:10.545518] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-21T19:39:10.545780] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-21T19:39:10.545900] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-21T19:39:10.566605] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-21T19:39:10.700300] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-21T19:39:10.889822] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T19:39:10.960958] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:39:11.351097] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-21T19:39:12.151051] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-21T19:39:12.271258] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T19:39:12.319362] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-21T19:39:12.951008] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-21T19:39:13.728585] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T19:39:13.750986] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-21T19:39:13.970083] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T19:39:13.973284] [INFO ] [REMOTE ] LAW: Full fetch complete (20961 records). [2025-10-21T19:39:13.973380] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-21T19:39:14.333022] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-21T19:39:14.333097] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-21T19:39:14.333532] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-21T19:39:14.333591] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-21T19:39:14.334156] [DEBUG] [LOCAL ] LAW: Trimmed 20961 records to 14777 (keeping 200 days of data) [2025-10-21T19:39:14.413986] [DEBUG] [LOCAL ] LAW: Primary data saved (14777 records). [2025-10-21T19:39:14.414124] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-21T19:39:14.414202] [INFO ] [MAIN ] Update Progress: 1237/2366 symbols completed. LAW took 30.9s. Estimated remaining: 2h 25m 17s. Rate: 7.8 symbols/min [2025-10-21T19:39:14.551030] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-21T19:39:15.356145] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-21T19:39:15.374514] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T19:39:15.872979] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T19:39:16.151013] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-21T19:39:16.950994] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-21T19:39:17.016722] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T19:39:17.672944] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T19:39:17.751032] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-21T19:39:18.550999] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-21T19:39:18.748326] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T19:39:19.351004] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-21T19:39:19.416062] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T19:39:19.422485] [INFO ] [REMOTE ] LAZ: Full fetch complete (65416 records). [2025-10-21T19:39:19.422603] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-21T19:39:19.830635] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-21T19:39:19.830767] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-21T19:39:19.831916] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-21T19:39:19.832005] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-21T19:39:19.833503] [DEBUG] [LOCAL ] LAZ: Trimmed 65416 records to 44474 (keeping 200 days of data) [2025-10-21T19:39:19.918515] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T19:39:20.124491] [DEBUG] [LOCAL ] LAZ: Primary data saved (44474 records). [2025-10-21T19:39:20.124612] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-21T19:39:20.125182] [INFO ] [MAIN ] Update Progress: 1238/2366 symbols completed. LAZ took 27.8s. Estimated remaining: 2h 25m 7s. Rate: 7.8 symbols/min [2025-10-21T19:39:20.151007] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-21T19:39:21.117054] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T19:39:21.128353] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-21T19:39:21.753804] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-21T19:39:21.763283] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-21T19:39:22.947693] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T19:39:22.959482] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-21T19:39:23.241328] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T19:39:23.351040] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-21T19:39:24.642128] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T19:39:24.652763] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-21T19:39:24.694465] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T19:39:24.951065] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-21T19:39:26.517966] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T19:39:26.529441] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-21T19:39:26.561021] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T19:39:26.570986] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-21T19:39:28.029845] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T19:39:28.038311] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-21T19:39:28.135972] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T19:39:28.150981] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-21T19:39:29.026161] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-21T19:39:29.035463] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-21T19:39:30.010822] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T19:39:30.022097] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-21T19:39:30.531900] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-21T19:39:30.537611] [INFO ] [REMOTE ] LB: Full fetch complete (55893 records). [2025-10-21T19:39:30.537746] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-21T19:39:30.916635] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-21T19:39:30.916751] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-21T19:39:30.917662] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-21T19:39:30.917725] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-21T19:39:30.918927] [DEBUG] [LOCAL ] LB: Trimmed 55893 records to 37118 (keeping 200 days of data) [2025-10-21T19:39:31.140380] [DEBUG] [LOCAL ] LB: Primary data saved (37118 records). [2025-10-21T19:39:31.140520] [INFO ] [MAIN ] LB: Full history saved. [2025-10-21T19:39:31.140598] [INFO ] [MAIN ] Update Progress: 1239/2366 symbols completed. LB took 23.3s. Estimated remaining: 2h 25m 2s. Rate: 7.8 symbols/min [2025-10-21T19:39:31.928700] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T19:39:31.940162] [INFO ] [REMOTE ] LBRT: Full fetch complete (76912 records). [2025-10-21T19:39:31.940309] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-21T19:39:32.329637] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-21T19:39:32.329747] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-21T19:39:32.330767] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-21T19:39:32.330830] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-21T19:39:32.332151] [DEBUG] [LOCAL ] LBRT: Trimmed 76912 records to 53003 (keeping 200 days of data) [2025-10-21T19:39:32.650508] [DEBUG] [LOCAL ] LBRT: Primary data saved (53003 records). [2025-10-21T19:39:32.650692] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-21T19:39:32.651439] [INFO ] [MAIN ] Update Progress: 1240/2366 symbols completed. LBRT took 22.5s. Estimated remaining: 2h 24m 49s. Rate: 7.8 symbols/min [2025-10-21T19:39:33.202298] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:39:33.253459] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:39:33.288356] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:39:33.350019] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:39:33.376392] [DEBUG] [LOCAL ] LCII: Loaded 27217 existing records from primary storage. [2025-10-21T19:39:33.388222] [INFO ] [MAIN ] LCII: Loaded 27217 existing records. [2025-10-21T19:39:33.528442] [DEBUG] [LOCAL ] LDI: Loaded 44983 existing records from primary storage. [2025-10-21T19:39:33.555612] [INFO ] [MAIN ] LDI: Loaded 44983 existing records. [2025-10-21T19:39:33.604582] [DEBUG] [LOCAL ] LDOS: Loaded 44754 existing records from primary storage. [2025-10-21T19:39:33.685323] [INFO ] [MAIN ] LDOS: Loaded 44754 existing records. [2025-10-21T19:39:33.685194] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:39:33.731066] [DEBUG] [LOCAL ] LC: Loaded 48258 existing records from primary storage. [2025-10-21T19:39:33.768197] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-21T19:39:33.754695] [INFO ] [MAIN ] LC: Loaded 48258 existing records. [2025-10-21T19:39:33.807786] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-21T19:39:33.892123] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-21T19:39:33.902568] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-21T19:39:34.099917] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:39:34.162673] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-21T19:39:34.162802] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-21T19:39:34.202770] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-21T19:39:34.197504] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:39:34.223740] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-21T19:39:34.235820] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-21T19:39:34.223669] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-21T19:39:34.279394] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-21T19:39:34.381050] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-21T19:39:34.489775] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:39:34.548132] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-21T19:39:34.614754] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-21T19:39:34.700000] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-21T19:39:34.733846] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-21T19:39:35.197870] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:39:35.296193] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-21T19:39:35.583858] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:39:35.634823] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-21T19:39:35.661973] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:39:35.682876] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:39:35.683208] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-21T19:39:35.683418] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-21T19:39:36.595767] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T19:39:36.600897] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-21T19:39:36.966870] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T19:39:36.973608] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-21T19:39:37.089233] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T19:39:37.099235] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-21T19:39:37.512341] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-21T19:39:37.522148] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-21T19:39:37.826401] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-21T19:39:37.833226] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-21T19:39:37.886368] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-21T19:39:37.893914] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-21T19:39:38.323591] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-21T19:39:38.551076] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-21T19:39:39.216837] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T19:39:39.305997] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-21T19:39:39.355067] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-21T19:39:39.358973] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T19:39:40.157960] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-21T19:39:40.176376] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T19:39:40.951074] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-21T19:39:41.020221] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T19:39:41.394017] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-21T19:39:41.751051] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-21T19:39:42.482461] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T19:39:42.550985] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-21T19:39:42.650936] [DEBUG] [REMOTE ] LCII: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-21T19:39:42.651128] [WARN ] [REMOTE ] LCII: No data returned for month 2025-05 [2025-10-21T19:39:42.651213] [FATAL] [REMOTE ] LCII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:39:42.651305] [FATAL] [MAIN ] LCII: Failed to fetch primary data. [2025-10-21T19:39:42.651370] [WARN ] [MAIN ] LCII: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:39:42.651441] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-21T19:39:42.651514] [DEBUG] [LOCAL ] LCII: No primary data file found to delete. [2025-10-21T19:39:42.651569] [INFO ] [LOCAL ] LCII: Starting deletion of derivative data. [2025-10-21T19:39:42.651744] [DEBUG] [LOCAL ] LCII: Deleted derivative data file. [2025-10-21T19:39:42.651824] [INFO ] [MAIN ] Update Progress: 1241/2366 symbols completed. LCII took 10.0s. Estimated remaining: 2h 24m 43s. Rate: 7.8 symbols/min [2025-10-21T19:39:42.820096] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:39:42.834070] [DEBUG] [LOCAL ] LDP: Loaded 12697 existing records from primary storage. [2025-10-21T19:39:42.834286] [INFO ] [MAIN ] LDP: Loaded 12697 existing records. [2025-10-21T19:39:43.010919] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:39:43.011104] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-21T19:39:43.011150] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-21T19:39:43.011300] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-21T19:39:43.011338] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-21T19:39:43.354824] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-21T19:39:43.367922] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:39:43.467527] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T19:39:44.151028] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-21T19:39:44.950998] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-21T19:39:45.153291] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T19:39:45.441624] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T19:39:45.750998] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-21T19:39:46.135094] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T19:39:46.551021] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-21T19:39:47.249958] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-21T19:39:47.277864] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T19:39:47.351012] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-21T19:39:48.151102] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-21T19:39:48.951070] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-21T19:39:49.037233] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T19:39:49.514989] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-21T19:39:49.751041] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-21T19:39:50.409885] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T19:39:50.550989] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-21T19:39:50.704571] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-21T19:39:51.351039] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-21T19:39:52.151674] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-21T19:39:52.154188] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T19:39:52.794232] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T19:39:52.951006] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-21T19:39:53.751058] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-21T19:39:53.789797] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T19:39:54.232917] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T19:39:54.551072] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-21T19:39:54.767305] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-21T19:39:55.351028] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-21T19:39:56.139390] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T19:39:56.150968] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-21T19:39:56.233546] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-21T19:39:56.951048] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-21T19:39:57.616400] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T19:39:57.750995] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-21T19:39:58.201226] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T19:39:58.551040] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-21T19:39:59.205209] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T19:39:59.351016] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-21T19:40:00.151078] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-21T19:40:00.502016] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-21T19:40:00.951016] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-21T19:40:01.015120] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-21T19:40:01.028296] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-21T19:40:01.028041] [INFO ] [REMOTE ] LDOS: Full fetch complete (67016 records). [2025-10-21T19:40:01.031069] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-21T19:40:01.415968] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-21T19:40:01.416042] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-21T19:40:01.417014] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-21T19:40:01.417075] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-21T19:40:01.418296] [DEBUG] [LOCAL ] LDOS: Trimmed 67016 records to 44723 (keeping 200 days of data) [2025-10-21T19:40:01.714282] [DEBUG] [LOCAL ] LDOS: Primary data saved (44723 records). [2025-10-21T19:40:01.714453] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-21T19:40:01.714563] [INFO ] [MAIN ] Update Progress: 1242/2366 symbols completed. LDOS took 29.1s. Estimated remaining: 2h 24m 46s. Rate: 7.8 symbols/min [2025-10-21T19:40:01.756137] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-21T19:40:01.897133] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:40:01.934800] [DEBUG] [LOCAL ] LEA: Loaded 41313 existing records from primary storage. [2025-10-21T19:40:01.935108] [INFO ] [MAIN ] LEA: Loaded 41313 existing records. [2025-10-21T19:40:02.179907] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:40:02.180139] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-21T19:40:02.180190] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-21T19:40:02.180413] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-21T19:40:02.180470] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-21T19:40:02.553610] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:40:02.553749] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-21T19:40:02.820061] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T19:40:03.351014] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-21T19:40:03.645184] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-21T19:40:04.013060] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-21T19:40:04.021479] [INFO ] [REMOTE ] LDI: Full fetch complete (62062 records). [2025-10-21T19:40:04.021638] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-21T19:40:04.164782] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-21T19:40:04.432800] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-21T19:40:04.432919] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-21T19:40:04.433994] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-21T19:40:04.434064] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-21T19:40:04.435478] [DEBUG] [LOCAL ] LDI: Trimmed 62062 records to 45083 (keeping 200 days of data) [2025-10-21T19:40:04.704789] [DEBUG] [LOCAL ] LDI: Primary data saved (45083 records). [2025-10-21T19:40:04.704923] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-21T19:40:04.705005] [INFO ] [MAIN ] Update Progress: 1243/2366 symbols completed. LDI took 32.0s. Estimated remaining: 2h 24m 34s. Rate: 7.8 symbols/min [2025-10-21T19:40:04.903849] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:40:04.959978] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-21T19:40:04.964282] [DEBUG] [LOCAL ] LEG: Loaded 50094 existing records from primary storage. [2025-10-21T19:40:04.965185] [INFO ] [MAIN ] LEG: Loaded 50094 existing records. [2025-10-21T19:40:05.113830] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T19:40:05.124951] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-21T19:40:05.212465] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:40:05.212635] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-21T19:40:05.212720] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-21T19:40:05.212960] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-21T19:40:05.213027] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-21T19:40:05.578405] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:40:05.751028] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-21T19:40:06.551064] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-21T19:40:06.777040] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-21T19:40:06.785101] [INFO ] [REMOTE ] LC: Full fetch complete (70684 records). [2025-10-21T19:40:06.785272] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-21T19:40:07.190489] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-21T19:40:07.190609] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-21T19:40:07.191733] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-21T19:40:07.191848] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-21T19:40:07.193503] [DEBUG] [LOCAL ] LC: Trimmed 70684 records to 48247 (keeping 200 days of data) [2025-10-21T19:40:07.319952] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-21T19:40:07.369199] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-21T19:40:07.434073] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T19:40:07.521303] [DEBUG] [LOCAL ] LC: Primary data saved (48247 records). [2025-10-21T19:40:07.521441] [INFO ] [MAIN ] LC: Full history saved. [2025-10-21T19:40:07.521525] [INFO ] [MAIN ] Update Progress: 1244/2366 symbols completed. LC took 34.9s. Estimated remaining: 2h 24m 22s. Rate: 7.8 symbols/min [2025-10-21T19:40:07.708148] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:40:07.764453] [DEBUG] [LOCAL ] LEN: Loaded 53202 existing records from primary storage. [2025-10-21T19:40:07.764812] [INFO ] [MAIN ] LEN: Loaded 53202 existing records. [2025-10-21T19:40:07.962534] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:40:07.962762] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-21T19:40:07.962813] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-21T19:40:07.962999] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-21T19:40:07.963036] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-21T19:40:08.158475] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-21T19:40:08.316510] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:40:08.951032] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-21T19:40:09.319454] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-21T19:40:09.345881] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T19:40:09.348013] [INFO ] [REMOTE ] LDP: Full fetch complete (18743 records). [2025-10-21T19:40:09.348102] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-21T19:40:09.725349] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-21T19:40:09.725466] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-21T19:40:09.725966] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-21T19:40:09.726030] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-21T19:40:09.726819] [DEBUG] [LOCAL ] LDP: Trimmed 18743 records to 12691 (keeping 200 days of data) [2025-10-21T19:40:09.763556] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-21T19:40:09.817250] [DEBUG] [LOCAL ] LDP: Primary data saved (12691 records). [2025-10-21T19:40:09.817401] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-21T19:40:09.817495] [INFO ] [MAIN ] Update Progress: 1245/2366 symbols completed. LDP took 27.2s. Estimated remaining: 2h 24m 9s. Rate: 7.8 symbols/min [2025-10-21T19:40:09.998930] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:40:10.018316] [DEBUG] [LOCAL ] LEO: Loaded 16617 existing records from primary storage. [2025-10-21T19:40:10.018575] [INFO ] [MAIN ] LEO: Loaded 16617 existing records. [2025-10-21T19:40:10.205318] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:40:10.205576] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-21T19:40:10.205624] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-21T19:40:10.205845] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-21T19:40:10.205899] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-21T19:40:10.558177] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-21T19:40:10.583879] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:40:10.617325] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T19:40:11.350996] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-21T19:40:11.687316] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-21T19:40:12.151015] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-21T19:40:12.294172] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T19:40:12.460173] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-21T19:40:12.951062] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-21T19:40:13.750998] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-21T19:40:14.080707] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-21T19:40:14.325138] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T19:40:14.551016] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-21T19:40:15.203171] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-21T19:40:15.351035] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-21T19:40:16.139848] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T19:40:16.150976] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-21T19:40:16.951071] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-21T19:40:17.256438] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T19:40:17.751020] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-21T19:40:17.816951] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T19:40:18.551052] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-21T19:40:18.846559] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-21T19:40:19.351014] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-21T19:40:19.727954] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T19:40:19.762819] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-21T19:40:20.151084] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-21T19:40:20.884700] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T19:40:20.950987] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-21T19:40:21.229629] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T19:40:21.751035] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-21T19:40:22.519444] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T19:40:22.551088] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-21T19:40:22.721093] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-21T19:40:23.351026] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-21T19:40:24.106345] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T19:40:24.151023] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-21T19:40:24.951046] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-21T19:40:25.077684] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-21T19:40:25.176254] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T19:40:25.751040] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-21T19:40:26.362336] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T19:40:26.551041] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-21T19:40:27.215070] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T19:40:27.351026] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-21T19:40:28.045929] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-21T19:40:28.151024] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-21T19:40:28.956187] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-21T19:40:28.970270] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-21T19:40:29.751079] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T19:40:29.751176] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-21T19:40:29.759020] [INFO ] [REMOTE ] LEA: Full fetch complete (60625 records). [2025-10-21T19:40:29.759125] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-21T19:40:30.158261] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-21T19:40:30.158350] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-21T19:40:30.159297] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-21T19:40:30.159359] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-21T19:40:30.160582] [DEBUG] [LOCAL ] LEA: Trimmed 60625 records to 41237 (keeping 200 days of data) [2025-10-21T19:40:30.423794] [DEBUG] [LOCAL ] LEA: Primary data saved (41237 records). [2025-10-21T19:40:30.423925] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-21T19:40:30.424706] [INFO ] [MAIN ] Update Progress: 1246/2366 symbols completed. LEA took 28.7s. Estimated remaining: 2h 24m 13s. Rate: 7.8 symbols/min [2025-10-21T19:40:30.556217] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-21T19:40:30.608384] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:40:30.662167] [DEBUG] [LOCAL ] LEVI: Loaded 51821 existing records from primary storage. [2025-10-21T19:40:30.662532] [INFO ] [MAIN ] LEVI: Loaded 51821 existing records. [2025-10-21T19:40:30.867981] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:40:30.868419] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-21T19:40:30.868504] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-21T19:40:30.868890] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-21T19:40:30.869016] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-21T19:40:31.175754] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-21T19:40:31.294929] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:40:31.306440] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T19:40:31.350986] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-21T19:40:31.549522] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T19:40:31.558882] [INFO ] [REMOTE ] LEG: Full fetch complete (72849 records). [2025-10-21T19:40:31.559001] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-21T19:40:31.940442] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-21T19:40:31.940517] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-21T19:40:31.941478] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-21T19:40:31.941540] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-21T19:40:31.942873] [DEBUG] [LOCAL ] LEG: Trimmed 72849 records to 50008 (keeping 200 days of data) [2025-10-21T19:40:32.152681] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-21T19:40:32.234541] [DEBUG] [LOCAL ] LEG: Primary data saved (50008 records). [2025-10-21T19:40:32.234700] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-21T19:40:32.235515] [INFO ] [MAIN ] Update Progress: 1247/2366 symbols completed. LEG took 27.5s. Estimated remaining: 2h 23m 60s. Rate: 7.8 symbols/min [2025-10-21T19:40:32.420426] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-21T19:40:32.426576] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:40:32.445588] [DEBUG] [LOCAL ] LFT: Loaded 18230 existing records from primary storage. [2025-10-21T19:40:32.445843] [INFO ] [MAIN ] LFT: Loaded 18230 existing records. [2025-10-21T19:40:32.621560] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:40:32.621790] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-21T19:40:32.621841] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-21T19:40:32.622003] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-21T19:40:32.622041] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-21T19:40:32.956480] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-21T19:40:32.976201] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:40:33.426737] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T19:40:33.751002] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-21T19:40:34.551153] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-21T19:40:34.847342] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-21T19:40:35.312944] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T19:40:35.351017] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-21T19:40:35.687510] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T19:40:36.151124] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-21T19:40:36.951068] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-21T19:40:37.006242] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T19:40:37.382460] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T19:40:37.750988] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-21T19:40:37.896504] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-21T19:40:38.550998] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-21T19:40:39.351018] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-21T19:40:39.455085] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T19:40:39.471942] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T19:40:40.151088] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-21T19:40:40.951007] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-21T19:40:41.010443] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T19:40:41.440261] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T19:40:41.751044] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-21T19:40:41.802378] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-21T19:40:41.805140] [INFO ] [REMOTE ] LEO: Full fetch complete (26417 records). [2025-10-21T19:40:41.805209] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-21T19:40:42.164567] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-21T19:40:42.164639] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-21T19:40:42.165165] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-21T19:40:42.165205] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-21T19:40:42.165814] [DEBUG] [LOCAL ] LEO: Trimmed 26417 records to 16799 (keeping 200 days of data) [2025-10-21T19:40:42.258240] [DEBUG] [LOCAL ] LEO: Primary data saved (16799 records). [2025-10-21T19:40:42.258362] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-21T19:40:42.258437] [INFO ] [MAIN ] Update Progress: 1248/2366 symbols completed. LEO took 32.4s. Estimated remaining: 2h 23m 54s. Rate: 7.8 symbols/min [2025-10-21T19:40:42.430520] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:40:42.446601] [DEBUG] [LOCAL ] LGI: Loaded 10042 existing records from primary storage. [2025-10-21T19:40:42.446876] [INFO ] [MAIN ] LGI: Loaded 10042 existing records. [2025-10-21T19:40:42.556216] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-21T19:40:42.650276] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:40:42.650716] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-21T19:40:42.650877] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-21T19:40:42.651109] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-21T19:40:42.651183] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-21T19:40:42.874813] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-21T19:40:43.022743] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:40:43.351046] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-21T19:40:44.106364] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-21T19:40:44.151042] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-21T19:40:44.459508] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T19:40:44.885390] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-21T19:40:44.951108] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-21T19:40:45.751050] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-21T19:40:45.917115] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-21T19:40:46.551065] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-21T19:40:47.351061] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-21T19:40:47.723320] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T19:40:47.909915] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-21T19:40:48.151064] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-21T19:40:48.951035] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-21T19:40:49.669798] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-21T19:40:49.751043] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-21T19:40:49.788380] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-21T19:40:49.826803] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-21T19:40:50.551002] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-21T19:40:50.598619] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-21T19:40:50.606987] [INFO ] [REMOTE ] LEN: Full fetch complete (77217 records). [2025-10-21T19:40:50.607134] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-21T19:40:51.022084] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-21T19:40:51.022181] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-21T19:40:51.023266] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-21T19:40:51.023330] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-21T19:40:51.024808] [DEBUG] [LOCAL ] LEN: Trimmed 77217 records to 53200 (keeping 200 days of data) [2025-10-21T19:40:51.353819] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-21T19:40:51.353727] [DEBUG] [LOCAL ] LEN: Primary data saved (53200 records). [2025-10-21T19:40:51.354128] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-21T19:40:51.354441] [INFO ] [MAIN ] Update Progress: 1249/2366 symbols completed. LEN took 43.8s. Estimated remaining: 2h 23m 48s. Rate: 7.8 symbols/min [2025-10-21T19:40:51.543767] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:40:51.580624] [DEBUG] [LOCAL ] LH: Loaded 37275 existing records from primary storage. [2025-10-21T19:40:51.580934] [INFO ] [MAIN ] LH: Loaded 37275 existing records. [2025-10-21T19:40:51.702028] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-21T19:40:51.784301] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:40:51.784520] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-21T19:40:51.784566] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-21T19:40:51.784798] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-21T19:40:51.784854] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-21T19:40:52.131913] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:40:52.150982] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-21T19:40:52.950990] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-21T19:40:53.239376] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-21T19:40:53.683682] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T19:40:53.751070] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-21T19:40:53.784144] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-21T19:40:54.551014] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-21T19:40:55.351034] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-21T19:40:55.425898] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T19:40:56.081855] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-21T19:40:56.156217] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-21T19:40:56.157914] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T19:40:56.951017] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-21T19:40:57.751020] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-21T19:40:57.782435] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T19:40:57.800882] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T19:40:58.551005] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-21T19:40:58.767285] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-21T19:40:59.351023] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-21T19:41:00.151081] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-21T19:41:00.190927] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T19:41:00.951073] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-21T19:41:01.131143] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-21T19:41:01.572938] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-21T19:41:01.751023] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-21T19:41:02.549211] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T19:41:02.552364] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-21T19:41:02.664504] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-21T19:41:03.351041] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-21T19:41:04.082715] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-21T19:41:04.151005] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-21T19:41:04.431187] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T19:41:04.439540] [INFO ] [REMOTE ] LEVI: Full fetch complete (74975 records). [2025-10-21T19:41:04.439728] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-21T19:41:04.825982] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-21T19:41:04.826064] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-21T19:41:04.827073] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-21T19:41:04.827137] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-21T19:41:04.828472] [DEBUG] [LOCAL ] LEVI: Trimmed 74975 records to 51823 (keeping 200 days of data) [2025-10-21T19:41:04.951053] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-21T19:41:05.047810] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T19:41:05.054940] [INFO ] [REMOTE ] LGI: Full fetch complete (14466 records). [2025-10-21T19:41:05.056584] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-21T19:41:05.467102] [DEBUG] [LOCAL ] LEVI: Primary data saved (51823 records). [2025-10-21T19:41:05.484614] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-21T19:41:05.496267] [INFO ] [MAIN ] Update Progress: 1250/2366 symbols completed. LEVI took 35.1s. Estimated remaining: 2h 23m 46s. Rate: 7.8 symbols/min [2025-10-21T19:41:05.628386] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-21T19:41:05.628935] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-21T19:41:05.629338] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-21T19:41:05.645201] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-21T19:41:05.682379] [DEBUG] [LOCAL ] LGI: Trimmed 14466 records to 10022 (keeping 200 days of data) [2025-10-21T19:41:05.699581] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:41:05.752678] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-21T19:41:05.762186] [DEBUG] [LOCAL ] LGI: Primary data saved (10022 records). [2025-10-21T19:41:05.762396] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-21T19:41:05.762494] [INFO ] [MAIN ] Update Progress: 1251/2366 symbols completed. LGI took 23.5s. Estimated remaining: 2h 23m 31s. Rate: 7.8 symbols/min [2025-10-21T19:41:05.954705] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:41:05.969708] [DEBUG] [LOCAL ] LHX: Loaded 48528 existing records from primary storage. [2025-10-21T19:41:05.969944] [INFO ] [MAIN ] LHX: Loaded 48528 existing records. [2025-10-21T19:41:06.159466] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:41:06.168551] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-21T19:41:06.168908] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-21T19:41:06.169448] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-21T19:41:06.169544] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-21T19:41:06.169388] [DEBUG] [LOCAL ] LII: Loaded 27796 existing records from primary storage. [2025-10-21T19:41:06.232708] [INFO ] [MAIN ] LII: Loaded 27796 existing records. [2025-10-21T19:41:06.514232] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:41:06.558150] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-21T19:41:06.588955] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-21T19:41:06.605565] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-21T19:41:06.642819] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-21T19:41:06.865055] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:41:06.896799] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-21T19:41:06.917771] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T19:41:06.903425] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-21T19:41:07.179036] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:41:07.351076] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-21T19:41:08.151092] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-21T19:41:08.729260] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T19:41:08.834049] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-21T19:41:08.951010] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-21T19:41:09.163789] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-21T19:41:09.166368] [INFO ] [REMOTE ] LFT: Full fetch complete (23824 records). [2025-10-21T19:41:09.166439] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-21T19:41:09.527110] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-21T19:41:09.527188] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-21T19:41:09.527671] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-21T19:41:09.527732] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-21T19:41:09.528423] [DEBUG] [LOCAL ] LFT: Trimmed 23824 records to 18162 (keeping 200 days of data) [2025-10-21T19:41:09.633219] [DEBUG] [LOCAL ] LFT: Primary data saved (18162 records). [2025-10-21T19:41:09.633359] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-21T19:41:09.633438] [INFO ] [MAIN ] Update Progress: 1252/2366 symbols completed. LFT took 37.4s. Estimated remaining: 2h 23m 20s. Rate: 7.8 symbols/min [2025-10-21T19:41:09.756113] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-21T19:41:09.810372] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:41:09.854636] [DEBUG] [LOCAL ] LION: Loaded 46794 existing records from primary storage. [2025-10-21T19:41:09.854971] [INFO ] [MAIN ] LION: Loaded 46794 existing records. [2025-10-21T19:41:10.029100] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:41:10.029304] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-21T19:41:10.029350] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-21T19:41:10.029547] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-21T19:41:10.029603] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-21T19:41:10.397808] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:41:10.414603] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T19:41:10.550986] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-21T19:41:11.351026] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-21T19:41:11.560091] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T19:41:11.706917] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-21T19:41:12.151048] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-21T19:41:12.478196] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-21T19:41:12.951059] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-21T19:41:13.751030] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-21T19:41:13.863532] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T19:41:14.044502] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-21T19:41:14.551064] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-21T19:41:15.140102] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-21T19:41:15.351065] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-21T19:41:15.588302] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T19:41:16.151089] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-21T19:41:16.735869] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-21T19:41:16.951029] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-21T19:41:17.520863] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T19:41:17.750998] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-21T19:41:18.195516] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-21T19:41:18.551082] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-21T19:41:19.351119] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-21T19:41:19.514355] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T19:41:19.802121] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T19:41:20.151161] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-21T19:41:20.659131] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T19:41:20.950995] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-21T19:41:21.326725] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-21T19:41:21.751075] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-21T19:41:22.551023] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-21T19:41:22.918986] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-21T19:41:23.214725] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T19:41:23.351004] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-21T19:41:23.429537] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T19:41:24.151033] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-21T19:41:24.761273] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T19:41:24.951077] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-21T19:41:25.751035] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-21T19:41:25.998804] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T19:41:26.551002] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-21T19:41:26.582723] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T19:41:26.978835] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T19:41:26.983672] [INFO ] [REMOTE ] LII: Full fetch complete (41689 records). [2025-10-21T19:41:26.983767] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-21T19:41:27.369349] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-21T19:41:27.367013] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-21T19:41:27.370525] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-21T19:41:27.371428] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-21T19:41:27.371572] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-21T19:41:27.372709] [DEBUG] [LOCAL ] LII: Trimmed 41689 records to 27758 (keeping 200 days of data) [2025-10-21T19:41:27.545235] [DEBUG] [LOCAL ] LII: Primary data saved (27758 records). [2025-10-21T19:41:27.545366] [INFO ] [MAIN ] LII: Full history saved. [2025-10-21T19:41:27.545443] [INFO ] [MAIN ] Update Progress: 1253/2366 symbols completed. LII took 21.8s. Estimated remaining: 2h 23m 22s. Rate: 7.8 symbols/min [2025-10-21T19:41:27.714112] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:41:27.719908] [DEBUG] [LOCAL ] LITB: Loaded 3871 existing records from primary storage. [2025-10-21T19:41:27.720049] [INFO ] [MAIN ] LITB: Loaded 3871 existing records. [2025-10-21T19:41:27.904951] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:41:27.905341] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-21T19:41:27.905460] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-21T19:41:27.905622] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-21T19:41:27.905721] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-21T19:41:28.153835] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-21T19:41:28.204748] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T19:41:28.269463] [INFO ] [REMOTE ] LH: Full fetch complete (54924 records). [2025-10-21T19:41:28.289283] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:41:28.289399] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-21T19:41:28.668482] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-21T19:41:28.668559] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-21T19:41:28.669582] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-21T19:41:28.670316] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-21T19:41:28.671490] [DEBUG] [LOCAL ] LH: Trimmed 54924 records to 37192 (keeping 200 days of data) [2025-10-21T19:41:28.915354] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T19:41:28.955025] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-21T19:41:28.954942] [DEBUG] [LOCAL ] LH: Primary data saved (37192 records). [2025-10-21T19:41:28.956054] [INFO ] [MAIN ] LH: Full history saved. [2025-10-21T19:41:28.956171] [INFO ] [MAIN ] Update Progress: 1254/2366 symbols completed. LH took 37.6s. Estimated remaining: 2h 23m 8s. Rate: 7.8 symbols/min [2025-10-21T19:41:29.124884] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:41:29.174015] [DEBUG] [LOCAL ] LLY: Loaded 53228 existing records from primary storage. [2025-10-21T19:41:29.174364] [INFO ] [MAIN ] LLY: Loaded 53228 existing records. [2025-10-21T19:41:29.349316] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:41:29.349509] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-21T19:41:29.349555] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-21T19:41:29.349791] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-21T19:41:29.349847] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-21T19:41:29.527994] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-21T19:41:29.712699] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:41:29.750997] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-21T19:41:30.059278] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T19:41:30.551085] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-21T19:41:31.351029] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-21T19:41:31.790771] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-21T19:41:32.151038] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-21T19:41:32.271770] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-21T19:41:32.310575] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T19:41:32.951066] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-21T19:41:33.725775] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-21T19:41:33.750994] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-21T19:41:34.551059] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-21T19:41:35.222601] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-21T19:41:35.353045] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-21T19:41:35.369721] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-21T19:41:35.410115] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-21T19:41:36.151039] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-21T19:41:36.165316] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-21T19:41:36.951017] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-21T19:41:37.751023] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-21T19:41:37.891362] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T19:41:37.899087] [INFO ] [REMOTE ] LION: Full fetch complete (57840 records). [2025-10-21T19:41:37.899198] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-21T19:41:38.303272] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-21T19:41:38.303353] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-21T19:41:38.304303] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-21T19:41:38.304364] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-21T19:41:38.305628] [DEBUG] [LOCAL ] LION: Trimmed 57840 records to 46849 (keeping 200 days of data) [2025-10-21T19:41:38.563681] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-21T19:41:38.572156] [DEBUG] [LOCAL ] LION: Primary data saved (46849 records). [2025-10-21T19:41:38.573309] [INFO ] [MAIN ] LION: Full history saved. [2025-10-21T19:41:38.574311] [INFO ] [MAIN ] Update Progress: 1255/2366 symbols completed. LION took 28.9s. Estimated remaining: 2h 23m 2s. Rate: 7.8 symbols/min [2025-10-21T19:41:38.750356] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:41:38.780996] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T19:41:38.847436] [DEBUG] [LOCAL ] LMND: Loaded 52135 existing records from primary storage. [2025-10-21T19:41:38.847905] [INFO ] [MAIN ] LMND: Loaded 52135 existing records. [2025-10-21T19:41:39.030235] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:41:39.030479] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-21T19:41:39.030537] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-21T19:41:39.030859] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-21T19:41:39.030915] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-21T19:41:39.135964] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-21T19:41:39.356190] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-21T19:41:39.393586] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:41:40.043340] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-21T19:41:40.151031] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-21T19:41:40.951070] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-21T19:41:41.123989] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T19:41:41.243239] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-21T19:41:41.751087] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-21T19:41:42.399368] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-21T19:41:42.551019] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-21T19:41:42.994203] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-21T19:41:43.351057] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-21T19:41:43.732415] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-21T19:41:43.739608] [INFO ] [REMOTE ] LHX: Full fetch complete (70812 records). [2025-10-21T19:41:43.739746] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-21T19:41:43.822786] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-21T19:41:44.143990] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-21T19:41:44.144089] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-21T19:41:44.145160] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-21T19:41:44.145223] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-21T19:41:44.146538] [DEBUG] [LOCAL ] LHX: Trimmed 70812 records to 48528 (keeping 200 days of data) [2025-10-21T19:41:44.206088] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-21T19:41:44.455855] [DEBUG] [LOCAL ] LHX: Primary data saved (48528 records). [2025-10-21T19:41:44.455992] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-21T19:41:44.456070] [INFO ] [MAIN ] Update Progress: 1256/2366 symbols completed. LHX took 39.0s. Estimated remaining: 2h 22m 53s. Rate: 7.8 symbols/min [2025-10-21T19:41:44.627405] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:41:44.682996] [DEBUG] [LOCAL ] LMT: Loaded 49622 existing records from primary storage. [2025-10-21T19:41:44.683302] [INFO ] [MAIN ] LMT: Loaded 49622 existing records. [2025-10-21T19:41:44.864603] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:41:44.864824] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-21T19:41:44.864872] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-21T19:41:44.865065] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-21T19:41:44.865103] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-21T19:41:44.956134] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-21T19:41:45.235708] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:41:45.690789] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-21T19:41:45.751033] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-21T19:41:46.183026] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-21T19:41:46.551012] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-21T19:41:47.351053] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-21T19:41:47.956912] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-21T19:41:47.959341] [INFO ] [REMOTE ] LITB: Full fetch complete (5773 records). [2025-10-21T19:41:47.959501] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-21T19:41:48.151689] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-21T19:41:48.355282] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-21T19:41:48.355974] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-21T19:41:48.356436] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-21T19:41:48.356704] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-21T19:41:48.357940] [DEBUG] [LOCAL ] LITB: Trimmed 5773 records to 3861 (keeping 200 days of data) [2025-10-21T19:41:48.381899] [DEBUG] [LOCAL ] LITB: Primary data saved (3861 records). [2025-10-21T19:41:48.382168] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-21T19:41:48.382411] [INFO ] [MAIN ] Update Progress: 1257/2366 symbols completed. LITB took 20.8s. Estimated remaining: 2h 22m 42s. Rate: 7.8 symbols/min [2025-10-21T19:41:48.579286] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-10-21T19:41:48.643958] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:41:48.655227] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-21T19:41:48.720593] [DEBUG] [LOCAL ] LNC: Loaded 51511 existing records from primary storage. [2025-10-21T19:41:48.721143] [INFO ] [MAIN ] LNC: Loaded 51511 existing records. [2025-10-21T19:41:48.931020] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:41:48.931243] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-21T19:41:48.931290] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-21T19:41:48.931463] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-21T19:41:48.931499] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-21T19:41:48.961404] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-21T19:41:49.282833] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:41:49.751012] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-21T19:41:50.017292] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T19:41:50.551101] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-21T19:41:50.862201] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T19:41:51.350998] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-21T19:41:51.457848] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T19:41:52.151032] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-21T19:41:52.951074] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-21T19:41:53.011101] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-21T19:41:53.103379] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T19:41:53.708226] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T19:41:53.751030] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-21T19:41:54.551069] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-21T19:41:54.732915] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-21T19:41:55.351068] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-21T19:41:55.883631] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-21T19:41:56.151022] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-21T19:41:56.951007] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-21T19:41:57.096945] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-21T19:41:57.265339] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T19:41:57.751056] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-21T19:41:57.918773] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T19:41:58.551043] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-21T19:41:59.047276] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-21T19:41:59.351129] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-21T19:41:59.415354] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T19:42:00.151036] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-21T19:42:00.308003] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T19:42:00.951025] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-21T19:42:01.751094] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-21T19:42:02.106777] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-10-21T19:42:02.234201] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-21T19:42:02.551043] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-21T19:42:03.007057] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-21T19:42:03.120361] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T19:42:03.351033] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-21T19:42:04.151067] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-21T19:42:04.575115] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-21T19:42:04.657222] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T19:42:04.951026] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-21T19:42:05.751056] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-21T19:42:06.359660] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-21T19:42:06.551051] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-21T19:42:06.763083] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T19:42:07.351120] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-21T19:42:07.896260] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-21T19:42:08.151063] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-21T19:42:08.641424] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T19:42:08.951120] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-21T19:42:09.751075] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-21T19:42:09.902859] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T19:42:10.012012] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-21T19:42:10.551046] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-21T19:42:11.350996] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-21T19:42:11.839969] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (2.89 seconds). [2025-10-21T19:42:11.848777] [INFO ] [REMOTE ] LMND: Full fetch complete (75463 records). [2025-10-21T19:42:11.848900] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-21T19:42:12.255120] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-21T19:42:12.255295] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-21T19:42:12.256625] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-21T19:42:12.256792] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-21T19:42:12.258688] [DEBUG] [LOCAL ] LMND: Trimmed 75463 records to 52124 (keeping 200 days of data) [2025-10-21T19:42:12.386194] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-21T19:42:12.482022] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-21T19:42:12.531832] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-21T19:42:12.556921] [INFO ] [REMOTE ] LLY: Full fetch complete (77202 records). [2025-10-21T19:42:12.557892] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-21T19:42:12.747409] [DEBUG] [LOCAL ] LMND: Primary data saved (52124 records). [2025-10-21T19:42:12.758945] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-21T19:42:12.770743] [INFO ] [MAIN ] Update Progress: 1258/2366 symbols completed. LMND took 34.2s. Estimated remaining: 2h 22m 49s. Rate: 7.8 symbols/min [2025-10-21T19:42:13.095809] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-21T19:42:13.239082] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:42:13.263961] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-21T19:42:13.287739] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-21T19:42:13.287859] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-21T19:42:13.289312] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-21T19:42:13.289690] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-21T19:42:13.295238] [DEBUG] [LOCAL ] LND: Loaded 4966 existing records from primary storage. [2025-10-21T19:42:13.292355] [DEBUG] [LOCAL ] LLY: Trimmed 77202 records to 53192 (keeping 200 days of data) [2025-10-21T19:42:13.295770] [INFO ] [MAIN ] LND: Loaded 4966 existing records. [2025-10-21T19:42:13.600729] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:42:13.600977] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-21T19:42:13.601024] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-21T19:42:13.601188] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-21T19:42:13.601244] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-21T19:42:14.134242] [DEBUG] [LOCAL ] LLY: Primary data saved (53192 records). [2025-10-21T19:42:14.148281] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-21T19:42:14.164658] [INFO ] [MAIN ] Update Progress: 1259/2366 symbols completed. LLY took 45.2s. Estimated remaining: 2h 22m 35s. Rate: 7.8 symbols/min [2025-10-21T19:42:14.168066] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:42:14.210822] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-21T19:42:14.336021] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:42:14.381548] [DEBUG] [LOCAL ] LNG: Loaded 51168 existing records from primary storage. [2025-10-21T19:42:14.381864] [INFO ] [MAIN ] LNG: Loaded 51168 existing records. [2025-10-21T19:42:14.558251] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:42:14.558625] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-21T19:42:14.558714] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-21T19:42:14.559027] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-21T19:42:14.559083] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-21T19:42:14.920127] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:42:14.920555] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-21T19:42:14.950854] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-21T19:42:14.957215] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-21T19:42:15.144156] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T19:42:15.152555] [INFO ] [REMOTE ] LNC: Full fetch complete (74563 records). [2025-10-21T19:42:15.152749] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-21T19:42:15.360115] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-21T19:42:15.543276] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-21T19:42:15.543355] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-21T19:42:15.544518] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-21T19:42:15.544581] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-21T19:42:15.546021] [DEBUG] [LOCAL ] LNC: Trimmed 74563 records to 51488 (keeping 200 days of data) [2025-10-21T19:42:15.856264] [DEBUG] [LOCAL ] LNC: Primary data saved (51488 records). [2025-10-21T19:42:15.856389] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-21T19:42:15.856815] [INFO ] [MAIN ] Update Progress: 1260/2366 symbols completed. LNC took 27.5s. Estimated remaining: 2h 22m 22s. Rate: 7.8 symbols/min [2025-10-21T19:42:16.031555] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:42:16.045533] [DEBUG] [LOCAL ] LNN: Loaded 11478 existing records from primary storage. [2025-10-21T19:42:16.045782] [INFO ] [MAIN ] LNN: Loaded 11478 existing records. [2025-10-21T19:42:16.156154] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-21T19:42:16.234851] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:42:16.235825] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T19:42:16.238688] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-21T19:42:16.238759] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-21T19:42:16.239300] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-21T19:42:16.239358] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-21T19:42:16.599255] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:42:16.951011] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-21T19:42:17.012024] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-21T19:42:17.589016] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T19:42:17.751036] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-21T19:42:18.363200] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-21T19:42:18.551002] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-21T19:42:18.643508] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-21T19:42:18.651208] [INFO ] [REMOTE ] LMT: Full fetch complete (72529 records). [2025-10-21T19:42:18.651336] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-21T19:42:19.032721] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-21T19:42:19.032803] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-21T19:42:19.033808] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-21T19:42:19.033869] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-21T19:42:19.035184] [DEBUG] [LOCAL ] LMT: Trimmed 72529 records to 49628 (keeping 200 days of data) [2025-10-21T19:42:19.342927] [DEBUG] [LOCAL ] LMT: Primary data saved (49628 records). [2025-10-21T19:42:19.343054] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-21T19:42:19.344112] [INFO ] [MAIN ] Update Progress: 1261/2366 symbols completed. LMT took 34.9s. Estimated remaining: 2h 22m 11s. Rate: 7.8 symbols/min [2025-10-21T19:42:19.356195] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-21T19:42:19.522286] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:42:19.529680] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-21T19:42:19.573310] [DEBUG] [LOCAL ] LOAR: Loaded 42010 existing records from primary storage. [2025-10-21T19:42:19.573611] [INFO ] [MAIN ] LOAR: Loaded 42010 existing records. [2025-10-21T19:42:19.747970] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:42:19.748223] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-21T19:42:19.748277] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-21T19:42:19.748456] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-21T19:42:19.748492] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-21T19:42:20.050500] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-21T19:42:20.110385] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:42:20.150986] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-21T19:42:20.951035] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-21T19:42:21.522218] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T19:42:21.535123] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-21T19:42:21.751055] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-21T19:42:22.551077] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-21T19:42:23.160406] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-21T19:42:23.351035] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-21T19:42:23.629178] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-21T19:42:24.151050] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-21T19:42:24.575494] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-21T19:42:24.951042] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-21T19:42:24.982755] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-21T19:42:25.751060] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-21T19:42:26.341670] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T19:42:26.551006] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-21T19:42:26.622173] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-21T19:42:27.351026] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-21T19:42:27.885580] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-21T19:42:28.151088] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-21T19:42:28.286592] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T19:42:28.734206] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T19:42:28.951077] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-21T19:42:29.751046] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-21T19:42:30.551011] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-21T19:42:30.720077] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T19:42:30.820753] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T19:42:31.218475] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-21T19:42:31.219830] [INFO ] [REMOTE ] LND: Full fetch complete (7805 records). [2025-10-21T19:42:31.219899] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-21T19:42:31.361763] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-21T19:42:31.594192] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-21T19:42:31.594289] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-21T19:42:31.594543] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-21T19:42:31.594605] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-21T19:42:31.595054] [DEBUG] [LOCAL ] LND: Trimmed 7805 records to 4930 (keeping 200 days of data) [2025-10-21T19:42:31.622992] [DEBUG] [LOCAL ] LND: Primary data saved (4930 records). [2025-10-21T19:42:31.623116] [INFO ] [MAIN ] LND: Full history saved. [2025-10-21T19:42:31.623198] [INFO ] [MAIN ] Update Progress: 1262/2366 symbols completed. LND took 18.9s. Estimated remaining: 2h 22m 7s. Rate: 7.8 symbols/min [2025-10-21T19:42:31.821405] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:42:31.847678] [DEBUG] [LOCAL ] LOB: Loaded 26844 existing records from primary storage. [2025-10-21T19:42:31.847955] [INFO ] [MAIN ] LOB: Loaded 26844 existing records. [2025-10-21T19:42:32.020406] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:42:32.020620] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-21T19:42:32.020697] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-21T19:42:32.020922] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-21T19:42:32.020977] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-21T19:42:32.158230] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-21T19:42:32.387520] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:42:32.951019] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-21T19:42:32.984743] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T19:42:33.402535] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-21T19:42:33.751032] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-21T19:42:34.214912] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T19:42:34.551067] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-21T19:42:35.350994] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-21T19:42:35.635310] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T19:42:35.734206] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T19:42:36.151071] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-21T19:42:36.719602] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T19:42:36.951085] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-21T19:42:37.264236] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T19:42:37.751055] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-21T19:42:38.466737] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T19:42:38.510962] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-21T19:42:38.551006] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-21T19:42:39.351101] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-21T19:42:39.467788] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-21T19:42:40.151079] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-21T19:42:40.840098] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-21T19:42:40.950997] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-21T19:42:41.423132] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-21T19:42:41.751038] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-21T19:42:42.423168] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T19:42:42.551001] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-21T19:42:42.656247] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T19:42:43.350026] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T19:42:43.352232] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-21T19:42:44.151016] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-21T19:42:44.416210] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-21T19:42:44.951030] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-21T19:42:44.971261] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-21T19:42:45.751077] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-21T19:42:46.551063] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-21T19:42:46.779808] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T19:42:46.781016] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T19:42:46.795395] [INFO ] [REMOTE ] LNN: Full fetch complete (16024 records). [2025-10-21T19:42:46.795483] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-21T19:42:47.165037] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-21T19:42:47.165112] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-21T19:42:47.165438] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-21T19:42:47.165521] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-21T19:42:47.166063] [DEBUG] [LOCAL ] LNN: Trimmed 16024 records to 11431 (keeping 200 days of data) [2025-10-21T19:42:47.235249] [DEBUG] [LOCAL ] LNN: Primary data saved (11431 records). [2025-10-21T19:42:47.235373] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-21T19:42:47.235449] [INFO ] [MAIN ] Update Progress: 1263/2366 symbols completed. LNN took 31.4s. Estimated remaining: 2h 22m 6s. Rate: 7.8 symbols/min [2025-10-21T19:42:47.356145] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-21T19:42:47.406592] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:42:47.412295] [DEBUG] [LOCAL ] LOCL: Loaded 3814 existing records from primary storage. [2025-10-21T19:42:47.412440] [INFO ] [MAIN ] LOCL: Loaded 3814 existing records. [2025-10-21T19:42:47.588410] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:42:47.588724] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-21T19:42:47.588779] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-21T19:42:47.588896] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-21T19:42:47.588941] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-21T19:42:47.816550] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-21T19:42:47.965452] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:42:48.151040] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-21T19:42:48.951014] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-21T19:42:49.349444] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-21T19:42:49.472405] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-21T19:42:49.508006] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-21T19:42:49.751041] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-21T19:42:50.551044] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-21T19:42:51.166121] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-21T19:42:51.174983] [INFO ] [REMOTE ] LOAR: Full fetch complete (56018 records). [2025-10-21T19:42:51.175143] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-21T19:42:51.355451] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-21T19:42:51.565366] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-21T19:42:51.565483] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-21T19:42:51.566555] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-21T19:42:51.566819] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-21T19:42:51.568112] [DEBUG] [LOCAL ] LOAR: Trimmed 56018 records to 42020 (keeping 200 days of data) [2025-10-21T19:42:51.759019] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T19:42:51.835317] [DEBUG] [LOCAL ] LOAR: Primary data saved (42020 records). [2025-10-21T19:42:51.835448] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-21T19:42:51.836049] [INFO ] [MAIN ] Update Progress: 1264/2366 symbols completed. LOAR took 32.5s. Estimated remaining: 2h 21m 56s. Rate: 7.8 symbols/min [2025-10-21T19:42:52.007327] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:42:52.041020] [DEBUG] [LOCAL ] LOMA: Loaded 32769 existing records from primary storage. [2025-10-21T19:42:52.041311] [INFO ] [MAIN ] LOMA: Loaded 32769 existing records. [2025-10-21T19:42:52.142632] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-21T19:42:52.156122] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-21T19:42:52.226254] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:42:52.226446] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-21T19:42:52.226493] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-21T19:42:52.226696] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-21T19:42:52.226752] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-21T19:42:52.574972] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:42:52.951076] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-21T19:42:53.567790] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-21T19:42:53.751097] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-21T19:42:54.361386] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T19:42:54.551024] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-21T19:42:54.934943] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-21T19:42:54.939375] [INFO ] [REMOTE ] LOB: Full fetch complete (38567 records). [2025-10-21T19:42:54.939454] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-21T19:42:55.312772] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-21T19:42:55.312879] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-21T19:42:55.313629] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-21T19:42:55.313710] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-21T19:42:55.314467] [DEBUG] [LOCAL ] LOB: Trimmed 38567 records to 26778 (keeping 200 days of data) [2025-10-21T19:42:55.367307] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-21T19:42:55.476402] [DEBUG] [LOCAL ] LOB: Primary data saved (26778 records). [2025-10-21T19:42:55.476524] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-21T19:42:55.476600] [INFO ] [MAIN ] Update Progress: 1265/2366 symbols completed. LOB took 23.9s. Estimated remaining: 2h 21m 45s. Rate: 7.8 symbols/min [2025-10-21T19:42:55.597392] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T19:42:55.677109] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:42:55.725811] [DEBUG] [LOCAL ] LOW: Loaded 52993 existing records from primary storage. [2025-10-21T19:42:55.726138] [INFO ] [MAIN ] LOW: Loaded 52993 existing records. [2025-10-21T19:42:55.902819] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:42:55.903059] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-21T19:42:55.903132] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-21T19:42:55.903331] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-21T19:42:55.903372] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-21T19:42:55.984483] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-21T19:42:56.156187] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-21T19:42:56.273487] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:42:56.951043] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-21T19:42:57.462293] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T19:42:57.751073] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-21T19:42:58.551002] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-21T19:42:58.777696] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T19:42:59.351080] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-21T19:42:59.474592] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T19:42:59.883182] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T19:43:00.151058] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-21T19:43:00.951054] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-21T19:43:01.027522] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T19:43:01.500442] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T19:43:01.751037] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-21T19:43:02.551051] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-21T19:43:02.560192] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-21T19:43:03.347394] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T19:43:03.354377] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-21T19:43:03.356346] [INFO ] [REMOTE ] LNG: Full fetch complete (74723 records). [2025-10-21T19:43:03.356432] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-21T19:43:03.752879] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-21T19:43:03.752972] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-21T19:43:03.754129] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-21T19:43:03.754195] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-21T19:43:03.755695] [DEBUG] [LOCAL ] LNG: Trimmed 74723 records to 51114 (keeping 200 days of data) [2025-10-21T19:43:03.872864] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-21T19:43:04.087788] [DEBUG] [LOCAL ] LNG: Primary data saved (51114 records). [2025-10-21T19:43:04.087960] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-21T19:43:04.088100] [INFO ] [MAIN ] Update Progress: 1266/2366 symbols completed. LNG took 49.9s. Estimated remaining: 2h 21m 38s. Rate: 7.8 symbols/min [2025-10-21T19:43:04.158443] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-21T19:43:04.310930] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:43:04.347455] [DEBUG] [LOCAL ] LPG: Loaded 39541 existing records from primary storage. [2025-10-21T19:43:04.347824] [INFO ] [MAIN ] LPG: Loaded 39541 existing records. [2025-10-21T19:43:04.521764] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:43:04.521960] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-21T19:43:04.522006] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-21T19:43:04.522182] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-21T19:43:04.522219] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-21T19:43:04.877185] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:43:04.951014] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-21T19:43:05.491595] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T19:43:05.751072] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-21T19:43:06.049888] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (5.10 seconds). [2025-10-21T19:43:06.418061] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T19:43:06.551018] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-21T19:43:07.035010] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T19:43:07.351026] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-21T19:43:08.151017] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-21T19:43:08.437368] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-21T19:43:08.608678] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-21T19:43:08.951027] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-21T19:43:08.976499] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T19:43:09.750990] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-21T19:43:10.232119] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T19:43:10.551088] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-21T19:43:11.266108] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T19:43:11.351030] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-21T19:43:12.151008] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-21T19:43:12.183102] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T19:43:12.713495] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-21T19:43:12.950998] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-21T19:43:13.396853] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-21T19:43:13.751022] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-21T19:43:14.253796] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-21T19:43:14.428786] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T19:43:14.434619] [INFO ] [REMOTE ] LOMA: Full fetch complete (47809 records). [2025-10-21T19:43:14.434748] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-21T19:43:14.556112] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-21T19:43:14.813087] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-21T19:43:14.813169] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-21T19:43:14.813994] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-21T19:43:14.814056] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-21T19:43:14.815017] [DEBUG] [LOCAL ] LOMA: Trimmed 47809 records to 32809 (keeping 200 days of data) [2025-10-21T19:43:14.994299] [DEBUG] [LOCAL ] LOMA: Primary data saved (32809 records). [2025-10-21T19:43:14.994424] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-21T19:43:14.995118] [INFO ] [MAIN ] Update Progress: 1267/2366 symbols completed. LOMA took 23.2s. Estimated remaining: 2h 21m 33s. Rate: 7.8 symbols/min [2025-10-21T19:43:15.162537] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:43:15.191372] [DEBUG] [LOCAL ] LPL: Loaded 28753 existing records from primary storage. [2025-10-21T19:43:15.191706] [INFO ] [MAIN ] LPL: Loaded 28753 existing records. [2025-10-21T19:43:15.295096] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T19:43:15.353189] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-21T19:43:15.375168] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:43:15.375337] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-21T19:43:15.375382] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-21T19:43:15.375545] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-21T19:43:15.375581] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-21T19:43:15.721419] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:43:16.151023] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-21T19:43:16.951029] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-21T19:43:17.295234] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T19:43:17.393037] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-21T19:43:17.398992] [INFO ] [REMOTE ] LOCL: Full fetch complete (4547 records). [2025-10-21T19:43:17.398832] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-21T19:43:17.399310] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-21T19:43:17.761222] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-21T19:43:17.792404] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-21T19:43:17.792492] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-21T19:43:17.792707] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-21T19:43:17.792768] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-21T19:43:17.793122] [DEBUG] [LOCAL ] LOCL: Trimmed 4547 records to 3714 (keeping 200 days of data) [2025-10-21T19:43:17.814314] [DEBUG] [LOCAL ] LOCL: Primary data saved (3714 records). [2025-10-21T19:43:17.814402] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-21T19:43:17.814490] [INFO ] [MAIN ] Update Progress: 1268/2366 symbols completed. LOCL took 30.6s. Estimated remaining: 2h 21m 21s. Rate: 7.8 symbols/min [2025-10-21T19:43:17.983463] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:43:18.023344] [DEBUG] [LOCAL ] LPX: Loaded 40152 existing records from primary storage. [2025-10-21T19:43:18.023682] [INFO ] [MAIN ] LPX: Loaded 40152 existing records. [2025-10-21T19:43:18.230422] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:43:18.230685] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-21T19:43:18.230746] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-21T19:43:18.230950] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-21T19:43:18.231201] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-21T19:43:18.558281] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-21T19:43:18.659185] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:43:19.356256] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-21T19:43:19.382122] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T19:43:20.150999] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-21T19:43:20.511834] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-21T19:43:20.911460] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T19:43:20.950983] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-21T19:43:21.304374] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T19:43:21.751013] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-21T19:43:22.438445] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T19:43:22.551049] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-21T19:43:23.186374] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T19:43:23.351020] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-21T19:43:23.553111] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-21T19:43:24.151072] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-21T19:43:24.776503] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T19:43:24.951030] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-21T19:43:25.761425] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-21T19:43:25.772245] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T19:43:25.797287] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-21T19:43:26.551053] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-21T19:43:27.351051] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-21T19:43:27.395042] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T19:43:27.475678] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-21T19:43:28.151022] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-21T19:43:28.909440] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T19:43:28.951063] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-21T19:43:29.231606] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-21T19:43:29.751088] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-21T19:43:30.551033] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-21T19:43:30.602282] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T19:43:31.351099] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-21T19:43:31.734907] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-21T19:43:32.042995] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-21T19:43:32.150992] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-21T19:43:32.201519] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T19:43:32.951032] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-21T19:43:33.750989] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-21T19:43:34.021050] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T19:43:34.176897] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-21T19:43:34.551031] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-21T19:43:35.137264] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T19:43:35.144681] [INFO ] [REMOTE ] LPG: Full fetch complete (58910 records). [2025-10-21T19:43:35.144911] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-21T19:43:35.351975] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-21T19:43:35.554683] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-21T19:43:35.554883] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-21T19:43:35.555912] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-21T19:43:35.564221] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-21T19:43:35.579512] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T19:43:35.588138] [DEBUG] [LOCAL ] LPG: Trimmed 58910 records to 39396 (keeping 200 days of data) [2025-10-21T19:43:35.588758] [INFO ] [REMOTE ] LOW: Full fetch complete (76719 records). [2025-10-21T19:43:35.589227] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-21T19:43:36.124976] [DEBUG] [LOCAL ] LPG: Primary data saved (39396 records). [2025-10-21T19:43:36.127427] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-21T19:43:36.127540] [INFO ] [MAIN ] Update Progress: 1269/2366 symbols completed. LPG took 32.0s. Estimated remaining: 2h 21m 22s. Rate: 7.8 symbols/min [2025-10-21T19:43:36.156160] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-21T19:43:36.331330] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-21T19:43:36.336887] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-21T19:43:36.343415] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-21T19:43:36.348635] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-21T19:43:36.403069] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:43:36.403924] [DEBUG] [LOCAL ] LOW: Trimmed 76719 records to 52978 (keeping 200 days of data) [2025-10-21T19:43:36.736267] [DEBUG] [LOCAL ] LRN: Loaded 39505 existing records from primary storage. [2025-10-21T19:43:36.739035] [INFO ] [MAIN ] LRN: Loaded 39505 existing records. [2025-10-21T19:43:36.868096] [DEBUG] [LOCAL ] LOW: Primary data saved (52978 records). [2025-10-21T19:43:36.889227] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-21T19:43:36.889406] [INFO ] [MAIN ] Update Progress: 1270/2366 symbols completed. LOW took 41.4s. Estimated remaining: 2h 21m 8s. Rate: 7.8 symbols/min [2025-10-21T19:43:36.979470] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:43:37.013512] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-21T19:43:37.018933] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-21T19:43:37.052061] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-21T19:43:37.052308] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-21T19:43:37.256605] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:43:37.265024] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T19:43:37.357048] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-21T19:43:37.554106] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:43:37.567874] [DEBUG] [LOCAL ] LSPD: Loaded 42440 existing records from primary storage. [2025-10-21T19:43:37.568185] [INFO ] [MAIN ] LSPD: Loaded 42440 existing records. [2025-10-21T19:43:37.746940] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:43:37.747345] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-21T19:43:37.747423] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-21T19:43:37.747735] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-21T19:43:37.747812] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-21T19:43:37.780346] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-21T19:43:37.966753] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-21T19:43:38.172679] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:43:38.551034] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-21T19:43:38.891909] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T19:43:39.028865] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T19:43:39.351027] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-21T19:43:39.986674] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T19:43:40.151083] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-21T19:43:40.895536] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T19:43:40.951023] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-21T19:43:41.746308] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T19:43:41.753952] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-21T19:43:42.556098] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-21T19:43:42.566369] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-21T19:43:42.573572] [INFO ] [REMOTE ] LPL: Full fetch complete (37468 records). [2025-10-21T19:43:42.573748] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-21T19:43:42.957374] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-21T19:43:42.957454] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-21T19:43:42.958322] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-21T19:43:42.958402] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-21T19:43:42.959339] [DEBUG] [LOCAL ] LPL: Trimmed 37468 records to 28918 (keeping 200 days of data) [2025-10-21T19:43:43.118770] [DEBUG] [LOCAL ] LPL: Primary data saved (28918 records). [2025-10-21T19:43:43.118898] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-21T19:43:43.118975] [INFO ] [MAIN ] Update Progress: 1271/2366 symbols completed. LPL took 28.1s. Estimated remaining: 2h 20m 59s. Rate: 7.8 symbols/min [2025-10-21T19:43:43.315437] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:43:43.317574] [DEBUG] [LOCAL ] LTC: No existing data file found in primary storage. [2025-10-21T19:43:43.317426] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T19:43:43.325859] [WARN ] [MAIN ] LTC: No existing data found, performing full refresh instead. [2025-10-21T19:43:43.326374] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-21T19:43:43.326813] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-21T19:43:43.326881] [DEBUG] [LOCAL ] LTC: No primary data file found to delete. [2025-10-21T19:43:43.326915] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-21T19:43:43.357195] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-21T19:43:43.698414] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:43:44.151041] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-21T19:43:44.311925] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T19:43:44.941065] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T19:43:44.950974] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-21T19:43:45.257425] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-21T19:43:45.751066] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-21T19:43:46.551018] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-21T19:43:46.668390] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T19:43:47.351048] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-21T19:43:47.557309] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T19:43:47.877840] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T19:43:48.151079] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-21T19:43:48.606447] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-21T19:43:48.951001] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-21T19:43:49.223333] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T19:43:49.751071] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-21T19:43:50.223420] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-21T19:43:50.551022] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-21T19:43:51.128327] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T19:43:51.351010] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-21T19:43:52.070193] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T19:43:52.151082] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-21T19:43:52.324788] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-21T19:43:52.951052] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-21T19:43:53.476716] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T19:43:53.751041] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-21T19:43:54.528151] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T19:43:54.551002] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-21T19:43:55.261016] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T19:43:55.350984] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-21T19:43:56.081843] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T19:43:56.088480] [INFO ] [REMOTE ] LPX: Full fetch complete (58751 records). [2025-10-21T19:43:56.088594] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-21T19:43:56.156257] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-21T19:43:56.470731] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-21T19:43:56.470854] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-21T19:43:56.471825] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-21T19:43:56.472036] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-21T19:43:56.483028] [DEBUG] [LOCAL ] LPX: Trimmed 58751 records to 40110 (keeping 200 days of data) [2025-10-21T19:43:56.499815] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-21T19:43:56.750453] [DEBUG] [LOCAL ] LPX: Primary data saved (40110 records). [2025-10-21T19:43:56.750578] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-21T19:43:56.751149] [INFO ] [MAIN ] Update Progress: 1272/2366 symbols completed. LPX took 38.9s. Estimated remaining: 2h 20m 57s. Rate: 7.8 symbols/min [2025-10-21T19:43:56.917188] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:43:56.951073] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-21T19:43:56.967844] [DEBUG] [LOCAL ] LTH: Loaded 51686 existing records from primary storage. [2025-10-21T19:43:56.968175] [INFO ] [MAIN ] LTH: Loaded 51686 existing records. [2025-10-21T19:43:57.143057] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:43:57.143271] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-21T19:43:57.143327] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-21T19:43:57.143539] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-21T19:43:57.143595] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-21T19:43:57.494955] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:43:57.513267] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-21T19:43:57.751024] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-21T19:43:58.032691] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-21T19:43:58.551016] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-21T19:43:59.356696] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-21T19:43:59.375942] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T19:44:00.151003] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-21T19:44:00.198155] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T19:44:00.204961] [INFO ] [REMOTE ] LSPD: Full fetch complete (62234 records). [2025-10-21T19:44:00.205063] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-21T19:44:00.587901] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-21T19:44:00.587975] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-21T19:44:00.588862] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-21T19:44:00.588925] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-21T19:44:00.590114] [DEBUG] [LOCAL ] LSPD: Trimmed 62234 records to 42387 (keeping 200 days of data) [2025-10-21T19:44:00.828285] [DEBUG] [LOCAL ] LSPD: Primary data saved (42387 records). [2025-10-21T19:44:00.828398] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-21T19:44:00.828473] [INFO ] [MAIN ] Update Progress: 1273/2366 symbols completed. LSPD took 23.9s. Estimated remaining: 2h 20m 46s. Rate: 7.8 symbols/min [2025-10-21T19:44:00.968170] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-21T19:44:01.003700] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:44:01.040185] [DEBUG] [LOCAL ] LTM: Loaded 39040 existing records from primary storage. [2025-10-21T19:44:01.040444] [INFO ] [MAIN ] LTM: Loaded 39040 existing records. [2025-10-21T19:44:01.218130] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:44:01.218376] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-21T19:44:01.218444] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-21T19:44:01.218967] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-21T19:44:01.219024] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-21T19:44:01.437862] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-21T19:44:01.620835] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:44:01.750987] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-21T19:44:01.852748] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T19:44:02.551014] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-21T19:44:02.865854] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-21T19:44:02.891731] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T19:44:03.351100] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-21T19:44:03.755426] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-21T19:44:04.151024] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-21T19:44:04.951002] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-21T19:44:05.066087] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T19:44:05.260486] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T19:44:05.751059] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-21T19:44:06.357877] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T19:44:06.551052] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-21T19:44:07.341685] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T19:44:07.350972] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-21T19:44:07.949892] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T19:44:08.151078] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-21T19:44:08.945544] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-21T19:44:08.953734] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-21T19:44:09.507635] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T19:44:09.751035] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-21T19:44:10.551024] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-21T19:44:10.771032] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T19:44:11.234553] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T19:44:11.240731] [INFO ] [REMOTE ] LRN: Full fetch complete (58340 records). [2025-10-21T19:44:11.240854] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-21T19:44:11.355868] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-21T19:44:11.692033] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-21T19:44:11.692228] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-21T19:44:11.693525] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-21T19:44:11.693629] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-21T19:44:11.724262] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T19:44:11.732211] [DEBUG] [LOCAL ] LRN: Trimmed 58340 records to 39446 (keeping 200 days of data) [2025-10-21T19:44:11.733377] [INFO ] [REMOTE ] LTC: Full fetch complete (43824 records). [2025-10-21T19:44:11.733504] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-21T19:44:12.157802] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-21T19:44:12.545562] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-21T19:44:12.552740] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-21T19:44:12.568562] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-21T19:44:12.575365] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-21T19:44:12.590883] [DEBUG] [LOCAL ] LTC: Trimmed 43824 records to 30677 (keeping 200 days of data) [2025-10-21T19:44:12.599890] [DEBUG] [LOCAL ] LRN: Primary data saved (39446 records). [2025-10-21T19:44:12.600496] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-21T19:44:12.600936] [INFO ] [MAIN ] Update Progress: 1274/2366 symbols completed. LRN took 36.5s. Estimated remaining: 2h 20m 42s. Rate: 7.8 symbols/min [2025-10-21T19:44:12.910385] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:44:13.002348] [DEBUG] [LOCAL ] LTC: Primary data saved (30677 records). [2025-10-21T19:44:13.002553] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-21T19:44:13.002683] [INFO ] [MAIN ] Update Progress: 1275/2366 symbols completed. LTC took 29.9s. Estimated remaining: 2h 20m 28s. Rate: 7.8 symbols/min [2025-10-21T19:44:13.173332] [DEBUG] [LOCAL ] LU: Loaded 49163 existing records from primary storage. [2025-10-21T19:44:13.225709] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:44:13.222333] [INFO ] [MAIN ] LU: Loaded 49163 existing records. [2025-10-21T19:44:13.459676] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-21T19:44:13.457477] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:44:13.467289] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-21T19:44:13.479690] [DEBUG] [LOCAL ] LUCK: Loaded 24157 existing records from primary storage. [2025-10-21T19:44:13.480362] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-21T19:44:13.480080] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-21T19:44:13.480563] [INFO ] [MAIN ] LUCK: Loaded 24157 existing records. [2025-10-21T19:44:13.485977] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-21T19:44:13.486829] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-21T19:44:13.678518] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T19:44:13.754520] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-21T19:44:13.840195] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:44:13.877589] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-21T19:44:13.879850] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-21T19:44:13.896488] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-21T19:44:13.904733] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-21T19:44:14.278440] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:44:14.456973] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:44:14.550976] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-21T19:44:15.092194] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T19:44:15.143268] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T19:44:15.351008] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-21T19:44:16.156212] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-21T19:44:16.178209] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T19:44:16.811195] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-21T19:44:16.951034] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-21T19:44:17.751023] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-21T19:44:17.830225] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T19:44:18.441554] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T19:44:18.551076] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-21T19:44:19.351016] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-21T19:44:19.520764] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T19:44:19.883010] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-21T19:44:20.151025] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-21T19:44:20.951037] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-21T19:44:21.004093] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T19:44:21.446821] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T19:44:21.751117] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-21T19:44:22.551072] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-21T19:44:22.824213] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T19:44:23.234033] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T19:44:23.351001] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-21T19:44:23.717677] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-21T19:44:24.151032] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-21T19:44:24.950994] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-21T19:44:25.040304] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T19:44:25.490555] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-21T19:44:25.751041] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-21T19:44:26.551004] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-21T19:44:26.724744] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T19:44:27.145060] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T19:44:27.153251] [INFO ] [REMOTE ] LTM: Full fetch complete (51124 records). [2025-10-21T19:44:27.153351] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-21T19:44:27.360627] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-21T19:44:27.535666] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-21T19:44:27.535749] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-21T19:44:27.536583] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-21T19:44:27.536621] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-21T19:44:27.538559] [DEBUG] [LOCAL ] LTM: Trimmed 51124 records to 39164 (keeping 200 days of data) [2025-10-21T19:44:27.780249] [DEBUG] [LOCAL ] LTM: Primary data saved (39164 records). [2025-10-21T19:44:27.781071] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-21T19:44:27.781756] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T19:44:27.781904] [INFO ] [MAIN ] Update Progress: 1276/2366 symbols completed. LTM took 27.0s. Estimated remaining: 2h 20m 26s. Rate: 7.8 symbols/min [2025-10-21T19:44:27.955088] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:44:28.006567] [DEBUG] [LOCAL ] LUMN: Loaded 53645 existing records from primary storage. [2025-10-21T19:44:28.006923] [INFO ] [MAIN ] LUMN: Loaded 53645 existing records. [2025-10-21T19:44:28.156669] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-21T19:44:28.187983] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:44:28.188178] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-21T19:44:28.188232] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-21T19:44:28.188573] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-21T19:44:28.188631] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-21T19:44:28.553988] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:44:28.951072] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-21T19:44:29.049909] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T19:44:29.563010] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T19:44:29.751019] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-21T19:44:30.133365] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T19:44:30.551086] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-21T19:44:31.351040] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-21T19:44:31.503278] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T19:44:32.151082] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-21T19:44:32.336464] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T19:44:32.951051] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-21T19:44:33.117397] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-21T19:44:33.236902] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-21T19:44:33.751055] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-21T19:44:34.418827] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T19:44:34.551058] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-21T19:44:34.824094] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T19:44:35.351048] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-21T19:44:36.151026] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-21T19:44:36.416431] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T19:44:36.424454] [INFO ] [REMOTE ] LTH: Full fetch complete (74760 records). [2025-10-21T19:44:36.424568] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-21T19:44:36.813450] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-21T19:44:36.813544] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-21T19:44:36.814618] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-21T19:44:36.814755] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-21T19:44:36.816257] [DEBUG] [LOCAL ] LTH: Trimmed 74760 records to 51653 (keeping 200 days of data) [2025-10-21T19:44:36.995789] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-21T19:44:37.053285] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T19:44:37.153963] [DEBUG] [LOCAL ] LTH: Primary data saved (51653 records). [2025-10-21T19:44:37.154089] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-21T19:44:37.154471] [INFO ] [MAIN ] Update Progress: 1277/2366 symbols completed. LTH took 40.4s. Estimated remaining: 2h 20m 20s. Rate: 7.8 symbols/min [2025-10-21T19:44:37.276827] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T19:44:37.280369] [INFO ] [REMOTE ] LUCK: Full fetch complete (39414 records). [2025-10-21T19:44:37.280483] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-21T19:44:37.654884] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-21T19:44:37.654956] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-21T19:44:37.655721] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-21T19:44:37.655780] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-21T19:44:37.656573] [DEBUG] [LOCAL ] LUCK: Trimmed 39414 records to 23955 (keeping 200 days of data) [2025-10-21T19:44:37.752015] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-21T19:44:37.796526] [DEBUG] [LOCAL ] LUCK: Primary data saved (23955 records). [2025-10-21T19:44:37.796637] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-21T19:44:37.796754] [INFO ] [MAIN ] Update Progress: 1278/2366 symbols completed. LUCK took 24.8s. Estimated remaining: 2h 20m 6s. Rate: 7.8 symbols/min [2025-10-21T19:44:38.611246] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T19:44:38.622040] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-21T19:44:39.757013] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-21T19:44:39.769553] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-21T19:44:40.245723] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-21T19:44:40.255900] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-21T19:44:41.634522] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T19:44:41.645857] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-21T19:44:41.964226] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-21T19:44:41.975083] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-21T19:44:43.619505] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-21T19:44:43.630794] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-21T19:44:43.690890] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T19:44:43.699272] [INFO ] [REMOTE ] LU: Full fetch complete (70940 records). [2025-10-21T19:44:43.699433] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-21T19:44:44.111281] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-21T19:44:44.111363] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-21T19:44:44.112747] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-21T19:44:44.112819] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-21T19:44:44.114114] [DEBUG] [LOCAL ] LU: Trimmed 70940 records to 49218 (keeping 200 days of data) [2025-10-21T19:44:44.377177] [DEBUG] [LOCAL ] LU: Primary data saved (49218 records). [2025-10-21T19:44:44.377298] [INFO ] [MAIN ] LU: Full history saved. [2025-10-21T19:44:44.377375] [INFO ] [MAIN ] Update Progress: 1279/2366 symbols completed. LU took 31.8s. Estimated remaining: 2h 19m 57s. Rate: 7.8 symbols/min [2025-10-21T19:44:45.541212] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T19:44:45.553058] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-21T19:44:47.486689] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T19:44:47.498607] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-21T19:44:49.363529] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T19:44:49.375221] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-21T19:44:51.590803] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-21T19:44:51.602213] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-21T19:44:53.735683] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-21T19:44:53.747451] [INFO ] [REMOTE ] LUMN: Full fetch complete (77778 records). [2025-10-21T19:44:53.747596] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-21T19:44:54.133598] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-21T19:44:54.133693] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-21T19:44:54.134713] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-21T19:44:54.134774] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-21T19:44:54.136171] [DEBUG] [LOCAL ] LUMN: Trimmed 77778 records to 53645 (keeping 200 days of data) [2025-10-21T19:44:54.426595] [DEBUG] [LOCAL ] LUMN: Primary data saved (53645 records). [2025-10-21T19:44:54.426744] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-21T19:44:54.427544] [INFO ] [MAIN ] Update Progress: 1280/2366 symbols completed. LUMN took 26.6s. Estimated remaining: 2h 19m 51s. Rate: 7.8 symbols/min [2025-10-21T19:44:55.080191] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:44:55.090045] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:44:55.117432] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:44:55.139703] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:44:55.140197] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-21T19:44:55.140422] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-21T19:44:55.140563] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-21T19:44:55.140627] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-21T19:44:55.140725] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-21T19:44:55.140771] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-21T19:44:55.266026] [DEBUG] [LOCAL ] LVWR: Loaded 18569 existing records from primary storage. [2025-10-21T19:44:55.277718] [INFO ] [MAIN ] LVWR: Loaded 18569 existing records. [2025-10-21T19:44:55.636939] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-21T19:44:55.692447] [DEBUG] [LOCAL ] LVS: Loaded 53570 existing records from primary storage. [2025-10-21T19:44:55.748877] [INFO ] [MAIN ] LVS: Loaded 53570 existing records. [2025-10-21T19:44:55.734683] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-10-21T19:44:55.743483] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:44:55.804998] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-21T19:44:55.826752] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-21T19:44:55.901004] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-21T19:44:55.906940] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:44:55.967553] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-10-21T19:44:55.935941] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-21T19:44:56.222073] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:44:56.272211] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T19:44:56.271659] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-21T19:44:56.272358] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-21T19:44:56.294500] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:44:56.294841] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-10-21T19:44:56.305361] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-21T19:44:56.352703] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-21T19:44:56.336326] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:44:56.355287] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-21T19:44:56.362210] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-21T19:44:56.369023] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-21T19:44:56.388763] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-21T19:44:56.434038] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:44:56.474391] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-21T19:44:56.488015] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-21T19:44:56.503562] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-21T19:44:56.579054] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-21T19:44:56.711895] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-21T19:44:56.738565] [INFO ] [MAIN ] Update Progress: 1281/2366 symbols completed. LUXE took 2.3s. Estimated remaining: 2h 19m 39s. Rate: 7.8 symbols/min [2025-10-21T19:44:56.798969] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:44:56.824693] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-21T19:44:57.323779] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:44:57.380014] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:44:57.371049] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-21T19:44:57.481324] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:44:57.486278] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-21T19:44:57.486431] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-21T19:44:57.489315] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-21T19:44:57.526508] [DEBUG] [LOCAL ] LW: Loaded 51191 existing records from primary storage. [2025-10-21T19:44:57.526851] [INFO ] [MAIN ] LW: Loaded 51191 existing records. [2025-10-21T19:44:57.698947] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:44:57.699152] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-21T19:44:57.699202] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-21T19:44:57.699394] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-21T19:44:57.699430] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-21T19:44:58.050192] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:44:58.050582] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-21T19:44:58.094135] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-21T19:44:58.095768] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-21T19:44:58.591137] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-21T19:44:58.592924] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-21T19:44:59.177611] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-21T19:44:59.179857] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-21T19:44:59.215757] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T19:44:59.226864] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-21T19:44:59.516377] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T19:44:59.527207] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-21T19:44:59.621042] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-21T19:44:59.631770] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-21T19:44:59.914795] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T19:44:59.919142] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-21T19:45:01.769085] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-10-21T19:45:01.781222] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-21T19:45:01.870781] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-21T19:45:01.881435] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-21T19:45:01.923044] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-21T19:45:01.932222] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-21T19:45:02.101597] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-21T19:45:02.111953] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-21T19:45:04.279509] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-21T19:45:04.309163] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-21T19:45:04.307593] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-21T19:45:04.321808] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-21T19:45:04.674789] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-10-21T19:45:04.686838] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-21T19:45:04.906285] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-10-21T19:45:04.911426] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-21T19:45:05.802493] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-21T19:45:05.807334] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-21T19:45:06.292034] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T19:45:06.305906] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-21T19:45:06.356890] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-21T19:45:06.371695] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-21T19:45:06.426402] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-21T19:45:06.443911] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-21T19:45:06.881238] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T19:45:06.885575] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-21T19:45:07.866913] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T19:45:07.873756] [INFO ] [REMOTE ] LVWR: Full fetch complete (20711 records). [2025-10-21T19:45:07.873978] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-21T19:45:08.280720] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-21T19:45:08.296505] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-21T19:45:08.306117] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-21T19:45:08.309388] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-21T19:45:08.312995] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T19:45:08.311583] [DEBUG] [LOCAL ] LVWR: Trimmed 20711 records to 18596 (keeping 200 days of data) [2025-10-21T19:45:08.325745] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-21T19:45:08.443069] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-21T19:45:08.470274] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-21T19:45:08.480051] [DEBUG] [LOCAL ] LVWR: Primary data saved (18596 records). [2025-10-21T19:45:08.481311] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-21T19:45:08.481414] [INFO ] [MAIN ] Update Progress: 1282/2366 symbols completed. LVWR took 14.0s. Estimated remaining: 2h 19m 35s. Rate: 7.8 symbols/min [2025-10-21T19:45:08.620759] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-21T19:45:08.701562] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:45:08.719228] [DEBUG] [LOCAL ] LXFR: Loaded 16472 existing records from primary storage. [2025-10-21T19:45:08.719468] [INFO ] [MAIN ] LXFR: Loaded 16472 existing records. [2025-10-21T19:45:08.897669] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:45:08.897928] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-21T19:45:08.898005] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-21T19:45:08.898190] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-21T19:45:08.898230] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-21T19:45:08.963224] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-21T19:45:09.266989] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:45:09.751084] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-21T19:45:10.133801] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T19:45:10.352846] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T19:45:10.442416] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-21T19:45:10.550990] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-21T19:45:10.741099] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T19:45:11.351030] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-21T19:45:11.628813] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-21T19:45:12.151042] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-21T19:45:12.951026] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-21T19:45:13.327679] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-21T19:45:13.354568] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T19:45:13.751035] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-21T19:45:14.565110] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-21T19:45:14.568741] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T19:45:14.798140] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-21T19:45:15.351072] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-21T19:45:16.151042] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-21T19:45:16.951025] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-21T19:45:17.193615] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-21T19:45:17.215864] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-21T19:45:17.751086] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-21T19:45:18.551031] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-21T19:45:18.696699] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T19:45:18.980221] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (4.42 seconds). [2025-10-21T19:45:19.351050] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-21T19:45:19.511835] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T19:45:20.151068] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-21T19:45:20.919964] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T19:45:20.950978] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-21T19:45:21.198979] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T19:45:21.530502] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (2.98 seconds). [2025-10-21T19:45:21.751079] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-21T19:45:22.550999] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-21T19:45:22.623096] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T19:45:22.631288] [INFO ] [REMOTE ] LW: Full fetch complete (74771 records). [2025-10-21T19:45:22.631404] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-21T19:45:23.018269] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-21T19:45:23.018350] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-21T19:45:23.019400] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-21T19:45:23.019464] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-21T19:45:23.020806] [DEBUG] [LOCAL ] LW: Trimmed 74771 records to 51180 (keeping 200 days of data) [2025-10-21T19:45:23.334279] [DEBUG] [LOCAL ] LW: Primary data saved (51180 records). [2025-10-21T19:45:23.334527] [INFO ] [MAIN ] LW: Full history saved. [2025-10-21T19:45:23.335247] [INFO ] [MAIN ] Update Progress: 1283/2366 symbols completed. LW took 26.5s. Estimated remaining: 2h 19m 33s. Rate: 7.8 symbols/min [2025-10-21T19:45:23.356685] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-21T19:45:23.511375] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:45:23.535228] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T19:45:23.544431] [INFO ] [REMOTE ] LVS: Full fetch complete (77722 records). [2025-10-21T19:45:23.544565] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-21T19:45:23.887700] [DEBUG] [LOCAL ] LXP: Loaded 50793 existing records from primary storage. [2025-10-21T19:45:23.909424] [INFO ] [MAIN ] LXP: Loaded 50793 existing records. [2025-10-21T19:45:24.055060] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-21T19:45:24.082437] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-21T19:45:24.099550] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-21T19:45:24.120914] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-21T19:45:24.176661] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-21T19:45:24.217637] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:45:24.218846] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-21T19:45:24.219218] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-21T19:45:24.219493] [DEBUG] [LOCAL ] LVS: Trimmed 77722 records to 53570 (keeping 200 days of data) [2025-10-21T19:45:24.219869] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-21T19:45:24.219950] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-21T19:45:24.220798] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-21T19:45:24.589322] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T19:45:24.849011] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:45:24.952431] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-21T19:45:24.955766] [DEBUG] [LOCAL ] LVS: Primary data saved (53570 records). [2025-10-21T19:45:24.955841] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-21T19:45:24.956684] [INFO ] [MAIN ] Update Progress: 1284/2366 symbols completed. LVS took 30.5s. Estimated remaining: 2h 19m 20s. Rate: 7.8 symbols/min [2025-10-21T19:45:25.127721] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:45:25.159463] [DEBUG] [LOCAL ] LXU: Loaded 31669 existing records from primary storage. [2025-10-21T19:45:25.159745] [INFO ] [MAIN ] LXU: Loaded 31669 existing records. [2025-10-21T19:45:25.342558] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:45:25.342787] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-21T19:45:25.342839] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-21T19:45:25.343025] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-21T19:45:25.343079] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-21T19:45:25.729278] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:45:25.751012] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-21T19:45:26.090748] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T19:45:26.254177] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T19:45:26.551085] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-21T19:45:26.617360] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-21T19:45:27.351103] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-21T19:45:28.131542] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T19:45:28.150975] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-21T19:45:28.190423] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-21T19:45:28.951034] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-21T19:45:29.751018] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-21T19:45:29.860256] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T19:45:29.892119] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T19:45:29.900470] [INFO ] [REMOTE ] LUV: Full fetch complete (77865 records). [2025-10-21T19:45:29.900600] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-21T19:45:30.310738] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-21T19:45:30.310841] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-21T19:45:30.312024] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-21T19:45:30.312087] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-21T19:45:30.313559] [DEBUG] [LOCAL ] LUV: Trimmed 77865 records to 53689 (keeping 200 days of data) [2025-10-21T19:45:30.555633] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-21T19:45:30.642701] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-10-21T19:45:30.642838] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-21T19:45:30.643386] [INFO ] [MAIN ] Update Progress: 1285/2366 symbols completed. LUV took 36.2s. Estimated remaining: 2h 19m 11s. Rate: 7.8 symbols/min [2025-10-21T19:45:30.816913] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:45:30.871480] [DEBUG] [LOCAL ] LYB: Loaded 53621 existing records from primary storage. [2025-10-21T19:45:30.871928] [INFO ] [MAIN ] LYB: Loaded 53621 existing records. [2025-10-21T19:45:31.051982] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:45:31.052336] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-21T19:45:31.052450] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-21T19:45:31.052714] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-21T19:45:31.069160] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-21T19:45:31.132835] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T19:45:31.352204] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-21T19:45:31.430630] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:45:31.538502] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-21T19:45:32.151061] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-21T19:45:32.872553] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T19:45:32.951050] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-21T19:45:33.127732] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T19:45:33.130423] [INFO ] [REMOTE ] LXFR: Full fetch complete (24692 records). [2025-10-21T19:45:33.130524] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-21T19:45:33.494329] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-21T19:45:33.494431] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-21T19:45:33.494963] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-21T19:45:33.495023] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-21T19:45:33.495730] [DEBUG] [LOCAL ] LXFR: Trimmed 24692 records to 16437 (keeping 200 days of data) [2025-10-21T19:45:33.593109] [DEBUG] [LOCAL ] LXFR: Primary data saved (16437 records). [2025-10-21T19:45:33.593254] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-21T19:45:33.593332] [INFO ] [MAIN ] Update Progress: 1286/2366 symbols completed. LXFR took 25.1s. Estimated remaining: 2h 18m 59s. Rate: 7.8 symbols/min [2025-10-21T19:45:33.756837] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-21T19:45:33.759260] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:45:33.809674] [DEBUG] [LOCAL ] LYG: Loaded 52666 existing records from primary storage. [2025-10-21T19:45:33.809962] [INFO ] [MAIN ] LYG: Loaded 52666 existing records. [2025-10-21T19:45:33.987543] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:45:33.987787] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-21T19:45:33.987847] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-21T19:45:33.988088] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-21T19:45:33.988156] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-21T19:45:34.362419] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:45:34.363998] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T19:45:34.551070] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-21T19:45:35.350996] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-21T19:45:35.455620] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T19:45:36.151096] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-21T19:45:36.298364] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-21T19:45:36.951025] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-21T19:45:37.136310] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T19:45:37.543246] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T19:45:37.751061] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-21T19:45:38.551036] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-21T19:45:38.638519] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T19:45:39.137313] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T19:45:39.351044] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-21T19:45:40.047312] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-21T19:45:40.151075] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-21T19:45:40.951087] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-21T19:45:41.044195] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T19:45:41.750989] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-21T19:45:41.995375] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T19:45:42.261284] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-21T19:45:42.551020] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-21T19:45:43.351110] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-21T19:45:43.651464] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T19:45:43.963571] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-21T19:45:44.151008] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-21T19:45:44.694932] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T19:45:44.951112] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-21T19:45:45.750996] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-21T19:45:45.991467] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T19:45:46.551006] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-21T19:45:47.034119] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-21T19:45:47.060061] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-21T19:45:47.351048] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-21T19:45:48.151004] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-21T19:45:48.383588] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T19:45:48.951047] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-21T19:45:49.092397] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T19:45:49.751002] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-21T19:45:49.843897] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T19:45:50.302208] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T19:45:50.307005] [INFO ] [REMOTE ] LXU: Full fetch complete (45258 records). [2025-10-21T19:45:50.307098] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-21T19:45:50.556096] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-21T19:45:50.682532] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-21T19:45:50.682608] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-21T19:45:50.683424] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-21T19:45:50.683485] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-21T19:45:50.684424] [DEBUG] [LOCAL ] LXU: Trimmed 45258 records to 31582 (keeping 200 days of data) [2025-10-21T19:45:50.870786] [DEBUG] [LOCAL ] LXU: Primary data saved (31582 records). [2025-10-21T19:45:50.870913] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-21T19:45:50.870989] [INFO ] [MAIN ] Update Progress: 1287/2366 symbols completed. LXU took 25.9s. Estimated remaining: 2h 18m 59s. Rate: 7.8 symbols/min [2025-10-21T19:45:51.044112] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:45:51.094607] [DEBUG] [LOCAL ] LYV: Loaded 51086 existing records from primary storage. [2025-10-21T19:45:51.095065] [INFO ] [MAIN ] LYV: Loaded 51086 existing records. [2025-10-21T19:45:51.275785] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:45:51.276011] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-21T19:45:51.276059] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-21T19:45:51.276227] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-21T19:45:51.276264] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-21T19:45:51.354584] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-21T19:45:51.668777] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-21T19:45:51.673041] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:45:52.151051] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-21T19:45:52.472670] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-21T19:45:52.668597] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T19:45:52.951002] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-21T19:45:53.751025] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-21T19:45:54.440168] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-21T19:45:54.550992] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-21T19:45:54.686108] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T19:45:54.694002] [INFO ] [REMOTE ] LXP: Full fetch complete (72867 records). [2025-10-21T19:45:54.694134] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-21T19:45:55.085590] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-21T19:45:55.085722] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-21T19:45:55.086768] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-21T19:45:55.086842] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-21T19:45:55.088434] [DEBUG] [LOCAL ] LXP: Trimmed 72867 records to 50786 (keeping 200 days of data) [2025-10-21T19:45:55.354403] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-21T19:45:55.386535] [DEBUG] [LOCAL ] LXP: Primary data saved (50786 records). [2025-10-21T19:45:55.387052] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-21T19:45:55.387610] [INFO ] [MAIN ] Update Progress: 1288/2366 symbols completed. LXP took 32.1s. Estimated remaining: 2h 18m 49s. Rate: 7.8 symbols/min [2025-10-21T19:45:55.560992] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:45:55.595215] [DEBUG] [LOCAL ] LZB: Loaded 35168 existing records from primary storage. [2025-10-21T19:45:55.595497] [INFO ] [MAIN ] LZB: Loaded 35168 existing records. [2025-10-21T19:45:55.774674] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:45:55.775023] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-21T19:45:55.775090] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-21T19:45:55.775472] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-21T19:45:55.775531] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-21T19:45:55.961438] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-21T19:45:56.152824] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-21T19:45:56.182214] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:45:56.261607] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-21T19:45:56.808333] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T19:45:56.951027] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-21T19:45:57.751035] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-21T19:45:58.288722] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-21T19:45:58.551095] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-21T19:45:58.861496] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T19:45:59.137683] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T19:45:59.351104] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-21T19:46:00.151082] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-21T19:46:00.545686] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-21T19:46:00.951041] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-21T19:46:01.685240] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-21T19:46:01.751044] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-21T19:46:01.750896] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T19:46:02.551012] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-21T19:46:02.819556] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T19:46:03.351067] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-21T19:46:03.954374] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-21T19:46:04.151003] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-21T19:46:04.788585] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-21T19:46:04.951121] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-21T19:46:05.143035] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T19:46:05.751018] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-21T19:46:05.863915] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-21T19:46:05.874250] [INFO ] [REMOTE ] LYB: Full fetch complete (77635 records). [2025-10-21T19:46:05.874495] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-21T19:46:06.246906] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-21T19:46:06.281669] [INFO ] [REMOTE ] LYG: Full fetch complete (76234 records). [2025-10-21T19:46:06.312350] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-21T19:46:06.440122] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-21T19:46:06.453257] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-21T19:46:06.455126] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-21T19:46:06.455219] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-21T19:46:06.511540] [DEBUG] [LOCAL ] LYB: Trimmed 77635 records to 53621 (keeping 200 days of data) [2025-10-21T19:46:06.561285] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-21T19:46:07.169187] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-21T19:46:07.173815] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-21T19:46:07.191049] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-21T19:46:07.200143] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-21T19:46:07.199917] [DEBUG] [LOCAL ] LYB: Primary data saved (53621 records). [2025-10-21T19:46:07.200876] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-21T19:46:07.201500] [INFO ] [MAIN ] Update Progress: 1289/2366 symbols completed. LYB took 36.6s. Estimated remaining: 2h 18m 45s. Rate: 7.8 symbols/min [2025-10-21T19:46:07.285995] [DEBUG] [LOCAL ] LYG: Trimmed 76234 records to 52661 (keeping 200 days of data) [2025-10-21T19:46:07.469226] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:46:07.513864] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T19:46:07.535974] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-21T19:46:07.557278] [DEBUG] [LOCAL ] LZM: Loaded 14708 existing records from primary storage. [2025-10-21T19:46:07.557803] [INFO ] [MAIN ] LZM: Loaded 14708 existing records. [2025-10-21T19:46:07.887085] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:46:07.899367] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-21T19:46:07.899559] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-21T19:46:07.899992] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-21T19:46:07.938101] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-21T19:46:07.993484] [DEBUG] [LOCAL ] LYG: Primary data saved (52661 records). [2025-10-21T19:46:08.028694] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-21T19:46:08.042857] [INFO ] [MAIN ] Update Progress: 1290/2366 symbols completed. LYG took 34.4s. Estimated remaining: 2h 18m 31s. Rate: 7.8 symbols/min [2025-10-21T19:46:08.429279] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:46:08.569289] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:46:08.569871] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-21T19:46:08.610817] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-21T19:46:08.662908] [DEBUG] [LOCAL ] M: Loaded 53544 existing records from primary storage. [2025-10-21T19:46:08.663236] [INFO ] [MAIN ] M: Loaded 53544 existing records. [2025-10-21T19:46:08.844192] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:46:08.844512] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-21T19:46:08.844602] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-21T19:46:08.844834] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-21T19:46:08.844890] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-21T19:46:08.952419] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-21T19:46:09.165626] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T19:46:09.252719] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:46:09.363619] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-21T19:46:09.751024] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-21T19:46:10.551039] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-21T19:46:10.723346] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-21T19:46:11.200179] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T19:46:11.351038] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-21T19:46:12.075980] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-21T19:46:12.150980] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-21T19:46:12.330201] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T19:46:12.951033] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-21T19:46:13.597177] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T19:46:13.751002] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-21T19:46:14.246401] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-21T19:46:14.551053] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-21T19:46:15.351001] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-21T19:46:15.445422] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T19:46:16.007985] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T19:46:16.151041] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-21T19:46:16.951050] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-21T19:46:17.089832] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T19:46:17.604316] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T19:46:17.751063] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-21T19:46:18.551058] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-21T19:46:18.723882] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-21T19:46:18.964759] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T19:46:19.351085] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-21T19:46:19.660977] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T19:46:19.668718] [INFO ] [REMOTE ] LZB: Full fetch complete (50971 records). [2025-10-21T19:46:19.668882] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-21T19:46:20.056042] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-21T19:46:20.056154] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-21T19:46:20.057053] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-21T19:46:20.057133] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-21T19:46:20.058282] [DEBUG] [LOCAL ] LZB: Trimmed 50971 records to 35070 (keeping 200 days of data) [2025-10-21T19:46:20.152353] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-21T19:46:20.172815] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-21T19:46:20.292274] [DEBUG] [LOCAL ] LZB: Primary data saved (35070 records). [2025-10-21T19:46:20.292413] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-21T19:46:20.292921] [INFO ] [MAIN ] Update Progress: 1291/2366 symbols completed. LZB took 24.9s. Estimated remaining: 2h 18m 27s. Rate: 7.8 symbols/min [2025-10-21T19:46:20.461020] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:46:20.511999] [DEBUG] [LOCAL ] MA: Loaded 52467 existing records from primary storage. [2025-10-21T19:46:20.512318] [INFO ] [MAIN ] MA: Loaded 52467 existing records. [2025-10-21T19:46:20.698347] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:46:20.699342] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-21T19:46:20.699400] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-21T19:46:20.700335] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-21T19:46:20.700391] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-21T19:46:20.953265] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-21T19:46:21.067423] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:46:21.088777] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T19:46:21.096950] [INFO ] [REMOTE ] LYV: Full fetch complete (74119 records). [2025-10-21T19:46:21.097093] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-21T19:46:21.481487] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-21T19:46:21.481561] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-21T19:46:21.482604] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-21T19:46:21.482696] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-21T19:46:21.484114] [DEBUG] [LOCAL ] LYV: Trimmed 74119 records to 51013 (keeping 200 days of data) [2025-10-21T19:46:21.752139] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-21T19:46:21.792840] [DEBUG] [LOCAL ] LYV: Primary data saved (51013 records). [2025-10-21T19:46:21.792955] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-21T19:46:21.793030] [INFO ] [MAIN ] Update Progress: 1292/2366 symbols completed. LYV took 30.9s. Estimated remaining: 2h 18m 14s. Rate: 7.8 symbols/min [2025-10-21T19:46:21.963815] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:46:22.006492] [DEBUG] [LOCAL ] MAA: Loaded 42908 existing records from primary storage. [2025-10-21T19:46:22.006804] [INFO ] [MAIN ] MAA: Loaded 42908 existing records. [2025-10-21T19:46:22.183136] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:46:22.183334] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-21T19:46:22.183380] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-21T19:46:22.183581] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-21T19:46:22.183636] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-21T19:46:22.541757] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:46:22.550976] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-21T19:46:22.584588] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T19:46:22.929358] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T19:46:23.351058] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-21T19:46:24.151002] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-21T19:46:24.194257] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T19:46:24.923897] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-21T19:46:24.950976] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-21T19:46:25.248794] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-21T19:46:25.746702] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-21T19:46:25.750972] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-21T19:46:26.555166] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-21T19:46:26.556121] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-21T19:46:27.351022] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-21T19:46:27.856210] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T19:46:28.151088] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-21T19:46:28.865420] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-21T19:46:28.951015] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-21T19:46:29.751062] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-21T19:46:30.087082] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-21T19:46:30.551052] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-21T19:46:30.714160] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-21T19:46:30.856423] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T19:46:31.351059] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-21T19:46:32.150993] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-21T19:46:32.483968] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T19:46:32.485198] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T19:46:32.500625] [INFO ] [REMOTE ] LZM: Full fetch complete (19809 records). [2025-10-21T19:46:32.501141] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-21T19:46:32.863982] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-21T19:46:32.864073] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-21T19:46:32.864495] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-21T19:46:32.864544] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-21T19:46:32.865122] [DEBUG] [LOCAL ] LZM: Trimmed 19809 records to 14736 (keeping 200 days of data) [2025-10-21T19:46:32.944165] [DEBUG] [LOCAL ] LZM: Primary data saved (14736 records). [2025-10-21T19:46:32.944293] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-21T19:46:32.944367] [INFO ] [MAIN ] Update Progress: 1293/2366 symbols completed. LZM took 25.7s. Estimated remaining: 2h 18m 9s. Rate: 7.8 symbols/min [2025-10-21T19:46:32.956231] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-21T19:46:33.114732] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:46:33.160764] [DEBUG] [LOCAL ] MAC: Loaded 49690 existing records from primary storage. [2025-10-21T19:46:33.161054] [INFO ] [MAIN ] MAC: Loaded 49690 existing records. [2025-10-21T19:46:33.335555] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:46:33.335817] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-21T19:46:33.335881] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-21T19:46:33.336111] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-21T19:46:33.336194] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-21T19:46:33.690633] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:46:33.750988] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-21T19:46:34.179435] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-21T19:46:34.550994] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-21T19:46:34.652377] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T19:46:35.082307] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T19:46:35.351025] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-21T19:46:36.150987] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-21T19:46:36.407912] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T19:46:36.925086] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T19:46:36.950977] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-21T19:46:37.751014] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-21T19:46:38.274386] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-21T19:46:38.551059] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-21T19:46:38.672545] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T19:46:39.351030] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-21T19:46:39.707436] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-21T19:46:40.150984] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-21T19:46:40.251922] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T19:46:40.955166] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-21T19:46:40.960614] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T19:46:41.751056] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-21T19:46:42.101580] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-21T19:46:42.110220] [INFO ] [REMOTE ] M: Full fetch complete (77658 records). [2025-10-21T19:46:42.110349] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-21T19:46:42.505302] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-21T19:46:42.505416] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-21T19:46:42.506683] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-21T19:46:42.506830] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-21T19:46:42.508409] [DEBUG] [LOCAL ] M: Trimmed 77658 records to 53544 (keeping 200 days of data) [2025-10-21T19:46:42.565135] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-21T19:46:42.856242] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-21T19:46:42.886688] [DEBUG] [LOCAL ] M: Primary data saved (53544 records). [2025-10-21T19:46:42.886807] [INFO ] [MAIN ] M: Full history saved. [2025-10-21T19:46:42.886878] [INFO ] [MAIN ] Update Progress: 1294/2366 symbols completed. M took 34.8s. Estimated remaining: 2h 18m 3s. Rate: 7.8 symbols/min [2025-10-21T19:46:43.058789] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:46:43.095526] [DEBUG] [LOCAL ] MAGN: Loaded 36341 existing records from primary storage. [2025-10-21T19:46:43.095845] [INFO ] [MAIN ] MAGN: Loaded 36341 existing records. [2025-10-21T19:46:43.282378] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:46:43.282636] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-21T19:46:43.282786] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-21T19:46:43.282985] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-21T19:46:43.283040] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-21T19:46:43.355030] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-21T19:46:43.605925] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T19:46:43.697786] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:46:44.150997] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-21T19:46:44.760354] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-21T19:46:44.772829] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T19:46:44.951099] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-21T19:46:45.756208] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-21T19:46:45.780915] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T19:46:45.848094] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T19:46:46.551066] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-21T19:46:47.296704] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T19:46:47.351097] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-21T19:46:48.001484] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T19:46:48.151032] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-21T19:46:48.944042] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T19:46:48.954178] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-21T19:46:49.481371] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-21T19:46:49.751079] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-21T19:46:50.280899] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T19:46:50.551026] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-21T19:46:51.165957] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T19:46:51.351060] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-21T19:46:52.143490] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T19:46:52.153007] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-21T19:46:52.951063] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-21T19:46:53.092302] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T19:46:53.751159] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-21T19:46:53.975153] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-21T19:46:54.301361] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-21T19:46:54.551038] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-21T19:46:55.221176] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T19:46:55.228928] [INFO ] [REMOTE ] MAC: Full fetch complete (71587 records). [2025-10-21T19:46:55.229043] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-21T19:46:55.365593] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-21T19:46:55.619453] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-21T19:46:55.619552] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-21T19:46:55.620678] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-21T19:46:55.620772] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-21T19:46:55.622147] [DEBUG] [LOCAL ] MAC: Trimmed 71587 records to 49653 (keeping 200 days of data) [2025-10-21T19:46:55.921891] [DEBUG] [LOCAL ] MAC: Primary data saved (49653 records). [2025-10-21T19:46:55.922028] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-21T19:46:55.922558] [INFO ] [MAIN ] Update Progress: 1295/2366 symbols completed. MAC took 23.0s. Estimated remaining: 2h 18m 0s. Rate: 7.8 symbols/min [2025-10-21T19:46:56.088953] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:46:56.128609] [DEBUG] [LOCAL ] MAIN: Loaded 41956 existing records from primary storage. [2025-10-21T19:46:56.129014] [INFO ] [MAIN ] MAIN: Loaded 41956 existing records. [2025-10-21T19:46:56.160797] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-21T19:46:56.315836] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:46:56.316035] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-21T19:46:56.316094] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-21T19:46:56.316292] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-21T19:46:56.316332] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-21T19:46:56.679169] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:46:56.795382] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-21T19:46:56.882111] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T19:46:56.951006] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-21T19:46:57.751060] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-21T19:46:57.779512] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-21T19:46:58.323960] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T19:46:58.551058] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-21T19:46:59.351017] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-21T19:46:59.462889] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T19:46:59.938503] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T19:47:00.151057] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-21T19:47:00.951067] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-21T19:47:01.759256] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-21T19:47:01.762317] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-21T19:47:01.926463] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T19:47:02.551028] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-21T19:47:02.776725] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T19:47:02.785040] [INFO ] [REMOTE ] MAA: Full fetch complete (61774 records). [2025-10-21T19:47:02.785315] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-21T19:47:03.213220] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-21T19:47:03.213415] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-21T19:47:03.215263] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-21T19:47:03.215445] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-21T19:47:03.236729] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T19:47:03.244716] [DEBUG] [LOCAL ] MAA: Trimmed 61774 records to 42974 (keeping 200 days of data) [2025-10-21T19:47:03.358136] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-21T19:47:03.547509] [DEBUG] [LOCAL ] MAA: Primary data saved (42974 records). [2025-10-21T19:47:03.547777] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-21T19:47:03.547934] [INFO ] [MAIN ] Update Progress: 1296/2366 symbols completed. MAA took 41.8s. Estimated remaining: 2h 17m 52s. Rate: 7.8 symbols/min [2025-10-21T19:47:03.747269] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:47:03.794635] [DEBUG] [LOCAL ] MAN: Loaded 44330 existing records from primary storage. [2025-10-21T19:47:03.795069] [INFO ] [MAIN ] MAN: Loaded 44330 existing records. [2025-10-21T19:47:03.982686] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:47:03.982979] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-21T19:47:03.983030] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-21T19:47:03.983301] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-21T19:47:03.983359] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-21T19:47:04.159465] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-21T19:47:04.422148] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:47:04.543820] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T19:47:04.552324] [INFO ] [REMOTE ] MA: Full fetch complete (76406 records). [2025-10-21T19:47:04.552468] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-21T19:47:04.944116] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-21T19:47:04.944193] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-21T19:47:04.945271] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-21T19:47:04.945332] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-21T19:47:04.946782] [DEBUG] [LOCAL ] MA: Trimmed 76406 records to 52465 (keeping 200 days of data) [2025-10-21T19:47:05.003612] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-21T19:47:05.284490] [DEBUG] [LOCAL ] MA: Primary data saved (52465 records). [2025-10-21T19:47:05.284633] [INFO ] [MAIN ] MA: Full history saved. [2025-10-21T19:47:05.285447] [INFO ] [MAIN ] Update Progress: 1297/2366 symbols completed. MA took 45.0s. Estimated remaining: 2h 17m 40s. Rate: 7.8 symbols/min [2025-10-21T19:47:05.527945] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:47:05.552862] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T19:47:05.589730] [DEBUG] [LOCAL ] MANU: Loaded 27281 existing records from primary storage. [2025-10-21T19:47:05.590139] [INFO ] [MAIN ] MANU: Loaded 27281 existing records. [2025-10-21T19:47:05.756714] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-21T19:47:05.779405] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:47:05.781221] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-21T19:47:05.781309] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-21T19:47:05.781576] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-21T19:47:05.781669] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-21T19:47:06.099497] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-21T19:47:06.186391] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:47:06.551023] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-21T19:47:06.593802] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T19:47:07.351056] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-21T19:47:07.489101] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T19:47:07.496599] [INFO ] [REMOTE ] MAGN: Full fetch complete (51907 records). [2025-10-21T19:47:07.496822] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-21T19:47:07.890075] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-21T19:47:07.890163] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-21T19:47:07.891060] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-21T19:47:07.891127] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-21T19:47:07.892206] [DEBUG] [LOCAL ] MAGN: Trimmed 51907 records to 36252 (keeping 200 days of data) [2025-10-21T19:47:08.102272] [DEBUG] [LOCAL ] MAGN: Primary data saved (36252 records). [2025-10-21T19:47:08.102420] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-21T19:47:08.102503] [INFO ] [MAIN ] Update Progress: 1298/2366 symbols completed. MAGN took 25.2s. Estimated remaining: 2h 17m 28s. Rate: 7.8 symbols/min [2025-10-21T19:47:08.161846] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-21T19:47:08.308669] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:47:08.341506] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T19:47:08.396721] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T19:47:08.427106] [DEBUG] [LOCAL ] MAS: Loaded 52281 existing records from primary storage. [2025-10-21T19:47:08.427558] [INFO ] [MAIN ] MAS: Loaded 52281 existing records. [2025-10-21T19:47:08.677802] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:47:08.678039] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-21T19:47:08.678113] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-21T19:47:08.678370] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-21T19:47:08.678429] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-21T19:47:08.956345] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-21T19:47:09.261874] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:47:09.296397] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T19:47:09.751040] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-21T19:47:09.821711] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-21T19:47:10.551012] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-21T19:47:11.308963] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T19:47:11.350992] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-21T19:47:12.150995] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-21T19:47:12.283471] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T19:47:12.745440] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T19:47:12.950989] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-21T19:47:13.062532] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-21T19:47:13.750993] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-21T19:47:14.551051] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-21T19:47:14.596031] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T19:47:14.959287] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-21T19:47:15.351040] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-21T19:47:16.004963] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T19:47:16.151466] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-21T19:47:16.615395] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T19:47:16.951073] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-21T19:47:17.748756] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-21T19:47:17.757721] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-21T19:47:18.391071] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T19:47:18.551033] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-21T19:47:19.351069] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-21T19:47:19.581160] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T19:47:19.853636] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-21T19:47:20.151024] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-21T19:47:20.843972] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T19:47:20.951071] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-21T19:47:21.751034] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-21T19:47:21.959266] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T19:47:22.039998] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T19:47:22.551040] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-21T19:47:23.071569] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T19:47:23.351026] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-21T19:47:23.928004] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T19:47:24.151044] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-21T19:47:24.930353] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T19:47:24.950981] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-21T19:47:25.489510] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-21T19:47:25.751092] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-21T19:47:26.551074] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-21T19:47:26.603723] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T19:47:27.318953] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T19:47:27.324123] [INFO ] [REMOTE ] MANU: Full fetch complete (39310 records). [2025-10-21T19:47:27.324249] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-21T19:47:27.356165] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-21T19:47:27.717330] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-21T19:47:27.717430] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-21T19:47:27.718261] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-21T19:47:27.718322] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-21T19:47:27.719205] [DEBUG] [LOCAL ] MANU: Trimmed 39310 records to 27249 (keeping 200 days of data) [2025-10-21T19:47:27.874630] [DEBUG] [LOCAL ] MANU: Primary data saved (27249 records). [2025-10-21T19:47:27.874971] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-21T19:47:27.875120] [INFO ] [MAIN ] Update Progress: 1299/2366 symbols completed. MANU took 22.6s. Estimated remaining: 2h 17m 30s. Rate: 7.8 symbols/min [2025-10-21T19:47:28.046074] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:47:28.076960] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T19:47:28.116474] [DEBUG] [LOCAL ] MATV: Loaded 35365 existing records from primary storage. [2025-10-21T19:47:28.116778] [INFO ] [MAIN ] MATV: Loaded 35365 existing records. [2025-10-21T19:47:28.158717] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-21T19:47:28.293253] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:47:28.293511] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-21T19:47:28.293559] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-21T19:47:28.293778] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-21T19:47:28.293861] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-21T19:47:28.641447] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:47:28.951063] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-21T19:47:29.057735] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T19:47:29.751012] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-21T19:47:29.982876] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-21T19:47:30.281916] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T19:47:30.551068] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-21T19:47:31.350997] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-21T19:47:31.400746] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T19:47:32.150997] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-21T19:47:32.238461] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T19:47:32.753884] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T19:47:32.951025] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-21T19:47:33.610117] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T19:47:33.751073] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-21T19:47:34.551099] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-21T19:47:34.582267] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-21T19:47:34.589742] [INFO ] [REMOTE ] MAN: Full fetch complete (62812 records). [2025-10-21T19:47:34.589889] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-21T19:47:34.967449] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-21T19:47:34.967528] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-21T19:47:34.968490] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-21T19:47:34.968551] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-21T19:47:34.969760] [DEBUG] [LOCAL ] MAN: Trimmed 62812 records to 44311 (keeping 200 days of data) [2025-10-21T19:47:35.228167] [DEBUG] [LOCAL ] MAN: Primary data saved (44311 records). [2025-10-21T19:47:35.228295] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-21T19:47:35.228373] [INFO ] [MAIN ] Update Progress: 1300/2366 symbols completed. MAN took 31.7s. Estimated remaining: 2h 17m 22s. Rate: 7.8 symbols/min [2025-10-21T19:47:35.354915] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-21T19:47:35.406848] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:47:35.434511] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T19:47:35.471960] [DEBUG] [LOCAL ] MATX: Loaded 32025 existing records from primary storage. [2025-10-21T19:47:35.472226] [INFO ] [MAIN ] MATX: Loaded 32025 existing records. [2025-10-21T19:47:35.649794] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:47:35.650021] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-21T19:47:35.650070] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-21T19:47:35.650277] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-21T19:47:35.650333] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-21T19:47:36.018608] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:47:36.151012] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-21T19:47:36.292354] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T19:47:36.735403] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T19:47:36.951002] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-21T19:47:37.303329] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-21T19:47:37.463896] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-21T19:47:37.472106] [INFO ] [REMOTE ] MAS: Full fetch complete (75366 records). [2025-10-21T19:47:37.472242] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-21T19:47:37.756144] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-21T19:47:37.862865] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-21T19:47:37.862945] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-21T19:47:37.864108] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-21T19:47:37.864175] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-21T19:47:37.865624] [DEBUG] [LOCAL ] MAS: Trimmed 75366 records to 52251 (keeping 200 days of data) [2025-10-21T19:47:38.177338] [DEBUG] [LOCAL ] MAS: Primary data saved (52251 records). [2025-10-21T19:47:38.177471] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-21T19:47:38.178255] [INFO ] [MAIN ] Update Progress: 1301/2366 symbols completed. MAS took 30.1s. Estimated remaining: 2h 17m 10s. Rate: 7.8 symbols/min [2025-10-21T19:47:38.346383] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:47:38.377837] [DEBUG] [LOCAL ] MAX: Loaded 30945 existing records from primary storage. [2025-10-21T19:47:38.378129] [INFO ] [MAIN ] MAX: Loaded 30945 existing records. [2025-10-21T19:47:38.566473] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-21T19:47:38.572479] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:47:38.572895] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-21T19:47:38.573795] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-21T19:47:38.574061] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-21T19:47:38.574118] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-21T19:47:38.932247] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:47:39.230038] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-21T19:47:39.351010] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-21T19:47:39.948377] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T19:47:40.151085] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-21T19:47:40.769901] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T19:47:40.951110] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-21T19:47:41.751001] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-21T19:47:42.049919] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T19:47:42.057257] [INFO ] [REMOTE ] MAIN: Full fetch complete (60409 records). [2025-10-21T19:47:42.057406] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-21T19:47:42.411174] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-21T19:47:42.483063] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-21T19:47:42.483149] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-21T19:47:42.484108] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-21T19:47:42.484173] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-21T19:47:42.485424] [DEBUG] [LOCAL ] MAIN: Trimmed 60409 records to 41978 (keeping 200 days of data) [2025-10-21T19:47:42.573000] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-21T19:47:42.745481] [DEBUG] [LOCAL ] MAIN: Primary data saved (41978 records). [2025-10-21T19:47:42.745608] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-21T19:47:42.746246] [INFO ] [MAIN ] Update Progress: 1302/2366 symbols completed. MAIN took 46.8s. Estimated remaining: 2h 17m 0s. Rate: 7.8 symbols/min [2025-10-21T19:47:42.914916] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:47:42.956997] [DEBUG] [LOCAL ] MBC: Loaded 43967 existing records from primary storage. [2025-10-21T19:47:42.957286] [INFO ] [MAIN ] MBC: Loaded 43967 existing records. [2025-10-21T19:47:43.139201] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:47:43.139508] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-21T19:47:43.157698] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-21T19:47:43.158061] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-21T19:47:43.158128] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-21T19:47:43.191525] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T19:47:43.357620] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-21T19:47:43.525754] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:47:43.897564] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-21T19:47:44.151038] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-21T19:47:44.616271] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T19:47:44.951071] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-21T19:47:45.704692] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T19:47:45.751057] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-21T19:47:46.469019] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T19:47:46.551129] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-21T19:47:47.282822] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T19:47:47.351117] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-21T19:47:48.114771] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T19:47:48.151002] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-21T19:47:48.827704] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T19:47:48.951026] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-21T19:47:49.556183] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T19:47:49.751141] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-21T19:47:50.232526] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T19:47:50.551031] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-21T19:47:51.175304] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-21T19:47:51.351028] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-21T19:47:51.833049] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T19:47:51.838067] [INFO ] [REMOTE ] MATV: Full fetch complete (52163 records). [2025-10-21T19:47:51.838167] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-21T19:47:52.156210] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-21T19:47:52.242454] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-21T19:47:52.242585] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-21T19:47:52.244794] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-21T19:47:52.244872] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-21T19:47:52.246801] [DEBUG] [LOCAL ] MATV: Trimmed 52163 records to 35183 (keeping 200 days of data) [2025-10-21T19:47:52.490709] [DEBUG] [LOCAL ] MATV: Primary data saved (35183 records). [2025-10-21T19:47:52.490983] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-21T19:47:52.491678] [INFO ] [MAIN ] Update Progress: 1303/2366 symbols completed. MATV took 24.6s. Estimated remaining: 2h 16m 54s. Rate: 7.8 symbols/min [2025-10-21T19:47:52.679113] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:47:52.702260] [DEBUG] [LOCAL ] MBI: Loaded 24304 existing records from primary storage. [2025-10-21T19:47:52.702544] [INFO ] [MAIN ] MBI: Loaded 24304 existing records. [2025-10-21T19:47:52.910895] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T19:47:52.933815] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:47:52.941837] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-21T19:47:52.942496] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-21T19:47:52.942833] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-21T19:47:52.942901] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-21T19:47:52.957723] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-21T19:47:53.309256] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:47:53.572561] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T19:47:53.751058] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-21T19:47:54.275307] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T19:47:54.551058] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-21T19:47:55.344037] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T19:47:55.352830] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-21T19:47:55.686069] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T19:47:56.151022] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-21T19:47:56.556933] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T19:47:56.951078] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-21T19:47:57.560236] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-21T19:47:57.751048] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-21T19:47:58.524225] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T19:47:58.550990] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-21T19:47:58.857515] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T19:47:59.351035] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-21T19:48:00.064449] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T19:48:00.151009] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-21T19:48:00.545917] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T19:48:00.951028] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-21T19:48:01.751118] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-21T19:48:01.932125] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T19:48:02.551068] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-21T19:48:02.763012] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T19:48:02.950099] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T19:48:03.351034] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-21T19:48:03.900896] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T19:48:04.151073] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-21T19:48:04.643609] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-21T19:48:04.951077] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-21T19:48:05.751008] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-21T19:48:05.789023] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T19:48:06.274417] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T19:48:06.551017] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-21T19:48:07.152310] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T19:48:07.351022] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-21T19:48:08.001283] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T19:48:08.006991] [INFO ] [REMOTE ] MATX: Full fetch complete (43858 records). [2025-10-21T19:48:08.007123] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-21T19:48:08.164235] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-21T19:48:08.461883] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-21T19:48:08.462812] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-21T19:48:08.464697] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-21T19:48:08.465695] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-21T19:48:08.465518] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-21T19:48:08.473535] [DEBUG] [LOCAL ] MATX: Trimmed 43858 records to 31987 (keeping 200 days of data) [2025-10-21T19:48:08.698201] [DEBUG] [LOCAL ] MATX: Primary data saved (31987 records). [2025-10-21T19:48:08.698309] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-21T19:48:08.698391] [INFO ] [MAIN ] Update Progress: 1304/2366 symbols completed. MATX took 33.5s. Estimated remaining: 2h 16m 53s. Rate: 7.8 symbols/min [2025-10-21T19:48:08.870369] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:48:08.870534] [DEBUG] [LOCAL ] MC: No existing data file found in primary storage. [2025-10-21T19:48:08.870571] [WARN ] [MAIN ] MC: No existing data found, performing full refresh instead. [2025-10-21T19:48:08.870772] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-21T19:48:08.870844] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-21T19:48:08.870900] [DEBUG] [LOCAL ] MC: No primary data file found to delete. [2025-10-21T19:48:08.870933] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-21T19:48:08.959838] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-21T19:48:09.225077] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:48:09.618614] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T19:48:09.624152] [INFO ] [REMOTE ] MAX: Full fetch complete (45191 records). [2025-10-21T19:48:09.624241] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-21T19:48:09.751617] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-21T19:48:09.964223] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-21T19:48:10.030034] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-21T19:48:10.030106] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-21T19:48:10.030945] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-21T19:48:10.031007] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-21T19:48:10.031849] [DEBUG] [LOCAL ] MAX: Trimmed 45191 records to 30845 (keeping 200 days of data) [2025-10-21T19:48:10.203693] [DEBUG] [LOCAL ] MAX: Primary data saved (30845 records). [2025-10-21T19:48:10.203814] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-21T19:48:10.203890] [INFO ] [MAIN ] Update Progress: 1305/2366 symbols completed. MAX took 32.0s. Estimated remaining: 2h 16m 40s. Rate: 7.8 symbols/min [2025-10-21T19:48:10.371546] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:48:10.384331] [DEBUG] [LOCAL ] MCB: Loaded 11359 existing records from primary storage. [2025-10-21T19:48:10.384535] [INFO ] [MAIN ] MCB: Loaded 11359 existing records. [2025-10-21T19:48:10.556416] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-21T19:48:10.561125] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:48:10.562128] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-21T19:48:10.562178] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-21T19:48:10.562521] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-21T19:48:10.562579] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-21T19:48:10.914706] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:48:11.351068] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-21T19:48:11.824864] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-21T19:48:12.150994] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-21T19:48:12.234415] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-21T19:48:12.951038] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-21T19:48:13.203220] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T19:48:13.693573] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-21T19:48:13.751002] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-21T19:48:14.551076] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-21T19:48:14.803169] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-21T19:48:15.351079] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-21T19:48:15.548401] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (4.99 seconds). [2025-10-21T19:48:15.845366] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T19:48:16.151027] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-21T19:48:16.334748] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T19:48:16.951051] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-21T19:48:17.670015] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T19:48:17.738736] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T19:48:17.750991] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-21T19:48:18.551083] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-21T19:48:19.349502] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-21T19:48:19.359217] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-21T19:48:20.151006] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-21T19:48:20.197057] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T19:48:20.951064] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-21T19:48:20.959276] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T19:48:21.429416] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-21T19:48:21.751066] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-21T19:48:22.551049] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-21T19:48:22.635621] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T19:48:23.351100] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-21T19:48:23.390349] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-21T19:48:23.399128] [INFO ] [REMOTE ] MBC: Full fetch complete (63082 records). [2025-10-21T19:48:23.399381] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-21T19:48:23.693823] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T19:48:23.731243] [INFO ] [REMOTE ] MBI: Full fetch complete (36081 records). [2025-10-21T19:48:23.746594] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-21T19:48:24.087069] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-21T19:48:24.089431] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-21T19:48:24.098991] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-21T19:48:24.115514] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-21T19:48:24.156239] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-21T19:48:24.217516] [DEBUG] [LOCAL ] MBC: Trimmed 63082 records to 43908 (keeping 200 days of data) [2025-10-21T19:48:24.423961] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-21T19:48:24.437015] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-21T19:48:24.438259] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-21T19:48:24.446152] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-21T19:48:24.460261] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T19:48:24.559234] [DEBUG] [LOCAL ] MBI: Trimmed 36081 records to 24151 (keeping 200 days of data) [2025-10-21T19:48:24.662765] [DEBUG] [LOCAL ] MBC: Primary data saved (43908 records). [2025-10-21T19:48:24.688696] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-21T19:48:24.689089] [INFO ] [MAIN ] Update Progress: 1306/2366 symbols completed. MBC took 41.9s. Estimated remaining: 2h 16m 38s. Rate: 7.8 symbols/min [2025-10-21T19:48:24.852086] [DEBUG] [LOCAL ] MBI: Primary data saved (24151 records). [2025-10-21T19:48:24.862507] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-21T19:48:24.867799] [INFO ] [MAIN ] Update Progress: 1307/2366 symbols completed. MBI took 32.4s. Estimated remaining: 2h 16m 24s. Rate: 7.8 symbols/min [2025-10-21T19:48:24.956237] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-21T19:48:25.002857] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:48:25.025683] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-21T19:48:25.025855] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-21T19:48:25.026327] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-21T19:48:25.053005] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-21T19:48:25.072800] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-21T19:48:25.099708] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:48:25.099791] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-21T19:48:25.208291] [DEBUG] [LOCAL ] MCI: Loaded 6235 existing records from primary storage. [2025-10-21T19:48:25.224186] [INFO ] [MAIN ] MCI: Loaded 6235 existing records. [2025-10-21T19:48:25.631967] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:48:25.660258] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:48:25.660706] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-21T19:48:25.661097] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-21T19:48:25.661488] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-21T19:48:25.661637] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-21T19:48:25.754207] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-21T19:48:25.772459] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T19:48:26.052322] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-21T19:48:26.074334] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:48:26.551082] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-21T19:48:27.351036] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-21T19:48:27.711429] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T19:48:27.842119] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-21T19:48:28.126683] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-21T19:48:28.150983] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-21T19:48:28.822516] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-21T19:48:28.824728] [INFO ] [REMOTE ] MCB: Full fetch complete (16652 records). [2025-10-21T19:48:28.824795] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-21T19:48:28.963683] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-21T19:48:29.189975] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-21T19:48:29.190053] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-21T19:48:29.190506] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-21T19:48:29.190566] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-21T19:48:29.191163] [DEBUG] [LOCAL ] MCB: Trimmed 16652 records to 11340 (keeping 200 days of data) [2025-10-21T19:48:29.259146] [DEBUG] [LOCAL ] MCB: Primary data saved (11340 records). [2025-10-21T19:48:29.259275] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-21T19:48:29.259348] [INFO ] [MAIN ] Update Progress: 1308/2366 symbols completed. MCB took 19.1s. Estimated remaining: 2h 16m 14s. Rate: 7.8 symbols/min [2025-10-21T19:48:29.431686] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:48:29.468121] [DEBUG] [LOCAL ] MCK: Loaded 38322 existing records from primary storage. [2025-10-21T19:48:29.468393] [INFO ] [MAIN ] MCK: Loaded 38322 existing records. [2025-10-21T19:48:29.649171] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:48:29.649378] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-21T19:48:29.649428] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-21T19:48:29.650443] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-21T19:48:29.650501] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-21T19:48:29.755871] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-21T19:48:30.035310] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:48:30.550996] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-21T19:48:30.585409] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T19:48:30.782786] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T19:48:31.351040] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-21T19:48:32.151560] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-21T19:48:32.153908] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T19:48:32.951013] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-21T19:48:33.305614] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-21T19:48:33.702944] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-21T19:48:33.730242] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T19:48:33.750990] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-21T19:48:34.551040] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-21T19:48:35.298455] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-21T19:48:35.350992] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-21T19:48:36.150997] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-21T19:48:36.554275] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-21T19:48:36.897306] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-21T19:48:36.908266] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-21T19:48:36.911752] [INFO ] [REMOTE ] MC: Full fetch complete (63101 records). [2025-10-21T19:48:36.911965] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-21T19:48:36.956206] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-21T19:48:37.372130] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-21T19:48:37.372270] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-21T19:48:37.374101] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-21T19:48:37.374220] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-21T19:48:37.376057] [DEBUG] [LOCAL ] MC: Trimmed 63101 records to 43725 (keeping 200 days of data) [2025-10-21T19:48:37.648541] [DEBUG] [LOCAL ] MC: Primary data saved (43725 records). [2025-10-21T19:48:37.648713] [INFO ] [MAIN ] MC: Full history saved. [2025-10-21T19:48:37.648797] [INFO ] [MAIN ] Update Progress: 1309/2366 symbols completed. MC took 29.0s. Estimated remaining: 2h 16m 7s. Rate: 7.8 symbols/min [2025-10-21T19:48:37.756235] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-21T19:48:37.821867] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:48:37.832449] [DEBUG] [LOCAL ] MCN: Loaded 8069 existing records from primary storage. [2025-10-21T19:48:37.832710] [INFO ] [MAIN ] MCN: Loaded 8069 existing records. [2025-10-21T19:48:38.013501] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:48:38.013767] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-21T19:48:38.013816] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-21T19:48:38.013975] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-21T19:48:38.014029] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-21T19:48:38.368356] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:48:38.551072] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-21T19:48:39.189205] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-21T19:48:39.351066] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-21T19:48:39.396700] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-21T19:48:39.398523] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T19:48:40.151077] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-21T19:48:40.951039] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-21T19:48:41.305563] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-21T19:48:41.667682] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-21T19:48:41.751098] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-21T19:48:41.947556] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T19:48:42.551088] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-21T19:48:42.579088] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T19:48:43.293665] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-21T19:48:43.350986] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-21T19:48:44.085252] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T19:48:44.151003] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-21T19:48:44.858893] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-21T19:48:44.951003] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-21T19:48:45.754057] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T19:48:45.751109] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-21T19:48:46.551043] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-21T19:48:47.351078] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-21T19:48:47.365726] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T19:48:47.962146] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-21T19:48:48.151026] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-21T19:48:48.951023] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-21T19:48:49.058475] [DEBUG] [REMOTE ] MCN: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-21T19:48:49.058867] [WARN ] [REMOTE ] MCN: No data returned for month 2025-06 [2025-10-21T19:48:49.058961] [FATAL] [REMOTE ] MCN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:48:49.059038] [FATAL] [MAIN ] MCN: Failed to fetch primary data. [2025-10-21T19:48:49.059073] [WARN ] [MAIN ] MCN: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:48:49.059125] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-21T19:48:49.059204] [DEBUG] [LOCAL ] MCN: No primary data file found to delete. [2025-10-21T19:48:49.059241] [INFO ] [LOCAL ] MCN: Starting deletion of derivative data. [2025-10-21T19:48:49.059385] [DEBUG] [LOCAL ] MCN: Deleted derivative data file. [2025-10-21T19:48:49.059485] [INFO ] [MAIN ] Update Progress: 1310/2366 symbols completed. MCN took 11.4s. Estimated remaining: 2h 16m 2s. Rate: 7.8 symbols/min [2025-10-21T19:48:49.245867] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:48:49.246055] [DEBUG] [LOCAL ] MCO: No existing data file found in primary storage. [2025-10-21T19:48:49.246093] [WARN ] [MAIN ] MCO: No existing data found, performing full refresh instead. [2025-10-21T19:48:49.246207] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-21T19:48:49.246248] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-21T19:48:49.246292] [DEBUG] [LOCAL ] MCO: No primary data file found to delete. [2025-10-21T19:48:49.246325] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-21T19:48:49.381365] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-21T19:48:49.649031] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:48:49.750996] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-21T19:48:50.471237] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-21T19:48:50.550986] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-21T19:48:51.273345] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T19:48:51.351033] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-21T19:48:52.151067] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-21T19:48:52.679559] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-21T19:48:52.913544] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T19:48:52.951015] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-21T19:48:53.388795] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T19:48:53.751089] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-21T19:48:54.551026] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-21T19:48:54.649066] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T19:48:55.135016] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-21T19:48:55.351150] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-21T19:48:55.855629] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-21T19:48:55.964446] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T19:48:56.151051] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-21T19:48:56.951107] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-21T19:48:57.173039] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T19:48:57.181696] [INFO ] [REMOTE ] MCD: Full fetch complete (77139 records). [2025-10-21T19:48:57.181846] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-21T19:48:57.377704] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T19:48:57.378630] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:48:57.378865] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:48:57.379003] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-21T19:48:57.379130] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-21T19:48:57.379229] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-21T19:48:57.379310] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-21T19:48:57.379398] [INFO ] [MAIN ] Update Progress: 1311/2366 symbols completed. MCD took 32.7s. Estimated remaining: 2h 15m 55s. Rate: 7.8 symbols/min [2025-10-21T19:48:57.430021] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-21T19:48:57.564227] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:48:57.574325] [DEBUG] [LOCAL ] MCR: Loaded 8879 existing records from primary storage. [2025-10-21T19:48:57.574512] [INFO ] [MAIN ] MCR: Loaded 8879 existing records. [2025-10-21T19:48:57.749209] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:48:57.749424] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-21T19:48:57.749481] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-21T19:48:57.749670] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-21T19:48:57.749732] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-21T19:48:57.760509] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-21T19:48:58.103068] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:48:58.551089] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-21T19:48:59.351142] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-21T19:48:59.353926] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T19:49:00.151037] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-21T19:49:00.214223] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T19:49:00.265679] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T19:49:00.951029] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-21T19:49:01.019353] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T19:49:01.020848] [INFO ] [REMOTE ] MCI: Full fetch complete (9810 records). [2025-10-21T19:49:01.020919] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-21T19:49:01.376731] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-21T19:49:01.376810] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-21T19:49:01.377049] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-21T19:49:01.377086] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-21T19:49:01.377480] [DEBUG] [LOCAL ] MCI: Trimmed 9810 records to 6222 (keeping 200 days of data) [2025-10-21T19:49:01.414412] [DEBUG] [LOCAL ] MCI: Primary data saved (6222 records). [2025-10-21T19:49:01.414507] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-21T19:49:01.414585] [INFO ] [MAIN ] Update Progress: 1312/2366 symbols completed. MCI took 36.5s. Estimated remaining: 2h 15m 44s. Rate: 7.8 symbols/min [2025-10-21T19:49:01.607960] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:49:01.629316] [DEBUG] [LOCAL ] MCS: Loaded 21228 existing records from primary storage. [2025-10-21T19:49:01.629547] [INFO ] [MAIN ] MCS: Loaded 21228 existing records. [2025-10-21T19:49:01.753741] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-21T19:49:01.788932] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-21T19:49:01.822102] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:49:01.822272] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-21T19:49:01.822317] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-21T19:49:01.822487] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-21T19:49:01.822541] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-21T19:49:02.184038] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:49:02.551072] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-21T19:49:03.335509] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T19:49:03.351032] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-21T19:49:03.707054] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-21T19:49:04.151004] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-21T19:49:04.446279] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T19:49:04.951070] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-21T19:49:04.966854] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-21T19:49:05.751025] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-21T19:49:06.457593] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-21T19:49:06.551017] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-21T19:49:06.777544] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T19:49:07.351066] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-21T19:49:08.107515] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T19:49:08.151060] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-21T19:49:08.954081] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-21T19:49:08.960091] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T19:49:09.017225] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-21T19:49:09.751045] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-21T19:49:10.414634] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T19:49:10.513835] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T19:49:10.550982] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-21T19:49:11.316000] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-21T19:49:11.350997] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-21T19:49:12.127991] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-21T19:49:12.150988] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-21T19:49:12.951007] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-21T19:49:13.751009] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-21T19:49:13.842359] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T19:49:13.865481] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-21T19:49:14.551099] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-21T19:49:15.315948] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T19:49:15.351309] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-21T19:49:15.970909] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-21T19:49:16.092029] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-21T19:49:16.097454] [INFO ] [REMOTE ] MCK: Full fetch complete (56708 records). [2025-10-21T19:49:16.097580] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-21T19:49:16.159981] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-21T19:49:16.508554] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-21T19:49:16.508637] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-21T19:49:16.509706] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-21T19:49:16.509770] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-21T19:49:16.510935] [DEBUG] [LOCAL ] MCK: Trimmed 56708 records to 38187 (keeping 200 days of data) [2025-10-21T19:49:16.759186] [DEBUG] [LOCAL ] MCK: Primary data saved (38187 records). [2025-10-21T19:49:16.759334] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-21T19:49:16.759417] [INFO ] [MAIN ] Update Progress: 1313/2366 symbols completed. MCK took 47.5s. Estimated remaining: 2h 15m 42s. Rate: 7.8 symbols/min [2025-10-21T19:49:16.943186] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:49:16.943754] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-21T19:49:16.946535] [INFO ] [REMOTE ] MCR: Full fetch complete (13487 records). [2025-10-21T19:49:16.946682] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-21T19:49:16.952311] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-21T19:49:17.132315] [DEBUG] [LOCAL ] MCY: Loaded 23809 existing records from primary storage. [2025-10-21T19:49:17.159317] [INFO ] [MAIN ] MCY: Loaded 23809 existing records. [2025-10-21T19:49:17.545303] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-21T19:49:17.537449] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:49:17.545458] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-21T19:49:17.546029] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-21T19:49:17.546116] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-21T19:49:17.545618] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-21T19:49:17.546240] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-21T19:49:17.546809] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-21T19:49:17.546890] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-21T19:49:17.546999] [DEBUG] [LOCAL ] MCR: Trimmed 13487 records to 8854 (keeping 200 days of data) [2025-10-21T19:49:17.753781] [DEBUG] [LOCAL ] MCR: Primary data saved (8854 records). [2025-10-21T19:49:17.778563] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-21T19:49:17.778431] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-21T19:49:17.794067] [INFO ] [MAIN ] Update Progress: 1314/2366 symbols completed. MCR took 20.4s. Estimated remaining: 2h 15m 29s. Rate: 7.8 symbols/min [2025-10-21T19:49:18.060363] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:49:18.127496] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T19:49:18.195807] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:49:18.237164] [DEBUG] [LOCAL ] MD: Loaded 38589 existing records from primary storage. [2025-10-21T19:49:18.237480] [INFO ] [MAIN ] MD: Loaded 38589 existing records. [2025-10-21T19:49:18.416123] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:49:18.416348] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-21T19:49:18.416407] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-21T19:49:18.416621] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-21T19:49:18.416713] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-21T19:49:18.557126] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-21T19:49:18.782197] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:49:19.350987] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-21T19:49:20.120884] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-21T19:49:20.150987] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-21T19:49:20.275327] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T19:49:20.720100] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T19:49:20.951135] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-21T19:49:21.751079] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-21T19:49:22.032972] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T19:49:22.040106] [INFO ] [REMOTE ] MCO: Full fetch complete (58204 records). [2025-10-21T19:49:22.040212] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-21T19:49:22.440110] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-21T19:49:22.440220] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-21T19:49:22.441298] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-21T19:49:22.441407] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-21T19:49:22.463470] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T19:49:22.463605] [DEBUG] [LOCAL ] MCO: Trimmed 58204 records to 39453 (keeping 200 days of data) [2025-10-21T19:49:22.560040] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-21T19:49:22.716491] [DEBUG] [LOCAL ] MCO: Primary data saved (39453 records). [2025-10-21T19:49:22.716627] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-21T19:49:22.716734] [INFO ] [MAIN ] Update Progress: 1315/2366 symbols completed. MCO took 33.7s. Estimated remaining: 2h 15m 19s. Rate: 7.8 symbols/min [2025-10-21T19:49:22.872577] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-21T19:49:22.910107] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:49:22.918556] [DEBUG] [LOCAL ] MDST: Loaded 6125 existing records from primary storage. [2025-10-21T19:49:22.918791] [INFO ] [MAIN ] MDST: Loaded 6125 existing records. [2025-10-21T19:49:23.101218] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:49:23.101436] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-21T19:49:23.101488] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-21T19:49:23.101687] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-21T19:49:23.101745] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-21T19:49:23.356223] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-21T19:49:23.467692] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:49:23.899901] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T19:49:24.151007] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-21T19:49:24.408600] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T19:49:24.951120] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-21T19:49:25.533269] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T19:49:25.629727] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-21T19:49:25.751077] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-21T19:49:26.551102] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-21T19:49:27.124063] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-21T19:49:27.351024] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-21T19:49:27.680769] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-21T19:49:28.151074] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-21T19:49:28.924054] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T19:49:28.950991] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-21T19:49:29.347267] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-21T19:49:29.751073] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-21T19:49:30.374804] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T19:49:30.551022] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-21T19:49:30.852721] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-21T19:49:31.165165] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T19:49:31.351066] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-21T19:49:32.151094] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-21T19:49:32.875187] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T19:49:32.950997] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-21T19:49:33.307417] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T19:49:33.311536] [INFO ] [REMOTE ] MCS: Full fetch complete (30669 records). [2025-10-21T19:49:33.311620] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-21T19:49:33.684569] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-21T19:49:33.684661] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-21T19:49:33.685291] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-21T19:49:33.685330] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-21T19:49:33.686035] [DEBUG] [LOCAL ] MCS: Trimmed 30669 records to 21229 (keeping 200 days of data) [2025-10-21T19:49:33.771026] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-21T19:49:33.811946] [DEBUG] [LOCAL ] MCS: Primary data saved (21229 records). [2025-10-21T19:49:33.812096] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-21T19:49:33.812177] [INFO ] [MAIN ] Update Progress: 1316/2366 symbols completed. MCS took 32.4s. Estimated remaining: 2h 15m 14s. Rate: 7.8 symbols/min [2025-10-21T19:49:33.981397] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:49:34.028796] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-21T19:49:34.029097] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-10-21T19:49:34.207303] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:49:34.207669] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-21T19:49:34.207771] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-21T19:49:34.213807] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-21T19:49:34.223513] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-21T19:49:34.256156] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T19:49:34.531159] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-21T19:49:34.556179] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-21T19:49:34.621465] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:49:35.351078] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-21T19:49:35.784164] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T19:49:35.916302] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-21T19:49:36.151059] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-21T19:49:36.951095] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-21T19:49:37.455720] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-21T19:49:37.513328] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-21T19:49:37.751087] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-21T19:49:38.310774] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-21T19:49:38.551021] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-21T19:49:39.351034] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-21T19:49:39.618179] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T19:49:40.151041] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-21T19:49:40.951075] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-21T19:49:41.174921] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T19:49:41.302425] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-21T19:49:41.751069] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-21T19:49:42.270418] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T19:49:42.516934] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-21T19:49:42.550994] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-21T19:49:43.351031] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-21T19:49:44.092710] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T19:49:44.150998] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-21T19:49:44.800489] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-21T19:49:44.950991] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-21T19:49:45.137766] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T19:49:45.751015] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-21T19:49:46.140901] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T19:49:46.144567] [INFO ] [REMOTE ] MCY: Full fetch complete (40860 records). [2025-10-21T19:49:46.144699] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-21T19:49:46.529196] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-21T19:49:46.529281] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-21T19:49:46.530179] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-21T19:49:46.530242] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-21T19:49:46.531277] [DEBUG] [LOCAL ] MCY: Trimmed 40860 records to 23711 (keeping 200 days of data) [2025-10-21T19:49:46.597523] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-21T19:49:46.690086] [DEBUG] [LOCAL ] MCY: Primary data saved (23711 records). [2025-10-21T19:49:46.690213] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-21T19:49:46.690291] [INFO ] [MAIN ] Update Progress: 1317/2366 symbols completed. MCY took 29.9s. Estimated remaining: 2h 15m 11s. Rate: 7.8 symbols/min [2025-10-21T19:49:47.351002] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-21T19:49:47.360852] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-21T19:49:47.672772] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-21T19:49:48.151062] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-21T19:49:48.854491] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T19:49:48.951161] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-21T19:49:48.985990] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T19:49:48.989321] [INFO ] [REMOTE ] MDST: Full fetch complete (8824 records). [2025-10-21T19:49:48.989453] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-21T19:49:49.507506] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-21T19:49:49.507585] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-21T19:49:49.507876] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-21T19:49:49.507939] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-21T19:49:49.508461] [DEBUG] [LOCAL ] MDST: Trimmed 8824 records to 6139 (keeping 200 days of data) [2025-10-21T19:49:49.548275] [DEBUG] [LOCAL ] MDST: Primary data saved (6139 records). [2025-10-21T19:49:49.548449] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-21T19:49:49.548547] [INFO ] [MAIN ] Update Progress: 1318/2366 symbols completed. MDST took 26.8s. Estimated remaining: 2h 14m 59s. Rate: 7.8 symbols/min [2025-10-21T19:49:49.751107] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-21T19:49:50.844490] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T19:49:50.856020] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-21T19:49:51.220257] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T19:49:51.351007] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-21T19:49:52.897104] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-21T19:49:52.909290] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-21T19:49:52.928012] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T19:49:52.935568] [INFO ] [REMOTE ] MD: Full fetch complete (55224 records). [2025-10-21T19:49:52.935752] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-21T19:49:53.324753] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-21T19:49:53.324843] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-21T19:49:53.325758] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-21T19:49:53.325820] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-21T19:49:53.327039] [DEBUG] [LOCAL ] MD: Trimmed 55224 records to 38586 (keeping 200 days of data) [2025-10-21T19:49:53.548867] [DEBUG] [LOCAL ] MD: Primary data saved (38586 records). [2025-10-21T19:49:53.549015] [INFO ] [MAIN ] MD: Full history saved. [2025-10-21T19:49:53.549332] [INFO ] [MAIN ] Update Progress: 1319/2366 symbols completed. MD took 35.7s. Estimated remaining: 2h 14m 48s. Rate: 7.8 symbols/min [2025-10-21T19:49:54.703518] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T19:49:54.714457] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-21T19:49:56.629973] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-21T19:49:56.641932] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-21T19:49:58.489482] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T19:49:58.500861] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-21T19:50:00.321703] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T19:50:00.333475] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-21T19:50:01.570611] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-21T19:50:01.579472] [INFO ] [REMOTE ] MDT: Full fetch complete (77857 records). [2025-10-21T19:50:01.579682] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-21T19:50:01.978454] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-21T19:50:01.978534] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-21T19:50:01.979607] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-21T19:50:01.979695] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-21T19:50:01.981277] [DEBUG] [LOCAL ] MDT: Trimmed 77857 records to 53678 (keeping 200 days of data) [2025-10-21T19:50:02.323293] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-10-21T19:50:02.323483] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-21T19:50:02.324062] [INFO ] [MAIN ] Update Progress: 1320/2366 symbols completed. MDT took 28.5s. Estimated remaining: 2h 14m 41s. Rate: 7.8 symbols/min [2025-10-21T19:50:02.988626] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:50:03.120916] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:50:03.102227] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:50:03.123429] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:50:03.135603] [DEBUG] [LOCAL ] MDV: Loaded 8358 existing records from primary storage. [2025-10-21T19:50:03.136011] [INFO ] [MAIN ] MDV: Loaded 8358 existing records. [2025-10-21T19:50:03.262516] [DEBUG] [LOCAL ] MEC: Loaded 16516 existing records from primary storage. [2025-10-21T19:50:03.289176] [INFO ] [MAIN ] MEC: Loaded 16516 existing records. [2025-10-21T19:50:03.283711] [DEBUG] [LOCAL ] MED: Loaded 21123 existing records from primary storage. [2025-10-21T19:50:03.354919] [INFO ] [MAIN ] MED: Loaded 21123 existing records. [2025-10-21T19:50:03.567989] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:50:03.630083] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-21T19:50:03.630156] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-21T19:50:03.631241] [DEBUG] [LOCAL ] MDU: Loaded 48046 existing records from primary storage. [2025-10-21T19:50:03.642265] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-21T19:50:03.677093] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-21T19:50:03.642211] [INFO ] [MAIN ] MDU: Loaded 48046 existing records. [2025-10-21T19:50:03.856978] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:50:03.907919] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-21T19:50:03.925086] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-21T19:50:03.970113] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:50:04.026032] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-21T19:50:04.070091] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-21T19:50:04.050257] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-21T19:50:04.113271] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-21T19:50:04.235677] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-21T19:50:04.343956] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-21T19:50:04.530123] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:50:04.640735] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-21T19:50:04.711108] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-21T19:50:04.838387] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:50:04.838587] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-21T19:50:04.855988] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-21T19:50:04.856113] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-21T19:50:05.061925] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:50:05.092306] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-21T19:50:05.540003] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:50:05.562094] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-21T19:50:05.638639] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:50:05.639327] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-21T19:50:05.768729] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T19:50:05.770623] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-21T19:50:06.197537] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-21T19:50:06.201148] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-21T19:50:06.394872] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-21T19:50:06.397025] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-21T19:50:06.666206] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T19:50:06.671583] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-21T19:50:06.984734] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T19:50:06.988245] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-21T19:50:07.223200] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-21T19:50:07.225996] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-21T19:50:07.310361] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T19:50:07.320516] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-21T19:50:07.695370] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-21T19:50:07.701533] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-21T19:50:07.767420] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-21T19:50:07.771843] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-21T19:50:08.014444] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-21T19:50:08.017104] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-21T19:50:08.705767] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-21T19:50:08.709547] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-21T19:50:08.802957] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T19:50:08.806567] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-21T19:50:08.859198] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-21T19:50:08.951629] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-21T19:50:08.951554] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T19:50:09.423846] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-21T19:50:09.573539] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-21T19:50:09.751017] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-21T19:50:10.321898] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-21T19:50:10.548543] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-21T19:50:10.551124] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-21T19:50:11.274414] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T19:50:11.351033] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-21T19:50:12.150997] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-21T19:50:12.388974] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T19:50:12.771223] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-21T19:50:12.951002] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-21T19:50:13.751040] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-21T19:50:13.990831] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T19:50:14.551060] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-21T19:50:14.661256] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-21T19:50:15.351036] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-21T19:50:15.615019] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-21T19:50:16.150999] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-21T19:50:16.213049] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-21T19:50:16.214607] [INFO ] [REMOTE ] MDV: Full fetch complete (11679 records). [2025-10-21T19:50:16.214699] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-21T19:50:16.580488] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-21T19:50:16.580578] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-21T19:50:16.580883] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-21T19:50:16.580942] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-21T19:50:16.581380] [DEBUG] [LOCAL ] MDV: Trimmed 11679 records to 8346 (keeping 200 days of data) [2025-10-21T19:50:16.632008] [DEBUG] [LOCAL ] MDV: Primary data saved (8346 records). [2025-10-21T19:50:16.632122] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-21T19:50:16.632196] [INFO ] [MAIN ] Update Progress: 1321/2366 symbols completed. MDV took 14.3s. Estimated remaining: 2h 14m 39s. Rate: 7.8 symbols/min [2025-10-21T19:50:16.805440] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:50:16.836418] [DEBUG] [LOCAL ] MEG: Loaded 31609 existing records from primary storage. [2025-10-21T19:50:16.836729] [INFO ] [MAIN ] MEG: Loaded 31609 existing records. [2025-10-21T19:50:16.956177] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-21T19:50:17.028882] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:50:17.029257] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-21T19:50:17.029397] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-21T19:50:17.029708] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-21T19:50:17.029767] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-21T19:50:17.364635] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-21T19:50:17.442423] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:50:17.733982] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-21T19:50:17.750986] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-21T19:50:18.551028] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-21T19:50:19.171321] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-21T19:50:19.351042] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-21T19:50:19.955000] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T19:50:20.151016] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-21T19:50:20.583540] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-21T19:50:20.951032] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-21T19:50:21.731630] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T19:50:21.750989] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-21T19:50:22.455736] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T19:50:22.551001] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-21T19:50:23.353619] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-21T19:50:23.356106] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T19:50:23.930025] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T19:50:24.151021] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-21T19:50:24.353285] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T19:50:24.951039] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-21T19:50:25.467346] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-21T19:50:25.751106] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-21T19:50:26.551009] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-21T19:50:26.633884] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T19:50:26.785240] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T19:50:27.330213] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-21T19:50:27.333535] [INFO ] [REMOTE ] MEC: Full fetch complete (22991 records). [2025-10-21T19:50:27.333614] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-21T19:50:27.356180] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-21T19:50:27.706169] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-21T19:50:27.706280] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-21T19:50:27.706861] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-21T19:50:27.706924] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-21T19:50:27.707596] [DEBUG] [LOCAL ] MEC: Trimmed 22991 records to 16796 (keeping 200 days of data) [2025-10-21T19:50:27.802742] [DEBUG] [LOCAL ] MEC: Primary data saved (16796 records). [2025-10-21T19:50:27.802876] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-21T19:50:27.802977] [INFO ] [MAIN ] Update Progress: 1322/2366 symbols completed. MEC took 25.5s. Estimated remaining: 2h 14m 34s. Rate: 7.8 symbols/min [2025-10-21T19:50:27.974370] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:50:27.994370] [DEBUG] [LOCAL ] MEGI: Loaded 19796 existing records from primary storage. [2025-10-21T19:50:27.994588] [INFO ] [MAIN ] MEGI: Loaded 19796 existing records. [2025-10-21T19:50:28.174447] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:50:28.154820] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-21T19:50:28.175123] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-21T19:50:28.175893] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-21T19:50:28.176084] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-21T19:50:28.176139] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-21T19:50:28.540425] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:50:28.638806] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-21T19:50:28.951041] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-21T19:50:29.241404] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-21T19:50:29.751001] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-21T19:50:30.551027] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-21T19:50:30.602384] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T19:50:30.844836] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-21T19:50:31.351023] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-21T19:50:31.672122] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-21T19:50:31.675330] [INFO ] [REMOTE ] MED: Full fetch complete (31819 records). [2025-10-21T19:50:31.675415] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-21T19:50:32.049051] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-21T19:50:32.049138] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-21T19:50:32.049823] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-21T19:50:32.049886] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-21T19:50:32.050616] [DEBUG] [LOCAL ] MED: Trimmed 31819 records to 21011 (keeping 200 days of data) [2025-10-21T19:50:32.153481] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-21T19:50:32.176106] [DEBUG] [LOCAL ] MED: Primary data saved (21011 records). [2025-10-21T19:50:32.176196] [INFO ] [MAIN ] MED: Full history saved. [2025-10-21T19:50:32.176267] [INFO ] [MAIN ] Update Progress: 1323/2366 symbols completed. MED took 29.8s. Estimated remaining: 2h 14m 23s. Rate: 7.8 symbols/min [2025-10-21T19:50:32.349990] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:50:32.379920] [DEBUG] [LOCAL ] MEI: Loaded 31501 existing records from primary storage. [2025-10-21T19:50:32.380196] [INFO ] [MAIN ] MEI: Loaded 31501 existing records. [2025-10-21T19:50:32.561217] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:50:32.561414] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-21T19:50:32.561460] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-21T19:50:32.561675] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-21T19:50:32.561732] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-21T19:50:32.935169] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:50:32.950985] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-21T19:50:33.235068] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T19:50:33.302106] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-21T19:50:33.751019] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-21T19:50:34.308764] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-21T19:50:34.351918] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-21T19:50:34.551044] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-21T19:50:35.351070] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-21T19:50:35.840866] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T19:50:36.151024] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-21T19:50:36.850109] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T19:50:36.951019] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-21T19:50:37.288107] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-21T19:50:37.751101] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-21T19:50:38.275923] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T19:50:38.551000] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-21T19:50:38.831138] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T19:50:39.351049] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-21T19:50:39.804533] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T19:50:39.811377] [INFO ] [REMOTE ] MEG: Full fetch complete (47471 records). [2025-10-21T19:50:39.811621] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-21T19:50:40.160422] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-21T19:50:40.213385] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-21T19:50:40.213469] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-21T19:50:40.214403] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-21T19:50:40.214466] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-21T19:50:40.215439] [DEBUG] [LOCAL ] MEG: Trimmed 47471 records to 31613 (keeping 200 days of data) [2025-10-21T19:50:40.404464] [DEBUG] [LOCAL ] MEG: Primary data saved (31613 records). [2025-10-21T19:50:40.404613] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-21T19:50:40.404729] [INFO ] [MAIN ] Update Progress: 1324/2366 symbols completed. MEG took 23.8s. Estimated remaining: 2h 14m 16s. Rate: 7.8 symbols/min [2025-10-21T19:50:40.586346] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:50:40.636695] [DEBUG] [LOCAL ] MET: Loaded 53307 existing records from primary storage. [2025-10-21T19:50:40.637030] [INFO ] [MAIN ] MET: Loaded 53307 existing records. [2025-10-21T19:50:40.830577] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:50:40.830889] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-21T19:50:40.830945] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-21T19:50:40.831143] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-21T19:50:40.831199] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-21T19:50:40.956140] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-21T19:50:41.231197] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:50:41.236190] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T19:50:41.244407] [INFO ] [REMOTE ] MDU: Full fetch complete (70675 records). [2025-10-21T19:50:41.244520] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-21T19:50:41.649317] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-21T19:50:41.649472] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-21T19:50:41.650856] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-21T19:50:41.650934] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-21T19:50:41.652386] [DEBUG] [LOCAL ] MDU: Trimmed 70675 records to 48021 (keeping 200 days of data) [2025-10-21T19:50:41.753279] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-21T19:50:41.855161] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T19:50:41.989986] [DEBUG] [LOCAL ] MDU: Primary data saved (48021 records). [2025-10-21T19:50:41.990148] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-21T19:50:41.991153] [INFO ] [MAIN ] Update Progress: 1325/2366 symbols completed. MDU took 39.7s. Estimated remaining: 2h 14m 4s. Rate: 7.8 symbols/min [2025-10-21T19:50:42.177947] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:50:42.175749] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T19:50:42.224177] [DEBUG] [LOCAL ] MFA: Loaded 45743 existing records from primary storage. [2025-10-21T19:50:42.224456] [INFO ] [MAIN ] MFA: Loaded 45743 existing records. [2025-10-21T19:50:42.405123] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:50:42.405391] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-21T19:50:42.405459] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-21T19:50:42.405700] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-21T19:50:42.405755] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-21T19:50:42.553637] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-21T19:50:42.769004] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:50:43.350997] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-21T19:50:43.526477] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T19:50:44.150999] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-21T19:50:44.228191] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T19:50:44.918714] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T19:50:44.950986] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-21T19:50:45.751060] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-21T19:50:45.933418] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T19:50:46.465080] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T19:50:46.536153] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T19:50:46.550972] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-21T19:50:47.351069] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-21T19:50:47.799999] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T19:50:48.151006] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-21T19:50:48.310124] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T19:50:48.951052] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-21T19:50:49.751011] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-21T19:50:49.980007] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T19:50:50.504787] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T19:50:50.550989] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-21T19:50:51.279322] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T19:50:51.350997] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-21T19:50:51.919867] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T19:50:52.151043] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-21T19:50:52.951012] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-21T19:50:53.165826] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T19:50:53.542629] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T19:50:53.751054] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-21T19:50:54.551013] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-21T19:50:54.740222] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T19:50:55.350999] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-21T19:50:55.751396] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-21T19:50:55.821752] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T19:50:55.826430] [INFO ] [REMOTE ] MEI: Full fetch complete (45368 records). [2025-10-21T19:50:55.826516] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-21T19:50:56.138909] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-21T19:50:56.154855] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-21T19:50:56.237130] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-21T19:50:56.237220] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-21T19:50:56.238081] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-21T19:50:56.238144] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-21T19:50:56.239229] [DEBUG] [LOCAL ] MEI: Trimmed 45368 records to 31387 (keeping 200 days of data) [2025-10-21T19:50:56.419938] [DEBUG] [LOCAL ] MEI: Primary data saved (31387 records). [2025-10-21T19:50:56.420072] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-21T19:50:56.420803] [INFO ] [MAIN ] Update Progress: 1326/2366 symbols completed. MEI took 24.2s. Estimated remaining: 2h 14m 1s. Rate: 7.8 symbols/min [2025-10-21T19:50:56.597431] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:50:56.604935] [DEBUG] [LOCAL ] MFAN: Loaded 4316 existing records from primary storage. [2025-10-21T19:50:56.605142] [INFO ] [MAIN ] MFAN: Loaded 4316 existing records. [2025-10-21T19:50:56.780162] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:50:56.780383] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-21T19:50:56.780448] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-21T19:50:56.780694] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-21T19:50:56.780780] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-21T19:50:56.960145] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-21T19:50:57.143500] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:50:57.751006] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-21T19:50:57.833438] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T19:50:58.086760] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-21T19:50:58.255933] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-21T19:50:58.551048] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-21T19:50:59.351100] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-21T19:51:00.140763] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T19:51:00.152181] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-21T19:51:00.521297] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-21T19:51:00.951023] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-21T19:51:01.751013] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-21T19:51:02.233521] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-21T19:51:02.432323] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-21T19:51:02.550998] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-21T19:51:02.761698] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-21T19:51:03.351037] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-21T19:51:04.151015] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-21T19:51:04.254995] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T19:51:04.352282] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T19:51:04.951021] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-21T19:51:05.751073] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-21T19:51:05.944293] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T19:51:05.943577] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T19:51:05.957098] [INFO ] [REMOTE ] MEGI: Full fetch complete (29041 records). [2025-10-21T19:51:05.957275] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-21T19:51:06.343945] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-21T19:51:06.344022] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-21T19:51:06.344707] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-21T19:51:06.344769] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-21T19:51:06.345446] [DEBUG] [LOCAL ] MEGI: Trimmed 29041 records to 19774 (keeping 200 days of data) [2025-10-21T19:51:06.462807] [DEBUG] [LOCAL ] MEGI: Primary data saved (19774 records). [2025-10-21T19:51:06.462939] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-21T19:51:06.463018] [INFO ] [MAIN ] Update Progress: 1327/2366 symbols completed. MEGI took 38.7s. Estimated remaining: 2h 13m 55s. Rate: 7.8 symbols/min [2025-10-21T19:51:06.556101] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-21T19:51:06.634383] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:51:06.666450] [DEBUG] [LOCAL ] MFAO: Loaded 3969 existing records from primary storage. [2025-10-21T19:51:06.666692] [INFO ] [MAIN ] MFAO: Loaded 3969 existing records. [2025-10-21T19:51:06.850050] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:51:06.850236] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-21T19:51:06.850284] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-21T19:51:06.850406] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-21T19:51:06.850443] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-21T19:51:07.213567] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-21T19:51:07.242620] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:51:07.350992] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-21T19:51:07.978414] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-21T19:51:08.151025] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-21T19:51:08.951016] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-21T19:51:09.217792] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T19:51:09.228454] [INFO ] [REMOTE ] MFA: Full fetch complete (65287 records). [2025-10-21T19:51:09.228732] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-21T19:51:09.634881] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-21T19:51:09.636693] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-21T19:51:09.636878] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-21T19:51:09.638007] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-21T19:51:09.639832] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-21T19:51:09.641331] [DEBUG] [LOCAL ] MFA: Trimmed 65287 records to 45661 (keeping 200 days of data) [2025-10-21T19:51:09.752906] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-21T19:51:09.921760] [DEBUG] [LOCAL ] MFA: Primary data saved (45661 records). [2025-10-21T19:51:09.921907] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-21T19:51:09.922628] [INFO ] [MAIN ] Update Progress: 1328/2366 symbols completed. MFA took 27.9s. Estimated remaining: 2h 13m 44s. Rate: 7.8 symbols/min [2025-10-21T19:51:10.096226] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:51:10.134889] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-21T19:51:10.206973] [DEBUG] [LOCAL ] MFC: Loaded 51048 existing records from primary storage. [2025-10-21T19:51:10.207352] [INFO ] [MAIN ] MFC: Loaded 51048 existing records. [2025-10-21T19:51:10.387588] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:51:10.387821] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-21T19:51:10.387879] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-21T19:51:10.388057] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-21T19:51:10.388094] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-21T19:51:10.493124] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-21T19:51:10.551263] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-21T19:51:10.753815] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2025